Dubbed the “Holiday House,” the Watch Hill mansion was bought by Swift in 2013, complete with an Olympic-sized swimming pool and a past that ties it to the Standard Oil fortune.