Visiting this estate had long been on my design bucket list. Here's what it was really like.