Terence Reeves-Smyth explores the eccentric history of this charming country house as it celebrates sixty years of public access