The story behind Mansfield Prison, a castle-like building saved from destruction by a Hollywood connection, and vast monolithic structures dominating a tiny island with a dark past