Initially known as the Castle of Ruthven, this was where the family of the same name would meet to hunt. In 1582, the Raid of Ruthven, an episode in the struggle between certain noblemen and royalty. The castle was confiscated in the 17C and handed to a favourite of the King.