Millrigg House was originally a 15th century stone pele tower, founded by the Birkbeck family. In the 16th century, it was absorbed in the complex alterations of a substantial two storey stronghouse. The three feet thick walls, are provided with defensive slits and on the doorhead is a datestone of 1597. 4 miles west is Brougham Castle and 8 miles south-east is Appleby Castle.