Brougham Hall is a 13th century fortified manor house, founded by Gilbert de Broham. In 1307, Ricardus de Brun of Dummaloch, founded the stone hall when he was granted a licence to crenellate. In the 16th century, there was a complex range of buildings, which included a manor house, a byre and a gate, to which a 17th century pele tower was added. Later in the 17th century, Lady Anne Clifford restored the hall but the site was largely rebuilt in the 19th century. A mile north-east is Brougham Castle and 2 miles north-west is Penrith Castle.