Coldred Court was possibly a Roman or Saxon fortified camp and within is the church of St Pancras. In the 11th century, Bishop Odo of Bayeux, half-brother of William the Conqueror, founded a earthwork motte and baileys castle on the site. Later the irregular earthwork enclosure became a fortified manorial complex, founded by the Maison Dieu Hospital, of Dover. In the 16th century after the Reformation, the manor house was sold to the Culpepper family, by King Henry VIII. The overgrown motte, is encased by a ditch and there are conspicuous ramparts, on two sides of the churchyard. 6 miles south-east is Dover Castle and 7 miles east is Old Walmer Court.