Castle Hill could be of Adulterine origin but it's probably a late 11th century earthwork motte and bailey fortress, founded by Roger de Busli. In the 12th century, William de Lovetot may have founded the stone castle, when crowning the flat-topped mound with a shell keep. A wide ditch cuts off a promontory, to make a large flat western platform and a steep slope formed by the valley of the River Ryton, gives defence to the north. By the time of Leland's 16th century visit, the castle had been demolished and its stones reused in the construction of the priory walls. Nothing is known for certain of its history or layout but the line of what may have been an original bailey, can be faintly traced through the adjacent modern building. 7 miles south-east at Bothamsall is Castle Hill and 9 miles north is Tickhill Castle.