The Bayle is a 12th century stone two storey gatehouse, of the Augustinian priory. In 1143, during the Anarchy in the reign of King Stephen, the priory and The Bayle, were fortified by William le Gros, with the priory being granted licence to crenellate in 1388, by King Richard II. The large vehicular archway of The Bayle, was the priory's main entrance and the interior passage gives access to small chambers, both with a garerobe, one being the porter's lodge and the other a prison. Accessed by spiral stairs, is a large first floor chamber, used as the Court of the Priors and although altered and repaired in brick during the 17th century, the gate, still retains its original form and arrangement. 4 miles north-east is Flamborough Castle and 6 miles south-west is Burton Agnes Manor House.