Ayton Castle is a late 14th century three storey stone tower house, with rib-vaulted chambers and twin mural stairs to give access to the upper floors. One corner stands to the height of the wall-head, where surviving corbels give evidence of a machicolated parapet and a corner turret. To the east are the remnants of the inner and outer bailey ramparts, with the grass covered foundations of an inner gateway and traces of fishponds. 3 miles south-west is Castle Hill and 5 miles north-east is Scarborough Castle.