Queen Mary's House was originally a 16th century bastle house, which had a first floor hall and an attic, above a vaulted basement. In the 16th and 17th century, the Kerr family altered the bastle, when integrating it into a T-plan tower house. The main block is of three storeys, with a centrally projecting wing of four storeys and a left-hand stair turret in the angle. A vault pend leads to the original entrance and the coat of arms over the doorway, suggests that this house belonged to the Wigmer family. The tower was one of at least six in Jedburgh in the 16th century and tradition says that this was the building, Queen Mary leased from Lady Ferniehirst in 1566 and visited her lover Bothwell at Hermitage Castle, while she was in residence. Nearby is Jedburgh Castle and 2 miles north-west is Lanton Tower.