A 14th centry church, also known as St John-on-the-Wall, is built into and along the city wall. The tower and steeple is build over St John's Gate. The church was heavily modified in the 19th century. It became a redundant church in 1984.