St Werburgh's Church used to stand at the corner of Small Street and Corn Street. The ancient church was rebuilt, in neo-Gothic style, in 1761 -- rather as Chatterton's poem imitated medieval poetry. In the 1870s, this building was itself taken down and rebuilt on Mina Street, in the St Werburgh's area of Bristol, where it still stands.

Chatterton wrote the 'Song of Seyncte Warburghe', supposedly sung when the first Bristol Bridge was opened in the thirteenth century. He also began a poem, ‘Ynn Auntient Dayes', on the life of St Werburgh – possibly inspired by the church. Accroding to this (fictional) biography, St Werburgh converted the Saxons in Bristol and transferred 644 new converts to Redcliffe, where they dedicated a church to Our Lady and St Werburgh.

Chatterton left the poem unfinished after writing 32 lines. This may have been because he discovered that Saint Werburgh was a woman: Werburga, daughter of one of the Anglo-Saxon kings of Mercia.