What is now Blackberry Hill Hospital was first built as a prison in 1779 to hold naval prisoners of war who were being landed on the quay side at Bristol during the American War of Independence and later, the Napoleonic Wars. In 1783, George lll recognised the 13 United States as free and independent and the prisoners, who were mostly Dutch and Spanish, were sent home.  

Ten years later, in 1793, when France declared war, Stapleton Prison was once again prepared for use for French prisoners of war.

The prison was enlarged in 1804 and a further building was added. This building is still here, as is the Militia Garrison Guard House and mess house.

With the Treaty of Paris in 1814, the prisoners of war were released and the buildings were used first as an arsenal and then as a marine school for errant boys.

After the 1834 cholera outbreak which led to many deaths through overcrowding at St Peter's Hospital, the city's first workhouse, the Guardians of the Poor first rented, and then purchased, the old prison. It then became Stapleton Workhouse and remained so until WW1.