The prison was designed by the Colonial Civil Engineer, George Pilkington. The cornerstone was laid in 1855 and, with the labour of convicts, immigrants and ‘convicted seamen’, construction was completed in 1858 at the cost of £18167. It was the largest prison in the Colony at the time and became a landmark at the entrance to Cape Town.

Roeland Street was named after the Roeland family who lived in the area on a farm purchased in 1789 on the Southeast side of Town. Jacob Roeland (also spelt Rohland) was a wine presser and vine-pruner who arrived at the Cape in 1761 from Leyden. 

There is correspondence in the archival records on how to reduce initial costs of the prison by £5470 to £15 000, (CO 653). It was decided to remove the tower and dispense with “ornamental work”.

Le ntolongo yadizayinwa yiNjineli eyayiliKoloniyali, u, uGeorge Pilkington.  Ilitye lembombo labekwa ngowe-1855 yaza yakhiwa ngamabanjwa, abantu ababephuma kwamanye amazwe nebabesele bengabemi ngeli xesha kunye noomatiloshe ababengamabanjwa wagqitywa ngowe-1858, ingumsebenzi lowo owaxabisa iiponti ezili-18167. Le yaba yeyona ntolongo inkulu eKoloni neyaziwa ngalo iKapa ngelo xesha.

Die gevangenis is deur die Koloniale Siviele Ingenieur, George Pilkington, ontwerp. Die hoeksteen is in 1855 gelê en bouwerk is in 1858 teen ’n koste van £18167 voltooi. Dit sou nie moontlik wees sonder die arbeid van gevangenes, immigrante en ‘veroordeelde matrose’. Op daardie stadium was dit die grootste gevangenis in die Kaapkolonie en dit het ’n baken geword by die ingang na Kaapstad.