Remnants of Brisbane’s convict period lasted centuries, gone inside days