San Giacomo del Colosseo used to stand right by the Colosseum at its east end, where its ruined outer wall terminates. It was not attached to the monument, although there was only a narrow gap between them.
There was a small hospital attached, and the two formed a detached set of buildings. The complex was demolished in 1815, because its proximity to the Colosseum was deemed to be aesthetically unpleasing. A map on the external website shows the arrangement.