Besides three incarnations of the Doctor being imprisoned in the Tower of London (at the same time!) during 2013’s 50th anniversary special The Day of the Doctor, fans also discovered that this is also where the Black Archives are located. There’s a lot of history within those walls! Not that you’d remember ever being there, of course. Everyone has their memory promptly wiped after each visit. It’s probably for the best.