A small blue plaque on the outside wall of the building in the Monmouthshire town is the only clue to what happened inside.