The Papal Palace in Avignon is a castle where popes lived in the 14th century. The stone walls are thick and the interior is spacious, with the halls and chapels retaining their original structure, giving a sense of medieval solemnity. The adjacent Pont Saint-Bénézet is the broken bridge mentioned in the song, and the view from the palace rooftop is expansive, overlooking the Rhône River and the old town.