London may have a reputation for being expensive, but that doesn’t have to stop you from experiencing its history. Check out these centuries-old traditions in the U.K. capital that don’t cost a pence.

Debates in the House of Parliament

Curious about what exactly takes place inside Westminster Palace? This iconic building along the Thames is the seat of U.K. Parliament, comprising two houses: the House of Commons and the House of Lords. Debates in both houses are open to the public, giving you an interesting look at the government as well as a sneak peek at the palace’s beautiful, historic interior — from the detailed mosaics in the Central Lobby to the vaulted ceiling and statues of St. Stephen’s Hall.

Old Bailey Public Galleries

Witness the British justice system at work inside the Central Criminal Court of Old Bailey. Here, the open public galleries give visitors a bird’s–eye view of legal proceedings rooted in the original medieval court of 1585. After listening to solicitors in their black robes and wigs for a couple of hours, you might even start addressing friends as “My Lord” or “My Lady” for the rest of the day.

Evensong at Westminster Abbey

Experience a millennium of history inside one of London’s most recognized buildings. Construction didn’t begin until 1245, but the church’s traditional evening choral service dates back to the arrival of Benedictine monks in the 10th century.

Changing of the Guard at Buckingham Palace

When the royal residence was moved to Buckingham Palace in 1837, the sovereign’s household troops stayed behind at St. James Palace. Since then, they have continued to march down the Mall every morning to relieve the old guard. Snag a prime spot outside the palace’s gilded gates and see how many bearskin hats you can count as the guards file in.

Key Ceremony at the Tower of London

Catch the phrase “Halt! Who goes there?” in action. With a red-cloaked yeoman warder (also known as a Beefeater) as your guide, discover what happens to Queen Elizabeth’s keys each night as the tower is locked. This nightly ceremony has taken place without fail for more than 700 years — even during the worst bombing raids of World War II. While tickets are free, be sure to request yours at least two months in advance.