Housed in the former bishop's palace (Castres was the seat of a bishopric from 1317 to 1790), the town hall was built in 1669 based on plans by Mansart. On the first floor is the Goya Museum. The Tour St Benoît in the courtyard, a massive Romanesque tower with an elegant portal, is all that remains of the former Abbaye St Benoît.