St Ulrich's Church houses a diocesan museum and an exhibition space.