This is not compatible with pgbouncer, so anything relying on admin/psql breaks entirely. The correct way to do this, is to:

ALTER USER some_user SET SEARCH PATH = musicbrainz, public;

And then the search_path will always be correct.