# Bartha Contemporary robots.txt # # One group for every crawler, classic and AI alike. A crawler that finds a # group named for itself reads only that group and ignores this one, so a # named "Allow: /" group would quietly lift every Disallow below for that # crawler. There are therefore no named groups: the wildcard is the policy. # # Only private and infrastructure paths are kept out: the client dashboard, # the CMS studio, the admin app and the API. A pattern ending in a slash does # not cover the bare path, so each is listed both ways. The public catalogue # and the share images are deliberately open under /api. # All public content (artists, exhibitions, works, journal, about) is crawlable. User-agent: * Allow: / Allow: /api/catalogue Allow: /api/og/ Disallow: /api/ Disallow: /studio/ Disallow: /studio Disallow: /client/ Disallow: /client Disallow: /admin/ Disallow: /admin Disallow: /inventory Sitemap: https://www.barthacontemporary.com/sitemap.xml