# Crawling is intentionally allowed. # # The site currently sends `X-Robots-Tag: noindex` on every response while # the catalogue is test data (see public/_headers). Google has to fetch a # page to see that header, so blocking crawling here would be counter- # productive: the old /pid-* and /cid-* URLs would stay in the index rather # than being dropped. # # When the real catalogue and images are live: remove the noindex header # first, then add the Sitemap line below. User-agent: * Allow: / # Sitemap: https://www.hbmobile.in/sitemap.xml