Hiding a page from search engines
Search engines like Google constantly crawl the internet in search of new data. When your site is being crawled, your store'srobots.txtfile blocks page content that might otherwise reduce the effectiveness of your SEO strategy by stealingPageRank.
If you made changes or added a page to your site, and you want Google to recrawl your URLs, then you have two options. You can either use the URL Inspection Tool, or submit a sitemap to Google. For more information, refer toAsk Google to recrawl your URLs.
By default, your store'srobots.txtfile tells bots (usually search engine indexing bots, or "crawlers") which pages or files they should or shouldn't request to view from a website. For example, the shopping cart page is requested not to be viewed by search engines because it's unique to individual customers and it isn't useful to be indexed by a search engine.
All Shopify stores have a preconfigured and optimizedrobots.txt.liquidtemplate. If you want to edit your robots.txt, then refer toEditing robots.txt.
You can hide pages that are not included in yourrobots.txt.liquidfile by customizing thesection of your store'stheme.liquidlayout file. You need to include some code to noindex particular pages.