It is possible to add these webpages on the file to get explicitly overlooked. Robots.txt documents use one thing called the Robots Exclusion Protocol. This Web site will easily generate the file to suit your needs with inputs of web pages to be excluded. Identify the robots.txt file: The robots.txt https://rankingseotoolz.com/robots-txt-generator