The Disallow directive triggers on partial matches at the same time. Be as unique as you possibly can when defining the Disallow directive to prevent unintentionally disallowing entry to documents. Identify the robots.txt file: The robots.txt file must be located in the root Listing of the web site you need https://rankingseotoolz.com/robots-txt-generator