A robots.txt file allows you to prohibit the entry of search engine robots that crawl the internet and it may possibly avoid these robots from accessing specific directories and internet pages. Furthermore, it specifies where the XML sitemap file is situated. A sitemap lists URLs that are available for crawling https://lecha201mdq5.ouyawiki.com/user