Robots.txt Generator
Free robots.txt generator: build a robots.txt file with disallow rules and your sitemap.
Quick answer: enter your details below and click Generate robots.txt — your result appears instantly, right here in your browser. Nothing you enter is uploaded or stored.
R
SEO & Webmaster
Enter your details below.
How to use
- List the paths to block, one per line.
- Add your sitemap URL.
- Click Generate and save the file as robots.txt at your site root.
About this tool
Robots.txt tells search engine crawlers which parts of your site to skip. This generator builds a standard file with your disallow paths and sitemap location.
Frequently asked questions
Does robots.txt hide pages from search?
It asks crawlers not to crawl them, but it does not remove already-indexed pages or block determined visitors.
Where does robots.txt live?
At your site root, e.g. example.com/robots.txt.