How to install robots.txt
cPanel / FTP
- Click Download robots.txt.
- Open cPanel → File Manager → public_html (the main folder of your site).
- Click Upload and choose the file (replace the old one if asked).
- Check it opens at yourwebsite.com/robots.txt.
WordPress
- Install Yoast SEO or Rank Math.
- Yoast: SEO → Tools → File editor. Rank Math: General Settings → Edit robots.txt.
- Paste the text and save.
Shopify / Wix
- Shopify: Online Store → Themes → Edit code → Add template → robots.txt.
- Wix: SEO Tools → Robots.txt Editor.
- Paste the text and save.
How to use the Robots.txt Generator
- Choose the default rule and folders to block.
- Add your sitemap address.
- Copy or download robots.txt and upload it to your website root.
Frequently asked questions
Can robots.txt hide a page from Google?
No – it only stops crawling. To keep a page out of search results use a "noindex" meta tag instead.