How do I let AI assistants in, and keep the rest out?
Pick who may read your site, from Google to ChatGPT, and download the file.
Questions people ask.
What is a robots.txt file?
A small text file at yourwebsite.com/robots.txt that tells visiting robots, like Google and ChatGPT, which parts of your site they may read. The well-known ones follow it.
Should I let AI assistants in?
If you want to come up when people ask ChatGPT or Perplexity for a business like yours, yes. Some robots only collect writing to build AI, and you can keep those out while the assistants come in.
Where does the file go?
In the top folder of your site, so it opens at yourwebsite.com/robots.txt. Most website builders, like Shopify and Wix, have a place for it in their settings.
Could this stop Google finding me?
No. The file only names AI robots. Every other robot, Google included, stays let in by its first two lines.
Check the rest of your site.
- How does my Google listing look next to the places near me?
- Why isn't this page showing up on Google?
- What does my page look like in Google results?
- What does Google think my site is about?
- Can Google find all my pages?
- Can ChatGPT read my website?
- Why don't I get stars or prices in Google?
- Do my links open when people click them?
Find your next customers.
Be the name people find on Google, hear about from friends and choose, week after week.
Free to start. Cancel any time.