The original, universally respected file for telling any automated crawler — search engine or AI — which parts of your site they may access.
It's the one file in this entire toolkit that every major crawler, AI vendor included, is documented to actually check and honour.
A genuine internet standard (RFC 9309), in use since 1994. If you only publish one file from this list, make it this one.
Site root: example.com/robots.txt
Fill this in and download robots.txt directly — the same generator lives in the full builder alongside the other 15 files.