Post #1044 1.41K Sep 18, 2026, 07:33 UTC Досить цікавий і безкоштовний інструмент для перевірки robots.txt від Steven Wilson-Beales https://www.stevenwilsonbeales.com/tools/robots-txt-checker/ Steven Wilson-Beales Robots.txt Checker Enter a domain to see what its robots.txt file tells Google, Bing, ChatGPT, Claude, Perplexity and other AI crawlers, explained in plain English for editors. 👍 3 👎 2