Host, protocol and port matter
robots.txt rules apply to the host, protocol and port where the file is served. A rule on one hostname does not automatically govern another.
Website + SEO
Fetch the root robots file, see declared sitemap URLs, and test whether a selected path is allowed for a chosen crawler token.
Result
Links re-run the check live.
robots.txt rules apply to the host, protocol and port where the file is served. A rule on one hostname does not automatically govern another.
Blocking crawling can prevent a crawler from seeing page-level indexing directives. Use the right control for the actual indexing goal.
Major crawlers support Sitemap fields in robots.txt. The declared location may be on another verified host.
The path tester uses common Google-style longest-match behavior, including Allow winning equal-length ties. Other crawlers may support different extensions.
Your current site stays online until your new one is ready. You approve the copy first, and if anything is not right we switch you back right away. The price you pick is the price you renew at.