My company operates many websites. I've run Sprout on about 20 of them and the report always shows that no sitemap URLs were found in the robots.txt file. I've verified with my team that our robots files do indeed includ (...)
This url has a 302 redirect https://www.blauerusa.com/es/mujer/chaquetas/plumifero-de-nailon (...)
The <meta name="robots" content="none"> is not detected and the extension UI states " Meta Robots: index "
Want to submit something? We're looking forward to your ideas.
Join now