sitemap and or robots.txt question

[Turan Mirza]

Ah! That is it! It's in the auto generated sitemap. So I am actually pointing to it, not form my site but from my sitemap!!

Keep me right here, can I add a noindex for all bots? i.e. is <meta content="noindex"> ok in the header of just that page?

Also, I thought they were retiring 'noindex' in favour of 'disallow' but that just might be in the context of robots/txt - it's getting harder to just design a page these days.

Many thanks for your fast response.

[Acorn]

I would try and use <META NAME="robots" CONTENT="noindex"> or even <META NAME="robots" CONTENT="noindex, nofollow">.

googlebot (Google labels it Googlebot) traps all of Google user agent crawlers.
I can only assume 'robots' will do every other one as well; else the list is overwhelming: https://www.keycdn.com/blog/web-crawlers.

Acorn