-
Posts
-
When I looked at Google Webmaster tools this morning I noticed what it shows for in my robots.txt file:
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/Wouldn’t I also want to disallow /symbiostock_rf as well to prevent google indexing my high res files?
On a mechanical note, from my site root, my files are actually
/blog/wp-admin/
/blog/wp-includes/
/blog/symbiostock_rf/And I don’t have a robots.txt file on my site.
So I’ve added one and we’ll see what happens, but if anyone knows a reason to remove the line disallowing the symbiostock_rf directory, please let me know 🙂
I think the answer is that those folders are not accessible through any URL based search – ie you can’t put http://www.digitalbristles.com/blog/symbiostock_rf/ and get anything. So Google can’t see them.
Steve
You must be logged in to reply to this topic.