Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I agree; I'm calling "incorrect" on this for now, pending corroborating sources. I run a few sites that don't contain a robots.txt file, and they are showing on Google just fine. I see links to the home page and several interior pages; all good.




Because you can see pages not affected doesn't guarantee they will stay that way.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: