I have users who would like to list their personal web sites on search engines. Despite registering multiple times, their pages still don't seem to be included in the indices. I've tried listing them myself on both Lycos (which tells me the pages were successfully spidered), and Yahoo. Several weeks later, test searches still don't bring up the users' pages.
Is there something in the server settings preventing spiders from accessing personal pages?
