[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Anti Capitalism?

At 10:51 AM -0800 1/3/97, Kent Crispin wrote:

3) DNS gropers will have pulled all this data into a white-pages
directory services anyway.

What is the standard for crawling through the DNS space? Are these
robots going to respect TTLs? The web crawlers are a nightmare to
synchronize with real pages. Half the pages in AltaVista don't exist
anymore. This is going to create a huge "DNS lag". I really don't think
this is the right direction to go in. Enhancing DNS, or building a
bridge to whois makes much more sense.


Regards,

Simon

--
If at first you don't succeed, skydiving is not for you.