Im am currently using the link crawler to crawl and capture all external links from a site. Would it be possible to feed the results directly into the whois parser to check to see if any of those domains are expired?
The idea here is to crawl a list of related or competing sites and check for expired domains.
The idea here is to crawl a list of related or competing sites and check for expired domains.