Possible to download entire whois database / list of registered domains?

Posted by Parand on Stack Overflow See other posts from Stack Overflow or by Parand
Published on 2008-11-21T01:38:42Z Indexed on 2010/04/19 0:43 UTC
Read the original article Hit count: 319

Filed under:

whois

|

domains

I wanted to do some analysis on registered domain names. Looks like I can hit whois.internic.net to get information about each domain, but it also looks like there are rate limits that prevent me from doing large numbers of queries.

Is there a way to periodically (say daily) grab the entire whois database? I really only care about whether a domain is registered or not, so I don't need the full whois information.

© Stack Overflow or respective owner

Related posts about whois

Whois list of Top Level Domain against their corresponding registrar

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm trying to find a list of TLD's to their corresponding whois server, for example .com americanWhoisServer .net someOtherWhoisServer .au australianWhoisServer In the end i'm aiming for something like a Dictionary where the key is the TLD and the value is the whois server address (eg whois.apnic… >>> More
Spam in Whois: How is it done and how do I protect my domain?

as seen on Server Fault - Search for 'Server Fault'
Yes, there are answered questions regarding spam in Whois. But still unclear: How do they do it? How should I respond? What precautions can I take? For example: Whois for google.com [...] Server Name: GOOGLE.COM.ZOMBIED.AND.HACKED.BY.WWW.WEB-HACK.COM IP Address: 217.107.217.167 Registrar:… >>> More
Modifying IP Whois results?

as seen on Server Fault - Search for 'Server Fault'
Okay, I recently bought a dedicated server from santrex.net If you go here: http://domaintoip.com/ip.php?domain=188.72.215.27 It displays the whois information for that IP, santrex.net I want to modify my whois information, so that it displays my information instead, and doesn't link to santrex… >>> More
How do I do an exact whois search?

as seen on Server Fault - Search for 'Server Fault'
When I execute the following whois command on my Ubuntu server, I get all sorts of other domains which contain google.com in the name, but clearly aren't owned by google. As this appears to be some sort of spam, I won't paste the output here. I'd like to check for exactly the name I typed in. I… >>> More
Is it OK for the top level domain .FM not to provide the whois server? [closed]

as seen on Super User - Search for 'Super User'
just a question in the title Is it OK for the top level domain .FM not to provide the whois server? Are there any other TLD that behaves in the same manner? The question came out of the whois command answer $ whois dot.fm This TLD has no whois server, but you can access the whois database at http://www… >>> More

Related posts about domains

Why does this mod_rewrite rule 'not-match'? (big rewrite log included)

as seen on Server Fault - Search for 'Server Fault'
I've got a scenario involving two domains: WordPress site hosted on domain1.com domain2.co.uk, simply redirecting users to domain1 via mod_rewrite This rule applies irrespective of whether www. is specified or not. (It's eventually removed from the URL, I'm a no-WWW fan.) There's nothing on domain2… >>> More
Best Practices - updated: which domain types should be used to run applications

as seen on Oracle Blogs - Search for 'Oracle Blogs'
This post is one of a series of "best practices" notes for Oracle VM Server for SPARC (formerly named Logical Domains). This is an updated and enlarged version of the post on this topic originally posted October 2012. One frequent question "what type of domain should I use to run applications… >>> More
Google Apps for Domains, Multiple Domains

as seen on Server Fault - Search for 'Server Fault'
I have a primary google apps for domains account which I use for my personal email, calender, docs etc and is great. I also receive my pop3 company email via settings-Get mail from other accounts in my account. Due to spam I want to make use of gmail servers for my company email and have two options: [1]… >>> More
IIS 7 + Domains and Sub Domains

as seen on Server Fault - Search for 'Server Fault'
I have setup 1 Domain and 1 Sub domain in IIS 7 - Set the bindings/ports etc When I browse to the subdomain url I get the website of the main domain. I have not configured an A record for the subdomain. Is this the problem? Its the same if I browe the non www version it rewrites or redirects to… >>> More
Sendmail - Multiple Domains, One Box - Blocking One Or Two Domains

as seen on Server Fault - Search for 'Server Fault'
I have a number of domains hosted at a web hosting service. They use sendmail to handle incoming email. I have six domains on this service (which we can call aaa.com, bbb.com and so on). Each email account has the same name and one email box. In other words, [email protected], [email protected], tango@fff… >>> More