Tool bulk nameserver deleted domains

[Jonh Borin]

hello guys Are there a tool that gives bulk nameserver to previously ended domains

 

[twiki]

hello guys Are there a tool that gives bulk nameserver to previously ended domains

Might be one soon, once Dotible is fully up (see my sig). But it won't have the ns of domains deleted BEFORE its launch.

What do you want to accomplish? Just asking so if I see how I can help out.

 

[Jonh Borin]

Might be one soon, once Dotible is fully up (see my sig). But it won't have the ns of domains deleted BEFORE its launch.

What do you want to accomplish? Just asking so if I see how I can help out.

I want to know the domains that were on brandbucket and squadhelp, And her companions didn't renew her, and she fell. Now it is available again.

 

[twiki]

I want to know the domains that were on brandbucket and squadhelp, And her companions didn't renew her, and she fell. Now it is available again.

Good one, thumbs up for the idea.

Yes I could help with that. I'm just working right now on the data mining portion of the site, an initial version will be live soon and nameservers are already in.

Side note I dropped quite a lot of SH .COM's as well. They might still be in the dropping phase or dropped. I'm not even keeping track of them.

Let's keep in touch if you agree and you can check it out once done. Send me a DM in case I forget.

This is a valid use case for my data, although it's a small niche but there are other types of users wanting the NS data for other reasons, so it makes sense. Within a couple weeks or so the tool should be live, and then it will "remember" all this data.

Note, this will probably be not free anywhere so just as a paid option. Although not a high priced one (like those looking for enterprise grade data would be expected to pay) but more of everyday user's one.

For the sole reason it requires quite a bit of storage and processing. From the outside is hard to figure. To go back in history you need tons of snapshots of all domains in the world, well one such snapshot takes a ton of data space and filtering through it also has its incurring costs. Even if someone else pays for the data, there's still running cost to be covered. This is why certain tools like DotDB are not free and there's not many of them available.

Just saying where I expect it goes. Some limited searches will be free on the site though.

Edit: Check this tool: https://dotible.com/domain-tools/bulk-registered-tld-checker . Might give you a hint of how big the data is and power behind it. The tool gives you all registered TLD's for a list of 100 domains for free instantly, but it can also do that for 1M domains if a client needs that.

In a similar fashion will work your needed NS search (but better, this is just an unfinished /unpolished initial version out there).

 

[okaydomains]

I want to know the domains that were on brandbucket and squadhelp, And her companions didn't renew her, and she fell. Now it is available again.

I see this happen all the time with Afternic listed domains but rarely SH (although I have caught a few). Never checked for BB domains.

I suspect there's just a lot less SH/BB names in general, as compared to Afternic.

Would definitely like to see this as a tool, @twiki!

 

[twiki]

I see this happen all the time with Afternic listed domains but rarely SH (although I have caught a few). Never checked for BB domains.

I suspect there's just a lot less SH/BB names in general, as compared to Afternic.

Would definitely like to see this as a tool, @twiki!

Sure thing! Please hit me with a DM in a couple weeks if I don't say anything.

( reason is, I might lose track - too much stuff wobbling around my head, not just this new startup, I'm running 3 businesses at the same time, now I have to move the entire warehouse for physical/brick mortar one. You can imagine I lose track on contacts and messaging due to volume. )

 

[twiki]

@Jonh Borin , @okaydomains , additional question.

What is the status of the domain you search? I guess you want a specific status. Expired, pending delete, or fully deleted only?

This raises quite some special requirements so I need to know.

It might require a massive Whois live poll to determine which are still available or not... some of them will be re-taken meantime... etc. That is quite a challenge so I will be looking at ways to optimize the tasks.

Edit: And I can offer live bulk Whois for certain TLDs only, .com and .net so far. Not so much for others. So it all depends on what data to pull exactly. Might have to mix in some other data sources for it.

 

[PoMa]

Besides @twiki 's tool, you can query/parse hosterstats to find already dropped domains that were published in SH/BB, but the amount of queries is limited per IP address.

You can also contact @domainior or follow him on twitter. He/she used to publish expired SH and BB domains here.

 

[okaydomains]

@Jonh Borin , @okaydomains , additional question.

What is the status of the domain you search? I guess you want a specific status. Expired, pending delete, or fully deleted only?

This raises quite some special requirements so I need to know.

It might require a massive Whois live poll to determine which are still available or not... some of them will be re-taken meantime... etc. That is quite a challenge so I will be looking at ways to optimize the tasks.

Edit: And I can offer live bulk Whois for certain TLDs only, .com and .net so far. Not so much for others. So it all depends on what data to pull exactly. Might have to mix in some other data sources for it.

I'm interested in domains that are in redemption or pending delete. I guess I'm interested in fully deleted but I assume they're crap if still available for hand reg so I don't spend a lot of time on those domains myself.

I'm willing to buy from expired domain auctions.

Its a hard problem because you can't just check the nameservers. They're often replaced with the registrars' nameservers during the redemption period, and even if not plenty of people use SH's nameservers for their private label names (which I do not care about).

I have this worked out for Afternic. Its a decent signal of good domains but its not overwhelmingly good. There's a lot of crap on Afternic, even if its highly priced. I'd be more interested in SH/BB accepted domains because of the human element.

 

[twiki]

I'm interested in domains that are in redemption or pending delete. I guess I'm interested in fully deleted but I assume they're crap if still available for hand reg so I don't spend a lot of time on those domains myself.

I'm willing to buy from expired domain auctions.

Its a hard problem because you can't just check the nameservers. They're often replaced with the registrars' nameservers during the redemption period, and even if not plenty of people use SH's nameservers for their private label names (which I do not care about).

I have this worked out for Afternic. Its a decent signal of good domains but its not overwhelmingly good. There's a lot of crap on Afternic, even if its highly priced. I'd be more interested in SH/BB accepted domains because of the human element.

Yes I pretty much figured that. Fully deleted would probably not help.

Hmm, have to think better over technicals.

What about TLD's? I can primarily do this for .com and .net at this stage. Not so much for other tld's.

 

[okaydomains]

What about TLD's? I can primarily do this for .com and .net at this stage. Not so much for other tld's.

In addition to .com, I am also interested in app, club, dev, finance, io, link, network, pro, shop, tech, tv, xyz, and zone.

I don't care about .net.

Edit: SH allows a list of TLDs thats bigger than what's listed in their submission guidelines, but its still < 20 TLDs. That would be a good starting place.

 

[Jonh Borin]

@Jonh Borin , @okaydomains , additional question.

What is the status of the domain you search? I guess you want a specific status. Expired, pending delete, or fully deleted only?

This raises quite some special requirements so I need to know.

It might require a massive Whois live poll to determine which are still available or not... some of them will be re-taken meantime... etc. That is quite a challenge so I will be looking at ways to optimize the tasks.

Edit: And I can offer live bulk Whois for certain TLDs only, .com and .net so far. Not so much for others. So it all depends on what data to pull exactly. Might have to mix in some other data sources for it.

deleted only

 

[twiki]

Might be able to do this only for .coms for now. It's half of the market anyway...

 

[okaydomains]

Might be able to do this only for .coms for now. It's half of the market anyway...

.com is probably > 90% of the domains listed on SquadHelp anyway. I don't have experience with BrandBucket but its probably similar.

.com only seems fine.

 

[twiki]

The point is, I just realized, this whole thing will have to be a byproduct of another product - bulk Whois data. You cannot know what a domain status is without Whois bigdata. If this one ever gets a chance.

That is a BIG business.

Here's an example: https://www.whoisxmlapi.com/whois-database-download.php

They used to have some prices (in many hundreds or thousands and up). Now, it's just request a quote. No wonder.

So I need to build this first before doing the other (byproduct). Side note I know this well, been working on it for a while (few years) as well as other tech.

But once that is built, unsure if I (or anyone else) might be interested in doing that domain research tool anymore. It's simply... pennies vs the real money and our lifetime is limited.

Anyway, just thoughts.

 

[twiki]

See about the stale aspect here:

https://whois.whoisxmlapi.com/database/specifications/datafeed-files

Quarterly.

And incremental, which means "fresh bits here and there"

This is not bad work on their part. It is how things are.

Edit: Funny, you can't even download a sample without signing up and then their reps pounding you with some offer.

 

[twiki]

Actually I think the tool might be doable, and soon-ish.

I've just pulled SH domains. only 1000 names are non-coms... So there is no point really in actually working on the other tld's.

Running other tests now.

 

[twiki]

I found one available domain so far, in case one of you wants it:

sun-nergy.com

Important though there is no guarantee a domain has been approved or just pointed via nameservers but never made it into SH.

 

[okaydomains]

Important though there is no guarantee a domain has been approved or just pointed via nameservers but never made it into SH.

This is what makes it a hard problem. I suspect most you'll find will just be pointed at the SH nameservers, but not approved.

 

[twiki]

Okay so here is how it went. Nothing found.

All the domains I have in list pointing at SH nameservers (165k, quite a lot) are still active and most have plenty of validity ahead, even for 2 years. Except the dashed one I posted above.

It is possible the data I have is too fresh so there is no 'former SH' in, expired or expiring.

Will check again in a couple weeks or so and see what's going on.