Dynadot

question What's up with all the bot traffic on Undeveloped?

Spaceship Spaceship
Watch

thevictor

Established Member
Impact
167
I recently started tracking my domain traffic via GA on Undeveloped and noticed that I am getting slammed every day with 300+ visits; all from bots.

Not sure if this has something to do with listing on Undeveloped or is that normal?
 
0
•••
The views expressed on this page by users and staff are their own, not those of NamePros.
I've had no such issues with GA integration on Undeveloped. Were you using GA and seeing similar numbers prior to listing with Undeveloped?
 
1
•••
Same problem here with my private marketplace at namecape.com
Bots are real menace nowadays. Apart from distorting the real stats, they consume a lot of resources.
GA can only filter them, it can not stop them.
 
1
•••
I've had no such issues with GA integration on Undeveloped. Were you using GA and seeing similar numbers prior to listing with Undeveloped?

I was using GA with Efty but was not getting anywhere near the bot traffic that I am getting with Undeveloped.

Here is the screenshot just for today:
 

Attachments

  • download (22).png
    download (22).png
    35.1 KB · Views: 253
0
•••
Same problem here with my private marketplace at namecape.com
Bots are real menace nowadays. Apart from distorting the real stats, they consume a lot of resources.
GA can only filter them, it can not stop them.
Exactly! It is pretty annoying!
 
0
•••
Same problem here with my private marketplace at namecape.com
Bots are real menace nowadays. Apart from distorting the real stats, they consume a lot of resources.
GA can only filter them, it can not stop them.

you can redirect them
 
1
•••
I was using GA with Efty but was not getting anywhere near the bot traffic that I am getting with Undeveloped.

Here is the screenshot just for today:

Aachen 1 user thats a real user from germany ;)
 
1
•••
you can redirect them
Using what method/tools ?
IP tracking - forget it, can be faked and doesn't work anymore.
You can end up redirecting real potential buyer - counterproductive.

One idea that comes to mind is using API to connect to AbuseIPDB, see if the IP has been blacklisted before and then (if yes) redirect the traffic to KGB website.:spam::eggface:
 
Last edited:
2
•••
Using what method/tools ?
IP tracking - forget it, can be faked and doesn't work anymore.
You can end up redirecting real potential buyer - counterproductive.

One idea that comes to mind is using API to connect to AbuseIPDB, see if the IP has been blacklisted before and then (if yes) redirect the traffic to KGB website.:spam::eggface:

the IPs that I captured doing bot stuff
have never done anything
a human would have done once in a while
 
2
•••
Aachen 1 user thats a real user from germany ;)

I thought that at first, but then noticed that this "potentially" real user only visits my .net domains, which would be an odd coincidence, given that I have 100+ names listed on Undeveloped. :xf.cool:
 
0
•••
Here is the traffic stats from 5/24 thru today, 5/26...

I am curious if anyone else using Undeveloped has noticed anything similar. As mentioned, I also use Efty and still get some bot traffic, but nowhere near these numbers.
 

Attachments

  • download (23).png
    download (23).png
    47.3 KB · Views: 243
0
•••
I use Undeveloped and did not notice any increase in bot traffic beyond the normal activity, some of which I presume is the legitimate search, etc. bots that crawl the web regularly. I wonder, have you been updating your sites more lately? I find that after I make website changes bot goes up, for a bit, and have always assumed that was related to search and directory bot activity.
 
1
•••
I use Undeveloped and did not notice any increase in bot traffic beyond the normal activity, some of which I presume is the legitimate search, etc. bots that crawl the web regularly. I wonder, have you been updating your sites more lately? I find that after I make website changes bot goes up, for a bit, and have always assumed that was related to search and directory bot activity.
Aside from updating the registrant contact email, there has been no recent changes.

What is odd is that only happens on Undeveloped. Same domain names were listed on Efty and were only getting bot hits once or twice per day...
 
1
•••
Aside from updating the registrant contact email, there has been no recent changes.

What is odd is that only happens on Undeveloped. Same domain names were listed on Efty and were only getting bot hits once or twice per day...

Do you only see it with certain extensions?
 
0
•••
first you have to filter it and acknowledged what bot is it.... there is plenty type of bots...
 
1
•••
Do you only see it with certain extensions?
It seems to be with all of my listings, no matter the extension.
The only exception being traffic from Aachen is specific to .net.
 
1
•••
first you have to filter it and acknowledged what bot is it.... there is plenty type of bots...

How would I know what type of bot it is? This is something new for me so I'm not sure about the "how tos" and "whys".
 
0
•••
use vps with dedicated ip, point your domain to the ip, let it be for 12-24 hours and then check the access_log
 
2
•••
I will give that a try. Thank you.

Once I figure out the type of bots, what can I do with that information?
 
0
•••
I will give that a try. Thank you.

Once I figure out the type of bots, what can I do with that information?

btw it supposed to be undeveloped job to filter and block bad bot, they were the one who paid for the server.

what can you do? let say there is 200 bot type and you think the most important bot were only bingbot and googlebot, so you could block the other 198 bot
 
1
•••
btw it supposed to be undeveloped job to filter and block bad bot, they were the one who paid for the server.

Hmmm. I guess I "hope" they are blocking the bad bots, but I wouldn't know at this point.

what can you do? let say there is 200 bot type and you think the most important bot were only bingbot and googlebot, so you could block the other 198 bot

Thanks again! Will see what I come up with on this one; if I can figure it out that is :xf.grin:
 
0
•••
@thevictor

Did you sort the problem out? I am having the same problem and just want to know how you got on with the above suggestions.
 
0
•••
my noob opinion is the bot traffic is often scanners, and its valuable information if your into upcoming tech and trends, see if words are being entered into scanners.

as for seperation, just filter the data you consider more valuable as non bounce users, so over 0 seconds like all bots are. and returning users.

either than that, why is it such a pain unless you have a bell go off each visit.

Cheers all,
 
0
•••
my noob opinion is the bot traffic is often scanners, and its valuable information if your into upcoming tech and trends, see if words are being entered into scanners.

Sorry to ask what is probably obvious to most, but what is a scanner in this sense?
 
0
•••
Sorry to ask what is probably obvious to most, but what is a scanner in this sense?

I might of dreamed this up like all my other conspiracy theories. But I assume for several reasons people have built software to scan domains.

The ones that dont give valuable data:
- newly regged scan for call centre spam lists..
- government scans for potential online frauds sites

Ones that provide good data would be consistent scans of keywords , it's how I realized "check" was so hot

Or new spike in future tech domains as the programmer / owner has entered the new keyword in there algo.

I also predict bots/scanners/algos are scanning hashtags in social media somehow. What an amazing way to predict trends. Cha ching. Data is king




-
 
2
•••
Back