About the datagnionbot

What does it?

The datagnionbot is a link crawler from datagnion designed to automatically visit links found in posts on social media to detect redirections in (shortened) URLs.

Is there any impact to my server?

No. Our probe requests will hardly produce any high load on your web server. Since our bot just sends very small HEAD requests we receive only the http response header from your web server. This also implicates that the generated traffic by our bot is always very small compared to a full GET request.

When we detect, that an URL doesn't redirect to another one, we add its full qualified domain name (FQDN) to our internal blacklist for some days to prevent excessive amounts of requests to that site.

How to prevent the bot from visiting my site?

Please feel free to drop us a line: .

We apologize for any inconvenience.