Category Archives: Training

Latest discoveries about deindexations and Search Engine crawling

LAST UPDATE: August 2017

searchbotEvery time a blog gets deindexed on EBN, we save all the information we have about it so we can analyze it later. We then do batch analysis to see if there are any patterns or footprints that we can report to the community.

In the last few weeks, we found a few interesting things. We’re still discussing on how to implement these into Blog Health to improve deindexation prevention but they’re useful insights nonetheless.

Here’s what we found.

Search Engine Crawler is visiting old URLs all the time

If you buy an expired domain with history, old URLs get crawled often and for long periods of time. This can go on for months, even if the URLs report 404 error.

Unrelated content and/or language can cause deindexation

We found that rebuilding old domains and using unrelated content and/or different language can cause deindexation.

Comments increase Search Engine Crawler visits

Comment feed is checked daily. If there are no comments, the blog is crawled less often.

Blocking crawlers can cause deindexation

We did not find any issues with users of Spider Blocker, however a lot of users add more than one plugin and block additional crawlers. Do NOT do this. Use one blocker and block as little crawlers as possible.

Some domains are permanently penalized

Some penalized domains never get any crawler traffic and will therefore never get indexed. Unfortunately we don’t yet have the data on how long this penalty can persist or what is the root cause of it (email spam, malware, phishing etc.).

Search Engine Crawler still visits the blog after deindexation (!)

When a domain gets removed from the SERP (deindexed), the old URLs still get crawled regularly and that stops only after 5-7 days. This could mean there are still options to save your blog after it gets deindexed by rebuilding URLs with relevant content.

Since we’re using passive indexation check, this is the reason why our indexation status can be late for 7-14 days (while Blog Health is checked daily).


Here’s a quick recap:

  • Rebuild URLs with relevant content that would fit on the old domain. Use the same language.
  • Check domains in spam and malware databases before buying them.
  • Use only one spider blocker, we recommend our free Spider Blocker plugin and block only the most important crawlers.

While none of this is a complete surprise, it’s just something that we can now confirm with data, not just speculation.

In the future, we’re going to start collecting even more information about domains – from social metrics to backlinks and blacklist databases. Once we have that, our analysis and deindexation prevention will greatly improve.

IP Ownership Analysis Of Cheap Hosting Providers: Only 20% With Own Servers

LAST UPDATE: August 2017

When people new to PBNs ask where to host their blogs, a lot of experts recommend using different cheap hosting providers to get a diversity of IPs. We wanted to put that claim to the test for some time now.

Analyzing 80 Cheap Hosting Providers

We collected a list of 80 popular cheap hosts from different forums and FB groups. Then we checked IP ownership of the homepage website with the method we discussed in our blog post about ASN in the footprints series.

The result?

The 80 hosting providers’ IPs are owned by only 17 companies. More than a third of those IPs are owned by just one company (EIG). Only 20% looks like they have their own servers.

In comparison – Easy Blog Networks IPs are spread over more than 30 companies – and you only need one login, not 80.

Screen Shot 2016-05-23 at 19.02.44

By far the largest owner is The Endurance International Group (36%) that is known for their acquisitions in the hosting industry. They own BlueHost, Hostgator, HostMonster, HostNine, SEOWebHosting, Site5 and tens of other hosting brands.

Other known brands are OVH, SoftLayer and HostDime.

So, what’s happening?

What people don’t know is that cheap hosting providers don’t usually have their own servers, IPs nor data centers. They buy servers or reseller plans from big brand hosting providers and just host all websites there.

Now, let’s be clear – there is nothing wrong with this and it will not get your PBN deindexed. However, if you plan on subscribing to 80 hosts and manage 80 logins, I am sure that you expect a lot more IP diversification. Therefore before singing up with individual hosting providers, make sure to analyze their homepage’s IP and ASN to get as much diversification as possible.

And of course with Easy Blog Networks you get access to almost twice the ASNs as in the above 80 hosts with A LOT less hassle.

Research: two thirds of PBNs on CloudFlare leak real IPs

LAST UPDATE: August 2017

A few weeks ago we added CloudFlare SSL support for blogs hosted on EBN. While in the process of integrating CloudFlare we did a thorough research on potential leaks and footprints. Here are our findings.

Is CloudFlare successfully masking my server’s real IP?

nocfIn essence, if you know exactly what you are doing and are very careful, then using CloudFlare to mask your PBN’s IPs is OK. But in reality, a lot of people have misconfigured PBNs and it is rather easy to get the real IPs they are using.

If you still want to use a single (or a small number of) server for your entire PBN and mask it with CloudFlare, you need to be careful with the following:

Continue reading

Advanced Footprints Series: MX Records

LAST UPDATE: August 2017

Last week we talked about how nameservers can be a huge footprint for your PBN. Today we have another DNS themed blog post. This time, we’ll talk about MX records.

What are MX records?

MX records are an optional part of your DNS (domain name system). They are similar to A records, which are required to have your site up on a domain, but instead they provide email functionality for your domain. To put it simply, if you want to receive email to, you need to set MX records for this domain. No MX Records, no emails.

The problem is that most SEO hosting providers do not provide emails for your PBN sites. That means all blogs on your PBN don’t have MX records set.

Could this be a footprint? Yes! Why? Well, out of 1 million top sites by Alexa, only 15% of domains are without MX Records, while 85% of all domains have MX records set. You do not want your *entire* PBN to be without MX records (not to mention inconvenience on not having emails for each of your sites).

Screen Shot 2016-05-17 at 10.15.51

How to check if you have MX records set?

Very easy – just run DNS report on your domain and check the MX records field.


Easy Blog Networks Has You Covered

As always, with EBN, we have this covered. All blogs hosted with us come with email support with randomized MX records. Read more about our Mail Inbox feature in our Help Center.