Several months ago a client inspired me to write a comprehensive guide to keeping website content out of search engines. Usually website owners are focused on the opposite side of search engine optimization, insuring web content is well indexed. Yet, as many can attest, search engines can be all too efficient at finding documents they shouldn’t. Thus, the need to understand what options exist, how they work and which search engines support them.

One problem with the techniques available up until now is that options for digital media have been limited. The official way to keep video, audio and pdf files out of search engines was through the robots.txt protocol, not a very efficient tool when setting indexing options on a file level.

[Read more →]

In the course of a search engine optimization project, I’m often asked during the competitor analysis phase why one website ranks highly in Alexa, while another ranks highly in an other statistics supplier’s top websites survey.

As our two part article Web statistics for internet market research: pick a number, any number illustrates, there are a plethora of services offering web statistics. Website owners often cite their Alexa rank to demonstrate how much more important their site is compared to a competitor’s. Other website owners will pay for Nielsen//Netratings panel research, a sampling technique born in the 1930s which surveys about 0% of Italy’s adult population – no wonder then the IAB has called this technique outdated.

[Read more →]