When Yahoo and Microsoft announced their Search Alliance in July 2009, only the high level agreement details were available:

• Microsoft will provide the development and management of search engine results technology (bing)
• Microsoft will provide the search and content network ad platform (adCenter)
• Microsoft will manage the relationship with self-service advertisers
• Yahoo will manage the relationship with large accounts
• Yahoo will provide their own user interface on top of the Bing results which will appear on Yahoo properties

Now that US and EU regulators have approved the deal, search marketers need to assess which Yahoo tools they rely on – and need to be prepared with alternatives should these tools be discontinued.

One problem search engines face when indexing and ranking a website’s content is to identify the target geographic and linguistic market a particular website page is trying to reach. The world wide web is indeed that, and the issue is particularly complicated for websites in languages which have a broad geographic reach such as English and Spanish.

Fortunately for site owners, there are clues search engines use to match website content with searcher location. By understanding these clues and user behavior, site owners can choose a domain and URL strategy which best fits their needs.

I discussed domain and URL strategies at the SMX West 2010 Search Marketing Expo conference. For the benefit of those who couldn’t attend, the slides and a rough transcript follow. I’d strongly recommend that you attend a future SMX conference in person – from search marketing tips to great networking (and fine food), you won’t regret it.

With the approval of the Microsoft-Yahoo search deal by EU regulators, search engine marketers will soon be working in a new landscape. In western Europe where Google dominates with about 90% of the market, it’s tempting to react to the deal with a big yawn.

Yet Yahoo! often has a bigger impact on our search marking than we might like to acknowledge. For many, Yahoo, through its Site Explorer and the Yahoo Search Boss / Site Explorer APIs , is a primary source of competitive backlink data. And who among us doesn’t perform a few searches in Yahoo to benchmark the quality of Google’s results?

Google’s very undiplomatic announcement that it is going to stop censoring its search results in China doesn’t leave much face-saving wiggle room for the Chinese government – a big no-no in Asian culture. Significant blocking of Google in China seems imminent – you don’t go to great lengths to build the great firewall of China for nothing. Google, a data-driven company, knows full well that Chinese users will be discouraged from using a search engine if it is slow or worse, unreachable. Game over as they say.

While it is easy to applaud Google for taking the moral high ground, you almost get the feeling that something else is happening: Google has given up its battle for search engine supremacy in China. Perhaps Google is giving up the fight because China is one of the few markets where local players, like Baidu, command more market share, regardless of who is doing the counting.

While the political repercussions will be interesting to watch, I’m also very curious to see how Microsoft responds. With its Bing, Microsoft seems to have finally put Google in its sights. Will Microsoft try to fill the void left by Google’s virtual departure? Or will Microsoft take a moral stance? Interesting…

When Yahoo announced their effective exit from the search engine business last July, the main points seemed clear:

• Microsoft will provide the development and management of search engine results technology
• Microsoft will provide the search and content network ad platform
• Microsoft will manage the relationship with all but an elite group of advertisers
• Yahoo will provide their own user interface on top of Microsoft’s Bing data

The Bing-Yahoo agreement, should it receive the necessary anti-trust approvals, may have a wider impact on web marketers (as a side note, I believe the agreement is a bad thing as it reduces competition in this strategic market). Consider the uncertainty surrounding just two of the web marketing tools currently provided by Yahoo:

As the western world looks at the 20^th anniversary of the fall of the Berlin Wall, I though I’d make my own modest contribution. I had the fortune to study in East Berlin in 1987-88, just before the wall fell. Sure there were tensions (communist darling Rosa Luxemburg’s

Freiheit ist immer die Freiheit des anders Denkenden

was provocatively thrown at the regime) but I don’t think anyone really thought at the time that the wall would fall any time soon.

On a personal level, the experience in East Berlin taught me a lot about critical thinking – such as how to read between the lines and why that is so important. I also learned to speak my first foreign language (full immersion works) and met my future soul-mate – not too bad for a year’s work.

Yesterday we saw a lot of press and blogosphere attention devoted to deals being made between the two leading search engines, Google and Bing, and leading social media services Twitter and Facebook.

Twitter search deals, while interesting, doesn’t yet merit much beyond a big yawn – we’ve already had decent, if imperfect, search via Summize, which became twitter search. Sure, both Google and Bing can improve this, but still, things like Google Squared are much more innovative.

What is really interesting about the search engine deals are the implications of the business details:

Is twitter being compensated for the indexing and retrieval attention Bing (and Google?) is giving them?

This past week the Italian antitrust authority (Autorità Garante della Concorrenza e del Mercato) conducted a search of Google’s Italian office and announced it was beginning an investigation into Google’s possible abuse of its dominant position in the Italian search engine market. The case was triggered by a complaint from the Italian Federation of News Publishers, FIEG (Federazione Italiana Editori Giornali). FIEG represents publishers of newspapers and magazines, together with press agencies.

So what’s the problem?

The news industry has struggled since the mid 1990s to figure out a profitable internet strategy. “Free” content needs to be supported by advertising revenue, yet poorly targeted banners and the like don’t pay much. Google’s indisputable success as an advertising powerhouse¹ has captured the press’ attention.

In a recent article on Microsoft’s bing, I felt it necessary to temper my enthusiasm for Microsoft’s commitment to web search by noting Microsoft’s decidedly checkered record as a good net citizen. What about Google?

It is almost too easy to write a glowing review of whatever new service Google unleashes. For example,

• Google Maps Street View enables us to preview a new client’s street and building prior to a first visit – a boon in city environments
• Google Translate has improved so significantly of late that it really is useful in providing rough draft translations of search marketing articles
• Google Squared provides an innovative take on structuring search results for items with multiple attributes.

However while enthusing over Google’s services one might ask,

At the end of May Microsoft announced its new search engine, Bing. Microsoft justified many of Bing’s new features by noting that 50% of search queries are either abandoned or refined – users aren’t getting the right answer on the first try, citing studies by Jakob Nielsen, Enquiro and internal testing. Microsoft also said that searchers are becoming more focused more on tasks and decisions – consequently search engine sessions are becoming longer as users work their way through their decision making process.

As data from Bing’s first full month becomes available, I thought it would be interesting to take a quick look at what the Bing rollout means for search marketers and, in a separate article, current search engine market shares.

At the end of May Microsoft announced its new search engine, Bing. As data from Bing’s first full month becomes available, I thought it would be interesting to take a quick look at the current market share enjoyed by the major search engines in the US and a “typical” European market, Italy. The real test of Bing’s success will to be to check back in a few months to see if Bing has picked up traction with users or not. As the folks from Cuil can attest, a burst of publicity doesn’t necessary translate into loyal search users.

Search Engine statistics, USA vs. Italy

Most web intelligence services are currently US centric with very little worldwide reach. Unless stated otherwise, the data which follows is for the US market. Where available, I’ve also provided data for the Italian market, which for search engine usage is rather typical of most west European markets.

One of the more exciting recent search engine advances I’ve seen in a while is Google Squared. Search for something which has multiple attributes and Google will try to build a structured table of results, adding columns for each major attribute it knows about. As an example, try “Hitchcock films”.

Figure 1: Google Squared search results for “hitchcock film”

Did Google miss a film? Just add a row and Google will try to fill in the missing attributes. Is a film attribute missing? Just choose from a column suggestion Google offers or specify it yourself and Google will try to find the data. Does a data element seem amiss? Hover over it and Google will display the data source along with alternative values. In the Hitchcock example, one film was reported with the re-release date rather than the original date; a click or two later and the correct date appeared.

Good user experience is fundamental for the success of a website:

On the Internet, it’s survival of the easiest: If customers can’t find a product, they can’t buy it. Give users a good experience and they’re apt to turn into frequent and loyal customers. But the Web also offers low switching costs … Only if a site is extremely easy to use will anybody bother staying around. – Usability guru Jakob Nielsen¹

While Nielsen probably had site design and information architecture in mind, his point also encompasses search engine visibility. Without search engine visibility a website is hidden away on a dead-end street instead of being front and center on main street², where the people are.

It may seem like a cliché but on the web no website is an island. Any site worth its salt will have accumulated inbound links and will most certainly contain outbound links to other resources on the web. Indeed, one can easily say that without links to interconnect websites, there wouldn’t be a worldwide web.

For search engines, such as Google, incoming links provide a strong signal as to the authority of a website. If multiple websites link to a specific website for a given topic, there is a good chance the website cited by others is deemed to be highly relevant for a good reason. Google and other search engines identify the theme of a website page by analyzing a page’s content and the text of the incoming links – the underlined text you click on to arrive at a page. Links, especially inbound links, are thus one of the most significant in the over 200 factors Google considers in its ranking algorithms. Inbound links from related sites in a business’ sector are also an excellent source of highly qualified direct traffic.

As many may know by now, Google has been experimenting for a few months with Ajax (JavaScript) based search results. One problem with the initial trial was that no referrer information was passed when a user clicked on a search result, “breaking” the historic ability of Web Analytics systems to track search traffic from Google. Google has more than one service on each of it’s domains which may send traffic to a website, such as the Google Reader, so just knowing traffic is from Google isn’t so informative.

Keyword information from search referrers is in particular very important as we want to know not only where our visitors came from, but what was their intent, intent indicated though the keywords they use to express their need or desire while searching.

It was bound to happen. In an economic climate of belt tightening, Microsoft has finally done the unthinkable. First there were those 5,000 layoffs. Then there was the abandonment of adCenter Analytics, Microsoft’s web analytics solution. Yesterday Microsoft announced it was discontinuing Encarta, tacit acknowledgment that it has been trumped by Wikipedia.

So perhaps I should have seen the writing on the wall. Yet today’s announcement that Microsoft is abandoning it’s Live Search took me by surprise. Is Yahoo! next? Will we soon be looking at a Google only world?

To judge by an e-mail I received, and this post Microsoft is abandoning the Live Metrics solution it relaunched as adCenter Analytics.

On a personal level, this reminds me lot of another web area (book search) where Microsoft competed with Google but later got cold feet and pulled out. I hope Yahoo remains steady in its commitment to Web Analytics [and hope they open it to SEO folks like me ]

The rel=”canonical” link duplicate content panacea

As many readers probably know, Google and other search engines recently announced support for a rel=”canonical” link attribute value. The new attribute value canonical (not a tag mind you, link is the html tag) can be used by website developers to specify which of essentially similar web pages is the definitive version.

A SEO problem known as duplicate content arises when websites use different URLs, generally through parameters, to provide slightly different versions of a page, such as a printer friendly version, or to support web analytics campaign tracking. In order to give search users unique choices, search engines tend to choose the “best” URL for a page, filtering out similar versions.

This SMX West 2009 session looks at how internet users interact with search engines and how that might influence search engine interface design and our SEO efforts.

Moderator: Gordon Hotchkiss, President and CEO, Enquiro

Speakers:

• Larry Cornett (@cornett), VP, Consumer Products, Yahoo!
• Gordon Hotchkiss (@outofmygord), President, Enquiro
• Ramez Naam, Group Program Manager – Live Search, Microsoft
• Jenni Tafoya, Vice President, comScore, Inc.

Some statistics to consider

Jenni Tafoya introduces comScore; notes they have a world-wide panel of 2 million people (as far as I know, no third party audit of their claims or methodology is available – Sean).

Jenni says U.S. search activity on engines and sites is up 38% – people are doing more searches and more people are online.

Search Engine Marketing is part of a bigger web ecosystem. At SMX West 2009, three habitués of the social media scene shared tips on successfully promoting a website using social media.

Moderator: Sara Holoubek, Consultant, Columnist and SEMPO Board of Directors

Speakers:

• Chris Bennett (@chrisbennett), President, 97th Floor
• Brent Csutoras (@BrentCsutoras), Online Marketing Consultant, Brent Csutoras, Inc
• Gab Goldenberg (@GabGoldenberg), Founder, SEO ROI Services

reddit

Brent Csutoras describes the user-generated news site reddit. When logged in, the front page is dashboard of reddits. You can create your own social media site using a CNAME sub domain name and the Reddit platform. (Add a CNAME record aliasing your domain to rhs.reddit.com. Enter this new domain, e.g. social.antezeta.com, in the domain field when you create a new reddit. – Sean)

I love the web. Despite being somewhere in Italy, I’m able to follow many professional conferences like SMX West through session write-ups posted online. After all, it isn’t always possible to attend conferences in person. Yet even when the post quality is high, there’s something missing, something that can’t be replicated virtually. Above all, its the human dimension, the networking experience. If you haven’t had the opportunity to attend professional conferences (or you’re a bit shy!), you might think, “what’s he on about?“.

As I reflect on the various breakfast, lunch and cocktail chats I had at SMX West, I think about the breadth of interesting people I met.

In the search engine optimization business there are several recurrent discussions with new client prospects. The most common one by far is around why conversion reports should be used for search metrics rather than traditional ranking reports. Jaws drop when people hear that two different Google users may see different search results for the same query made at the same moment in time. The reasons vary – searches made at google.com vs. google.it, data centers may not be synchronized, etc.

Two years ago, Google introduced Google Personalized Results. Google provides special results, just for me, based on my search history, as long as I am logged into a Google service. In November, Google added SearchWiki, a facility for a user to annotate and customize their search results.

Google Blog Search is Google’s vertical search engine which focuses exclusively on blog content. While overall usage is probably pretty low, results from Google blog search are starting to appear in Google’s web search as part of their “Universal Search”, more generally known as blended search. Blog content can appear in Google’s standard web search independently of its presence in Google Blog Search. Google’s Chris Pennock, an Engineer with Google’s New York office, discussed how Google Blog Search works at the SMX West search conference.

Moderator: Matt McGee, Assignment Editor, Search Engine Land

Speaker: Chris Pennock, Senior Software Engineer, Blog Search, Google Inc.

One of the nice things about web marketing is the wealth of data available to use in decision making processes. Web marketing data also helps in getting and maintaining management support for SEO activities.

This SMX West session focusing on in-house SEO considered what data to present to management, when to present it and how to best present it. The line-up is an all star cast – two in house SEO practitioners at companies, that among other things, own search engines. As if that wasn’t enough, we also have John Marshall, founder and former CEO of Clicktracks. Rounding up the line-up is Jessica Bowman, a SEO consultant specializing in setting up and guiding in-house SEO programs.

Moderator: Jessica Bowman, Founder, SEOinhouse.com

Speakers:

• Duane Forrester, Senior Program Manager SEO, Microsoft

Passing through the Frankfurt Airport on my way from Milan to SMX West, I couldn’t help but notice the front page of Germany’s weekly newspaper, Die Zeit (The Time).

Google. Der Spion, den wir lieben.

Google weiß alles. Der Internetgigant aus Kalifornien macht uns das Leben leicht. Zugleich aber folgt er uns im Netz auf Schritt und Tritt – nun auch über das Google-Handy. (Die Zeit, 5. Februar 2009)

The image, inspired by 007, says:

Google. The spy we love.
Google knows everything. The California Internet giant makes life easy. Yet at the same time Google follows our every step on the net – now through the Google cell phone as well.

One day you note a fall off in the traffic Google sends your website. As Google is the main source of your traffic, as is the case for many websites, alarm bells naturally start ringing. Investigating, you realize that the site does not appear at all in Google or has poor visibility at best in search results. What is a poor site owner to do? Did someone say panic?

Understand why the site disappeared from Google

There are several reasons why a site no longer appears in typical Google search results.

Several Italian SEO practitioners have noted seeing Google search results with snippets about double the normal length¹.

Google’s query result snippet (the result summary or description) is usually around 150 characters or so. It may be the contents of a page’s html meta description tag, especially if the tag contains the search keywords, or an abstract created by Google from the page’s content.

I hadn’t seen this behavior in English language Google results until I made a very specific search where I used more than the typical 2 or 3 keywords seasoned searchers type. Searching for google feedburner mybrand server not found (no, Google’s feedburner migration did not go smoothly) I noticed that the 4^th and successive results had super long descriptions – around 300 characters or so:

The title might be a bit provocative, but the topic is important for companies which want to insure their website is a profit center rather than a cost center. The number of page views tracked by a web analytics system is often a weak indicator of website monetization potential. With the advent of monetization programs such as Google’s AdSense, the specific content of a web page has become much more telling in this regard. Let’s see why.

In this article we will restrict ourselves to advertising as the monetization tool.

For a long time, Google’s advice to website developers was to keep things simple to ensure search engine spiders could successfully crawl and process website content:

Use a text browser such as Lynx to examine your site, because most search engine spiders see your site much as Lynx would. If fancy features such as JavaScript, cookies, session IDs, frames, DHTML, or Flash keep you from seeing all of your site in a text browser, then search engine spiders may have trouble crawling your site.¹

In reality, Google often found links in Flash objects, significantly improving this ability as announced last June (creating much confusion by misrepresenting this as a new feature rather than an improvement). And despite the hoopla, there are still many good reasons to avoid Flash.

One sign that a profession has matured is in its ability to support a dedicated conference where professionals can hear and learn from presenters as well as interact with other practitioners (and potential clients & vendors).

Search Marketing has had its very own conference since Danny Sullivan started the Search Engine Strategies (SES) series 10 years ago. After growing the SES conference series for many years for the benefit of other owners, Danny started his own conference series, SMX: Search Marketing Expo, in 2007.

I’m happy to say that on February 10-12 I’ll be attending the three day SMX West 2009, in Santa Clara, California. I’m particularly looking forward to day 2’s Keynote Conversation with Google’s Vint Cerf. One of the advantages of the California edition of SMX is that it is easier to get key search engine employees to participate – they’re already right down the street. The sessions on Ecommerce Search Marketing Tactics and Search & Reputation Management also look particularly promising.