James Royal-Lawson


The Times and Rupert commit search engine suicide

Forget SEO, News International is covering new ground in SES (Search Engine Suicide). They announced in March that in June 2010 a paywall on all content would be put in place. That happened earlier today.

302 Redirect

For a while earlier today, today’s paywall launch was search engine suicide due to the way that tens of thousands of timesonline articles indexed by search engines were being redirected.

Pretty much every URL for a number of hours today was being redirected to an index-page on a different domain, which then also displayed a paywall notification layer.

Here’s an example:

http redirects times article June 2010

There you can see the “302 Moved Temporarily” redirect. This tells Google and other search engines is to keep checking this URL as at some point it will start to serve content of its own again. Google generally honours this type of redirect and uses the content of the destination page for indexing and ranking purposes.

What we can spot here though is that The Times article we tried to read (“Fears that vuvuzela horns could harm World Cup football fans hearing” from June 9th 2010) is being redirected to a different top level domain and this is the case for every redirect I’ve checked. Tens of thousands of articles are being redirected to the same URL. This is starting to look to Google very much like the old hijacking trick by spammers.

301 Redirect

But it doesn’t end there. Once we’ve followed the first redirect, we then get hit by a second one. This time a “301 Moved Permanently” redirect status code.

http redirects times article June 2010

This tells us (and the search engines) that has been moved forever and should not be shown in indexes any more and any “value” (Pagerank) the old page has should be transferred to the URL pointed to by the redirect, which is

Pop goes your index

So what does this mean? Well, Google will receive same page for all articles, plus that content is being served from a different domain to what it started with. The likely hood is that the entire site will be dropped from the index as punishment for spamming tactics. Best case is that the 60,000 plus articles currently indexed by Google will be replaced by

Update: 20:31

Whilst I’ve been writing this post, the redirect behaviour has changed a number of times. It seems to be stabilising and reflecting what The Times outlined in their announcement. Articles from that are currently indexed by the search engines are still available, for free, and don’t redirect anywhere.

New articles published after the launch of the paywall are being 302 redirected to the,uk start page with a paywall “login” splash.

Screenshot Google June 2010

This means that no new Times article content will be indexed by Google; it will just receive very similar content for every URL. We are going to see News and opinion from The Times, sign up now for an exclusive preview of the new Times website” or something similar a lot for Times pages in search results from now on.

Update: 16 June 2010

If the erection of the paywall wasn’t crazy enough, I’ve also spotted that The Times have stopped updating all of their RSS feeds

Why on earth would you stop feeding article teasers to thousands of loyal readers who have taken the time to subscribe to your news feed? Surely these are exactly the kind of people who might actually pay a few pounds to get through the paywall!

7 articles worth reading… (Spotted: Week 23 2010)

A twelve step process for a storming Social Media strategy

Straight-forward, practical stuff. A process that isn’t complicated to follow and will give results. The first comment to the post (by Jon Buscall) is also worth reading.

A Cross-cultural eye tracking study

A cross-cultural eye tracking study covering 6 countries (and 30 survey participants in each) shows that international websites can’t be successful ‘one size fits all’ sites due to statistically significant cultural differences in information needs. Would love to see more research into this.

Analytics Basics: Averages and Ratios

Highlighting the advantages of using median values for due to the non-normal distribution of visit lengths. Another article where it’s worth taking the time to read the comments. Brian Clifton and Neil bring up some good points regarding goals.

Designing with Behavioral Economics

Some family examples, nicely packaged in one article. It covers opt-in versus opt-out forms, problems of excessive choice, and Value judgements featuring the wonderful Economist subscription example.

No plans to redesign your site? Now is the time to hire a web design agency

Paul Boag talks a whole load of sense in this post of his. We really have got to break the “rebuild” cycle we’ve have ended up with for websites. My only criticism is that he keeps referring to “website” when he should be using “web presence” (or something similarly broad)

Varning: lyssna inte på ‘good enough’-profeterna

When good enough becomes the goal, when you choose to aim to do something competently, you will never do anything anything fantastic.

SEO site review session from Google I/O 2010

A man after my own heart, Matt Cutts (from Google) does a series of quick site reviews (from an SEO viewpoint). It’s an hour long video, but it gives some real-life examples of why certain things are important.

6 Articles worth reading… (Spotted: Week 15, 2010)

Collaboration Is More Important Than Ever – 3 Barriers To Adoption

An article looking at some significant reasons that prevent people from using collaboration tools to collaborate effectively within an organisation. Some further comments on the Beantin facebook page.

Web customers care about tasks, not goals

It’s all task based. When we arrive at a web site we have already decided what we want to achieve. This is a point I have to explain every single week…

Mary Meeker: Mobile Internet Will Soon Overtake Fixed Internet

Some excellent data to back up the claim that the mobile internet is reaching tipping point. One thing that concerns me though is Mary’s encouragement of the walled garden for content. A separate Swedish article reveals that 20% of Swedes surf via their mobiles at least once a week.

Better recipes on the web: Introducing recipe rich snippets

Reviews, people, video, events & now Recipes – where’s ‘products’? It’s only a matter of time before Google lift it out of their labs and start using it for real.

Using site speed in web search ranking

Today Google officially announce that slow site speed with affect your ranking in Google Search results. Let’s hope this brings a new dawn of page-size efficiency to the web-world. There is going to be a short series of Beantin blog posts about page speed very soon.

30 iPad Productivity Problems

Perhaps a bit of link-bait from Steve, but it does highlight really well why the iPad isn’t a capable of being your primary (or only) mobile computing device.

For your reading pleasure (week 5, 2010)

Your business blog needs to be written for children

Most business websites are unreadable. You don’t need to “dumb down” your content, you just need to make it readable

Tax on What? Taxonomy on the Intranet

Oliver talks us through how an intranet folksonomy and taxonomy can work together. Combining their respective strengths can compensate for the other’s deficiencies

Recruiters really care about your online reputation even if you don’t

The information about you that is discoverable online is a potential time bomb for many. Once something is out there, it’s not always straight forward to wipe it away.

Google Economist Explains Why You Won’t Pay For Online News

Graham argues, backed up by search data, that reading the news online is a work-time activity, and that workers reading news as a distraction from other tasks won’t be prepared to pay for it.

Confessions from an Annoyed yet Modern SEO

Another week, another good post from Jesper. The days of the fast lane to SEO optimisation have passed. You need good content, good analytics, and a good understanding of what your target audience wants.

Using the hReview Microformat for your Review Pages

Google will be using on-site microformats increasingly often to produce rich snippets in search result pages. This is a great walk-through for those wanting to implement the hReview microformat for reviews on their site.

4 of 6
Reload this page with responsive web design DISABLED