robots.txt
- Microsoft Cloaking MSNBots Again?
- Fri, 03 Sep 2010 05:54:05 -0700A WebmasterWorld thread has webmasters complaining that Microsoft is cloaking their MSNBots again, soon to be named BingBot . It has been going on recently since early August and continues throughout today. Microsoft has had issues with cloaking their bots in the past and fixed them. Is it possible they are breaking into bad habits once again? One senior member at WebmasterWorld said: Currently ...
- Google Responds To Detailed Questions On Pagination SEO Issues
- Thu, 26 Aug 2010 05:45:24 -0700Duplicate content is not a fun topic for many SEOs and Webmasters. When it comes to dealing with large dynamic sites and dealing with how they paginate content, it makes things a bit more complicated. Pagniation of articles and even worse, pagination of the navigational elements (categories, sub category pages) to those articles can be a real hair puller for many webmasters. So what do you do? I ...
- One Bing now rules them all in U.S. and Canada
- Wed, 25 Aug 2010 08:42:00 -0700Microsoft announced that it has completed integrating its Bing search engine technology into Yahoo's U.S. and Canadian Web portals.
- SearchCap: The Day In Search, August 24, 2010
- Tue, 24 Aug 2010 14:28:49 -0700Yahoo just announced the transition from Yahoo Search powered results to Bing powered organic Yahoo search results is now complete. The search ads are still from Yahoo but the free, organic results are now powered by Bing in the U.S. and Canada. Shashi Seth, Senior Vice President of Yahoo!
- Robots.txt Recruiter: Daily Mail Uses Robots.txt File To Find SEO
- Tue, 24 Aug 2010 06:28:50 -0700# August 12th, MailOnline are looking for a talented SEO Manager so if you found this then you’re the kind of techie we need! # Send your CV to holly dot ward at mailonline dot co dot uk
- British Newspaper Daily Mail Plants Job Advert In Robots.txt File
- Tue, 24 Aug 2010 05:20:21 -0700Perhaps unsurprising for a newspaper that probably has more SEO staff than, well, actual journalists, the UK's Daily Mail is hiring a new Search Engine Optimization manager. Interestingly, however, the job advert itself in fact appears in the newspaper's website robots.txt file, which isn't usually designed to be read by humans but is targeted at search engines bots to tell them what content ...
- Daily Mail Places Stealth Job Ad In Its Robots.txt
- Tue, 24 Aug 2010 02:37:43 -0700It’s more commonly used as a way to block search crawlers from certain parts of publishers’ sites.
- Difference Between Video Sitemaps & Video Sitemaps Labs Report in Google Webmaster Tools
- Mon, 23 Aug 2010 06:01:01 -0700A couple weeks ago, Google released a new labs report named video sitemaps errors . So now there are two reports in Google Webmaster Tools reporting on your video sitemaps . What is the difference between the one in the Site configuration section and the one currently in the Labs section? A Google Webmaster Help thread has a response from Google's JohnMu on the key differences. He said: The ...
- Facebook's Publicly Available Data: A Big Strategic Risk
- Wed, 18 Aug 2010 13:53:04 -0700My name is Pete Warden , and a few months ago I created visualization based on crawling 210 million public Facebook profiles that raised a lot of questions about how openly available that information should be. While I've seen a lot of discussion of the impact on users, I've seen little on why Facebook and other companies care so passionately about that data. If we want to understand what's ...
- If German Homes Can Now Opt Out Of Google, Then How About People?
- Tue, 17 Aug 2010 16:20:21 -0700Google made their "opt out of street view" service live in Germany today, giving select Germans until September 15th to exclude their properties from being mapped when the Street View service launches. The function will be available for a limited time in the 20 cities that are mentioned which includes Berlin, Dresden and Hamburg and then extend to all cities covered as Google Maps Germany rolls ...