28 Feb '13, 12am

The Second February Mozscape Index is Live!

The Second February Mozscape Index is Live!

The Mozscape index is created in one continuous batch processing pipeline. A massive amount of crawl data is initially downloaded which is first sorted and organized, then the computations and magic are applied. Every so often, files get uploaded in a checkpoint step; just in case something catastrophic happens to the index, we'll be able to roll back to a fairly recent step. Recently the Big Data processing team dug through this checkpointing code to see where they could optimize - and they really optimized! The time needed to checkpoint files varies throughout the pipeline, but the longest checkpointing step used to take about 60 hours to complete… With the optimization from Doug and Martin , this step now takes on average 2.18 hours! Holy time savings!! The first few steps in processing are dedicated to organizing how the work is going to be distributed across the entir...

Full article: http://www.seomoz.org/blog/the-second-february-mozscape-i...

Tweets

My February Favourites <3

My February Favourites <3

bubzbeauty.com 27 Feb '13, 4pm

It feels like FOREVER since my last Monthly Favourites vide and I think it's because I didn't make one for January and Dec...

Spring is coming, so now is a great time to get...

usga.org 02 Mar '13, 7pm

While the USGA® develops the formula used in tabulating handicaps, it does not issue them directly to individual golfers. ...

SearchCap: The Day In Search, February 25, 2013

searchengineland.com 25 Feb '13, 10pm

Google Panda Two Years Later: The Real Impact Beyond Rankings & SEO Visibility (Editor’s Note: This is the second in a ser...

MasterCard Index: Indonesia & Philippines Lead #ConsumerConfidence @MasterCardSG

MasterCard Index: Indonesia & Philippines Lead ...

superadrianme.com 25 Feb '13, 1am

25 February 2013, Singapore – MasterCard Worldwide Index of Consumer Confidence survey conducted between 7 November to 23 ...

UK-GBC members have ranked first and second in the Environment Agency’s second and final CRC league table:

UK-GBC members have ranked first and second in ...

ukgbc.org 26 Feb '13, 12pm

UK-GBC members rank first and second in CRC league table Date released: 26 Feb 2013 UK-GBC members have ranked first and s...

SearchCap: The Day In Search, February 26, 2013

searchengineland.com 26 Feb '13, 10pm

How To Stop The Panic Before Asking “Have I Been Panda Slapped?” You may see a drop in rankings or traffic and immediately...

Kelihos (botnet behind pharma spam, Bitcoin wallet theft & credential harvesting) shut down live at #RSAC @threatpost

Kelihos (botnet behind pharma spam, Bitcoin wal...

threatpost.com 27 Feb '13, 4pm

SAN FRANCISCO – Down goes Kelihos—again. The third version of the prolific peer-to-peer botnet responsible for volumes of ...

GAP 50% Off Second Pair of 1969 Jeans

GAP 50% Off Second Pair of 1969 Jeans

greatdeals.com.sg 25 Feb '13, 4am

GAP 50% Off Second Pair of 1969 Jeans Posted by GDS Team on February 25, 2013 Can’t get enough of your favourite GAP jeans...

Levi's, BBVA, Ebay Top Social Media Sustainability Index - Environmental Leader

Levi's, BBVA, Ebay Top Social Media Sustainabil...

environmentalleader.com 27 Feb '13, 2pm

The Social Media Sustainability Index begins by looking at how 400 global publicly listed companies are communicating thei...

Rolex named number one consumer Superbrand for ...

brandrepublic.com 25 Feb '13, 9am

Rolex named number one consumer Superbrand for second year running Ben Bold, marketingmagazine.co.uk, 25 February 2013, 08...