Hadoop in the wild: These are the 3 biggest challenges

When we deployed the first production Hadoop cluster in 2006, we were looking to build a more efficient and cost-effective web search index at Yahoo. Very quickly, other groups at Yahoo started using Hadoop for research jobs and revenue-driving applications, such as click prediction for sponsored search. Since then, Hadoop has evolved to become an essential tool for many of the world’s largest companies, including Facebook, GE, Visa, and Wal-Mart.