Twitter removes storage bottlenecks, speeds up Hadoop analytics by 50%

Think it's hard keeping up with your Twitter feed? Imagine keeping track of all of Twitter. "Every tweet is comprised of over 100 data points," says Matt Singer, a senior staff hardware engineer responsible for server architecture at Twitter. Data from every retweet, "unfollow", link-click and other actions feeds analytic and deep learning systems serving operational, advertising. How does an organization handle such hyper-scale demands?