Twitter will move some of its core infrastructure to Googles Cloud Platform for better data management, the company has announced. “We are excited to announce that we are working with Google Cloud to move cold data storage and our flexible compute Hadoop clusters to Google Cloud Platform,” Parag Agrawal, Chief Technology Officer at Twitter, said in a blog post.
“This will enable us to enhance the experience and productivity of our engineering teams working with our data platform,” he added.
Hadoop from Apache is an open-source software for organising Big Data.
The Hadoop compute system is the core of Twitter`s data platform, and the company runs multiple large Hadoop clusters that are among the biggest in the world.
“In fact, our Hadoop file systems host more than 300PB of data across tens of thousands of servers,” Agrawal said.