How We Built a Data Pipeline That Powers Billions of Transactions Every Day
In 2016, digital advertising will overtake TV in overall media spend, surpassing $66 billion in annual revenue. The companies that will come out on top in this new digital media landscape will be those that can cut through the noise and reach the right consumer with the right message at the right time. At Altitude Digital, we have to decide which video ad to serve to a particular user in a matter of milliseconds—and be able to report on it in real time to our clients. In this session, I’ll discuss how we do this accurately and effectively, by leveraging a data pipeline we built using Hadoop, Kafka, Cascading, Oozie, Druid, and a custom ETL process. By the end of this session, you’ll understand the benefits of layering these technologies, and how you can apply the same process in order to transform your businesses.