Data Engineering Podcast

Summary Apache Spark is a popular and widely used tool for a variety of data oriented projects. With the large array of ... Read more

Summary Yelp needs to be able to consume and process all of the user interactions that happen in their platform in as cl... Read more

Summary As data engineers the health of our pipelines is our highest priority. Unfortunately, there are countless ways t... Read more

Summary The theory behind how a tool is supposed to work and the realities of putting it into practice are often at odds... Read more

Summary One of the longest running and most popular open source database projects is PostgreSQL. Because of its extensib... Read more

Summary The financial industry has long been driven by data, requiring a mature and robust capacity for discovering and ... Read more

Summary The rate of change in the data engineering industry is alternately exciting and exhausting. Joe Crobak found his... Read more

Summary With the proliferation of data sources to give a more comprehensive view of the information critical to your bus... Read more

Summary Despite the fact that businesses have relied on useful and accurate data to succeed for decades now, the state o... Read more

Summary Data integration and routing is a constantly evolving problem and one that is fraught with edge cases and compli... Read more

Summary The responsibilities of a data scientist and a data engineer often overlap and occasionally come to cross purpos... Read more

Summary Building a data platform that works equally well for data engineering and data science is a task that requires f... Read more

Summary Data governance is a complex endeavor, but scaling it to meet the needs of a complex or globally distributed org... Read more

Summary Delivering a data analytics project on time and with accurate information is critical to the success of any busi... Read more

Summary Data engineers are responsible for building tools and platforms to power the workflows of other members of the b... Read more

Summary With the wealth of formats for sending and storing data it can be difficult to determine which one to use. In th... Read more

Summary Buzzfeed needs to be able to understand how its users are interacting with the myriad articles, videos, etc. tha... Read more

Summary In recent years the traditional approach to building data warehouses has shifted from transforming records befor... Read more

Summary Data is only valuable if you use it for something, and the first step is knowing that it is available. As organi... Read more

Summary Building an ETL pipeline can be a significant undertaking, and sometimes it needs to be rebuilt when a better op... Read more