Wait for buses, not insights: How to build data analytics pipelines faster than your morning commute

What is infrastructure? You may think of public transport and utilities, or perhaps networking and databases. All of those are infrastructure, and they actually have quite a bit in common. If words like “expensive”, “inconvenient” and “too slow” now come to mind, these are sad truths about buses, but your analytics pipelines could be running to a better schedule! Data is arriving faster and in greater quantities than ever before, from everywhere, all the time—we simply cannot afford to wait.
 
In this session we will use live data feeds from Helsinki’s transport network to show how a complete open source data pipeline—from collection to insights—can be created in a matter of minutes using infrastructure-as-code and visualisation tools you’re already familiar with. If you’re a software developer, platform engineer, data engineer or analyst, we hope you’ll take away some tips and tricks to relieve the toil and frustration of your data infrastructure. (But sorry, we can’t fix the buses and trains…)

Wil jij deze en meer inspirerende lezingen volgen? Meld je gratis aan voor de Big Data Expo op 14 & 15 september 2022 in Jaarbeurs Utrecht.