Photo by Pawel Czerwinski on Unsplash Big data is touted as the solution to many problems. However, the truth is, big data has caused a lot of big problems. Yes, big data can provide more context and provide insights we have never had before. It also makes queries slow, data expensive to manage, requires a lot of expensive…
Read more
gBig data is the new commodity that companies need to drive the business forward. Having access to all your companies data sets used to be limited to large companies that could afford a whole team of data engineers and software developers. But this is no longer the case. Traditionally you would need to have a…
Read more
Photo by Leohoho on Unsplash Migrating to the modern data stack means poising your organization to meet the varying demands of modern data. The modern data stack seeks to overcome the problems and challenges associated with modern data while enabling an organization to innovate and automate like never before. As more organizations migrate to the modern…
Read more
It’s becoming difficult to keep track of all the new data warehouse solutions that are trying to challenge the current incumbents. Choosing the best data warehouse to meet the needs and objectives of your operation is a crucial component of your business strategy. Unfortunately, many organizations are still struggling with this decision. To add to…
Read more
Companies of all sizes are looking for faster and easier ways to take advantage of data through analytics and BI. In particular, knowing who your customers are, how they interact with your business, products and services is a modern necessity. In a customer-centric world where data can help improve the overall customer experience and relationships,…
Read more
Photo by Myriam Jessier on Unsplash The modern data stack (MDS) is a new approach to data integration capable of saving your engineers time while allowing both engineers and analysts to focus on high-value pursuits. With a suite of tools to support data integration, the modern data stack will free your teams of monotony while empowering…
Read more
Maybe it’s the 6 figure salaries, the opportunity to work with cool technology or people are finally learning that data engineering is where everything starts in the data field. Whatever the reason, people are noticing. VCs are investing in data storage and ingestion platforms and companies are interviewing more data engineers compared to previous years. But how…
Read more
Scaling data talent is hard. It’s hard to hire. Hard to grow and just overall hard in terms of managing processes and output. But there are brilliant leaders and managers doing it everyday. I recently interviewed Veronica Zhai, the principal product manager at Fivetran. She has led Fivetran’s analytical team for nearly the last year…
Read more
Photo by Christina @ wocintechchat.com on Unsplash Why does it feel like so many more articles are discussing the data engineering profession? Perhaps it’s because Dice’s 2020 tech jobs report cites data engineering as the fastest-growing field in 2020, increasing by a staggering 50%, while data science roles only increased by 10%? Or maybe it’s just because the Medium…
Read more
Photo by Martin Sanchez on Unsplash There are plenty of clichés about data and its likeness to oil. But it’s far from easy to get value from data. Companies are creating more data than ever before. At our current pace, 2.5 quintillion bytes of data are created every day. Companies went from pulling data solely…
Read more