Photo by Nana Smirnova on Unsplash With all the recent data events I have put together I inevitably run into new data engineers who are either finishing up college or looking to transition into a data engineer or data scientist position. In fact I have talked to several newly graduated engineers who are struggling to…
Read more
If you haven’t started looking for ways to improve your data analytics budget for 2023, then you’re probably already behind. The truth is that between all of the various economic indicators and investor letters, everyone is looking to improve audit all parts of their business. Especially where there has likely been bloat. One of those…
Read more
If you’ve worked as a DBA or data engineer, then you’ve likely had to deal with data access requests. These basic data requests can go from quick requests to endless data access requests that bog down entire data teams. This has been heavily driven by the fact that companies want to be data-driven. Meaning an…
Read more
It can be easy to take certain tools for granted when you work for companies with mature infrastructure. One of my favorite tools at Facebook was iData. iData was Facebook’s data discoverability tool. It provided a lot of functionality that I have started to miss. This included the baseline functions you would expect including the…
Read more
“Why do we still struggle to answer basic questions like how many customers are still active or what exactly is the company’s churn?” This was a question posed to a panel I was sitting on at the Snowflake Summit. Several panelists provided different answers and all come from very different perspectives. Truth be told I…
Read more
Over the last 20 years or so, Big Data completely changed the face of business. Then the pandemic hit. While other industries skidded to a stop, the pace of technology development skyrocketed. Suddenly, our whole lives, from work to entertainment to hanging out with friends, were happening online. Worldwide, 97 percent of businesses sped up…
Read more
The modern data stack has been discussed heavily in 2020 and 2021. But what wasn’t discussed enough was how to set up a successful data strategy. Truthfully, to drive value from your data you’re going to need to focus less on modernizing and more on your actual business problems. Driving business value with your data…
Read more
Over the last 3 months, I have taken on two different migrations that involved taking companies from manually managing Airflow VMs to going over to using Cloud Composer and MWAA (Managed Workflows For Apache Airflow). These are two great options when it comes to starting your first Airflow project. They help reduce a lot of issues…
Read more
gBig data is the new commodity that companies need to drive the business forward. Having access to all your companies data sets used to be limited to large companies that could afford a whole team of data engineers and software developers. But this is no longer the case. Traditionally you would need to have a…
Read more
Photo by Leohoho on Unsplash Migrating to the modern data stack means poising your organization to meet the varying demands of modern data. The modern data stack seeks to overcome the problems and challenges associated with modern data while enabling an organization to innovate and automate like never before. As more organizations migrate to the modern…
Read more