Data has been consistently demonstrated to be a valuable asset for businesses of all sizes. Consulting firms, like McKinsey, have found that companies using AI and analytics attribute 20% of their earnings to it. As a consultant, I have personally witnessed how data can uncover new sources of revenue and cost reduction opportunities for clients…
Read more
AWS has jumped on the bandwagon of removing the need for ETLs. Snowflake announced this both with their hybrid tables and their partnership with Salesforce. Now, I do take a little issue with the naming “Zero ETLs”. Because at the very surface the functionality described is often closer to a zero integration future, which probably…
Read more
If you’ve worked as a DBA or data engineer, then you’ve likely had to deal with data access requests. These basic data requests can go from quick requests to endless data access requests that bog down entire data teams. This has been heavily driven by the fact that companies want to be data-driven. Meaning an…
Read more
It can be easy to take certain tools for granted when you work for companies with mature infrastructure. One of my favorite tools at Facebook was iData. iData was Facebook’s data discoverability tool. It provided a lot of functionality that I have started to miss. This included the baseline functions you would expect including the…
Read more
Databricks is a company that aims to make managing big data easy. By utilizing Apache Spark as its core processing engine, Databricks aims to make managing and processing big data easy. As one of the leading providers of big data solutions, Databricks has made a name for itself in the industry. What is Databricks? So,…
Read more
Photo by Victoriano Izquierdo on Unsplash Companies that are serious about using raw data for business intelligence need some way to centralize and control that data. Many of them are using specialized vendor products to do so. Fivetran is one choice for getting all of that data wherever it resides and centralizing it in an…
Read more
Maybe it’s the 6 figure salaries, the opportunity to work with cool technology or people are finally learning that data engineering is where everything starts in the data field. Whatever the reason, people are noticing. VCs are investing in data storage and ingestion platforms and companies are interviewing more data engineers compared to previous years. But how…
Read more