Tag: Big Data

junior data engineering hiring

How To Hire Junior Data Engineers

Photo by Nana Smirnova on Unsplash With all the recent data events I have put together I inevitably run into new data engineers who are either finishing up college or looking to transition into a data engineer or data scientist position. In fact I have talked to several newly graduated engineers who are struggling to…
Read more


January 18, 2023 0
alternatives to fivetran

What Is The State Of Data Engineering And Infrastructure In 2023

Photo by Sigmund on Unsplash 2022 is coming to an end. What is the state of data infra? Are Snowflake and Databricks still fighting over total cost of ownership? Is everyone switching to DuckDB? Are data engineers all learning Rust? Let’s try to answer these questions.   Building field-level lineage for modern data systems Lineage…
Read more


January 18, 2023 0

Data Warehouse Consultants – What Do They Do And Why You Need One

A data warehouse consultant plays an important role in companies looking to become data-driven. They help companies design and deploy centralized data sets that are easy to use and reliable. But in order to understand why you need a data warehouse consultant we should take a step back. In this article we will not only…
Read more


January 13, 2023 0
data engineering scaling hiring

Improving Your Data Analytics Infrastructure In 2023 – Part 1

Data has been consistently demonstrated to be a valuable asset for businesses of all sizes. Consulting firms, like McKinsey, have found that companies using AI and analytics attribute 20% of their earnings to it. As a consultant, I have personally witnessed how data can uncover new sources of revenue and cost reduction opportunities for clients…
Read more


January 9, 2023 0
data engineering consulting

Should We Get Rid Of ETLs?

AWS has jumped on the bandwagon of removing the need for ETLs. Snowflake announced this both with their hybrid tables and their partnership with Salesforce. Now, I do take a little issue with the naming “Zero ETLs”. Because at the very surface the functionality described is often closer to a zero integration future, which probably…
Read more


December 30, 2022 0
data engineering consulting

Data warehouses vs Data Lakes vs Databases – Which One Do You Need

By Reseun  McClendon Today, your enterprise must effectively collect, store, and integrate data from disparate sources to both provide operational and analytical benefits. Whether its helping increase revenue by finding new customers or reducing costs, all of it starts with data. Data analysts, data scientists, engineers, and managers all require a robust data storage solution for…
Read more


December 19, 2022 1
data strategy cost reduction

Reducing Data Analytics Costs In 2023 – Doing More With Less

If you haven’t started looking for ways to improve your data analytics budget for 2023, then you’re probably already behind. The truth is that between all of the various economic indicators and investor letters, everyone is looking to improve audit all parts of their business. Especially where there has likely been bloat. One of those…
Read more


December 11, 2022 3
big data consulting

What Is Shadow IT?

At my very first job in data, I was an analyst on a finance team. I was working with a senior engineer who had built out several new automated processes and was managing a data warehouse and several other applications. We were supporting 4-5 financial analysts who were relying on our data to report to…
Read more


November 29, 2022 0
data security consulting

Security And Privacy In The Modern Data World

If you’ve worked as a DBA or data engineer, then you’ve likely had to deal with data access requests. These basic data requests can go from quick requests to endless data access requests that bog down entire data teams. This has been heavily driven by the fact that companies want to be data-driven. Meaning an…
Read more


October 29, 2022 0

What Is Data Governance

Photo by Christopher Gower on Unsplash By Reseun  McClendon Data Governance is the set of principles and procedures an organization uses to manage data during its life cycle. More specifically, data governance encompasses all that is done to ensure data is private, secure, accurate, available, and usable. The data life cycle may include the data’s acquisition, use, and disposal…
Read more


September 24, 2022 0