Data is an integral aspect of any business. It allows for solution development, metric tracking, and creates a structure for streamlined and integrated processes. Data empowers business decisions. I say that both from the fact that consulting firms like McKinsey have found that in their research companies that are using AI and analytics can attribute 20%…
Read more
It’s becoming difficult to keep track of all the new data warehouse solutions that are trying to challenge the current incumbents. Choosing the best data warehouse to meet the needs and objectives of your operation is a crucial component of your business strategy. Unfortunately, many organizations are still struggling with this decision. To add to…
Read more
Source Apache Airflow is a popular open-source tool that helps teams create, schedule, and monitor sequences of tasks, known as “workflows.” Managed Workflows for Apache Airflow, abbreviated as MWAA, is a managed service designed for orchestration in Apache Airflow. With MWAA, users can easily operate data pipelines at scale, setting up and managing them from…
Read more
Companies of all sizes are looking for faster and easier ways to take advantage of data through analytics and BI. In particular, knowing who your customers are, how they interact with your business, products and services is a modern necessity. In a customer-centric world where data can help improve the overall customer experience and relationships,…
Read more
Photo by Myriam Jessier on Unsplash The modern data stack (MDS) is a new approach to data integration capable of saving your engineers time while allowing both engineers and analysts to focus on high-value pursuits. With a suite of tools to support data integration, the modern data stack will free your teams of monotony while empowering…
Read more
Source https://unsplash.com/photos/sb7RUrRMaC4 Snowflake is a cloud data platform. To be more specific it’s the first cloud built data platform. Its architecture allows data specialists to not only create data warehouses but also cloud data lake-houses because it can manage both structured and unstructured data easily. Being that Snowflake is based in the cloud, this means that it…
Read more
Maybe it’s the 6 figure salaries, the opportunity to work with cool technology or people are finally learning that data engineering is where everything starts in the data field. Whatever the reason, people are noticing. VCs are investing in data storage and ingestion platforms and companies are interviewing more data engineers compared to previous years. But how…
Read more
Scaling data talent is hard. It’s hard to hire. Hard to grow and just overall hard in terms of managing processes and output. But there are brilliant leaders and managers doing it everyday. I recently interviewed Veronica Zhai, the principal product manager at Fivetran. She has led Fivetran’s analytical team for nearly the last year…
Read more
Photo by Christina @ wocintechchat.com on Unsplash Why does it feel like so many more articles are discussing the data engineering profession? Perhaps it’s because Dice’s 2020 tech jobs report cites data engineering as the fastest-growing field in 2020, increasing by a staggering 50%, while data science roles only increased by 10%? Or maybe it’s just because the Medium…
Read more
Photo by Martin Sanchez on Unsplash There are plenty of clichés about data and its likeness to oil. But it’s far from easy to get value from data. Companies are creating more data than ever before. At our current pace, 2.5 quintillion bytes of data are created every day. Companies went from pulling data solely…
Read more