How data is structured, managed and processed will continue to grow in importance as the demand for AI and machine learning increase. It’s unavoidable that as businesses demand that their data teams implement AI, they will also realize that data engineers are a crucial piece of the data pipeline. That means, if you’re looking for…
Read more
SSIS, short for SQL Server Integration Service, is an essential data migration tool for modern businesses. As a key part of Microsoft’s SQL database software, It allows you to easily complete many complex tasks, including data extraction, merging data, loading and transformation, aggregating data, and more. It’s a comprehensive solution to your data management needs. In today’s business landscape,…
Read more
Photo by Shubham Dhage on Unsplash Learning about how to data models from basic star schemas on the internet is like learning data science using the IRIS data set. It works great as a toy example. But it doesn’t match real life at all. Data modeling in real life requires you fully understand the data…
Read more
Photo by Leif Christoph Gottwald on Unsplash A few months ago, I uploaded a video where I discussed data warehouses, data lakes, and transactional databases. However, the world of data management is evolving rapidly, especially with the resurgence of AI and machine learning. There are numerous other methods that technical teams are utilizing to handle…
Read more
Photo by JESHOOTS.COM on Unsplash Modern data stack consultant plays an important role in companies looking to become data-driven. They help companies design and deploy centralized data sets that are easy to use and reliable. They do so by using cloud based solutions that help automate data pipelines and processes with less code than in…
Read more
Photo by Myriam Jessier on Unsplash The modern data stack (MDS) is a new approach to data integration capable of saving your engineers time while allowing both engineers and analysts to focus on high-value pursuits. With a suite of tools to support data integration, the modern data stack will free your teams of monotony while empowering…
Read more
Software engineer vs. data engineer. People outside these professions are often confused about the differences between these experts. They may think these are two different names for the same thing: a programming expert. Of course, the duties of each engineer type are different, but their roles are similar enough to confuse people who are in…
Read more
Photo by ThisisEngineering RAEng on Unsplash By Iris Huang I’ve been four years into a career leading to data engineering, and am very glad to see the wave has risen. Influencers (from YouTube to LinkedIn top voices) and companies have started to recognize the importance of onboarding a data engineer before a data scientist if…
Read more
Photo by Windows on Unsplash It seems like it might be finally happening. Data engineering is finally getting a little bit of the data lime light. Which makes sense. The data being stored and analyzed is not only becoming more voluminous but its speed, complexity and variety are also increasing. Making it difficult to wrangle. With…
Read more
Photo by CHUTTERSNAP on Unsplash In our last article, we outlined what to avoid when you modernize your data architecture. That was more of an introduction piece for people to know what to do when they start developing their data strategies. Now we are going to work to start developing a strategy to modernize your…
Read more