Data and analytics teams are often responsible for several key pillars in a company. This can pose a challenge when you’re the head of data and analytics and you need to pick your next data project. Where do you even start when you’re constantly bombarded with requests from your management team. In this article I…
Read more
Photo by JESHOOTS.COM on Unsplash Depending on your outlook, your small business might be inspired or intimidated by data science. No matter which end of the spectrum you’re on, one thing you can’t afford to do is ignore it. Data may be the single most important thing you can use to boost profits and cut…
Read more
Companies are continually setting up programs and initiatives to become more data-driven. Millions are being spent on new infrastructure, hiring employees, and creating processes to drive value with data. The need for better tooling, faster data, and experienced data professionals will become even more important as data sources, size, and speed grow. However, eventually, the…
Read more
Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being funded. So that means every company has…
Read more
Photo by Anika Huizinga on Unsplash Billions of dollars have been put into investing into companies that fall under the concept of “Modern Data Stack”. Fivetran nearly has one billion dollars funding them, DBT has 150 million(and is looking to raise more), Starburst has 100 million…and I could really go on and on about all the companies being…
Read more
Your business’s digital presence is generating an incredible amount of raw data. Data visualization is the way that access to this data has been made available to everyone within a company. No longer is the IT department the gatekeeper to useful information about your customers, users, visitors, and funnels. Data visualization is a way of…
Read more
Source https://unsplash.com/photos/sb7RUrRMaC4 Snowflake is a cloud data platform. To be more specific it’s the first cloud built data platform. Its architecture allows data specialists to not only create data warehouses but also cloud data lake-houses because it can manage both structured and unstructured data easily. Being that Snowflake is based in the cloud, this means that it…
Read more
Photo by Jakub Skafiriak on Unsplash Born out of frustration with the only open source distributed programming implementation of the time, Apache Spark was created in the UC Berkeley AMPLab in 2014 to replace it’s predecessor Hadoop MapReduce. MapReduce was robust but burdened by excessive boiler plating, serialization and deserialization. MapReduce was created to anticipate node…
Read more
Photo by CHUTTERSNAP on Unsplash In our last article, we outlined what to avoid when you modernize your data architecture. That was more of an introduction piece for people to know what to do when they start developing their data strategies. Now we are going to work to start developing a strategy to modernize your…
Read more
Photo by CHUTTERSNAP on Unsplash When it comes to best practices and business alignment, most new data engineers learn as they go on the job. From building overly complex and unsustainable systems to putting too much faith in existing data structures, here are five of the most common mistakes and traps that even the most…
Read more