Source Apache Airflow is a popular open-source tool that helps teams create, schedule, and monitor sequences of tasks, known as “workflows.” Managed Workflows for Apache Airflow, abbreviated as MWAA, is a managed service designed for orchestration in Apache Airflow. With MWAA, users can easily operate data pipelines at scale, setting up and managing them from…
Read more
Photo by Juan Encalada on Unsplash The busing and coach industry has taken a beating in 2020. Without the typical flood of people from cruises, events and tech employees needing to be shuttled to work, business has nearly come to a halt. In turn, if you’re a coach operator, you will be asking the question.…
Read more
Photo by bruce mars on Unsplash Technology has been speeding forward through 2020. The impacts of Covid have only sped up the adoption of change for companies. Companies small and big, start-ups and corporations have been pushed to innovate and improve processes. For example, small, medium, and large companies are migrating to the cloud to…
Read more
Photo by Eric Krull on Unsplash. Parsing and processing documents can provide a lot of value for almost every department in a company. This is one of the many use cases where natural language processing (or NLP) can come in handy. NLP is not just for chatbots and Gmail predicting what you are going to write in your…
Read more
As a developer, you will often need to create APIs to interact with various systems and integrations. Traditionally, this required a lot of work as far as developing the infrastructure and deploying the code on either an on-premise or cloud server like EC2. However, this method is slow and costly. Thus, the concept of serverless…
Read more
With success accompanying a growing brand comes the demand for better technological solutions. Businesses today consider full access to specialized support services like cloud computing an integral part of their day to day. Cloud computing permits firms to access to the same computing power that big businesses have. Cloud computing also delivers the perfect fit…
Read more
Photo by Science in HD on Unsplash Unlike software engineering, there aren’t a lot of college courses in data engineering. Nor a huge list of boot camps teaching the practice. This leads to best practices often being learned on the job, as well as a cornucopia of technologies being used across teams and companies. So what defines a…
Read more
Back in my day, databases and applications used to only sync late at night while everyone was asleep. Now in the modern era, everyone expects their data the second it’s updated (if not somehow magically before the data occurs). Large corporations and Fortune 500 companies depend on this data to be able to predict consumer…
Read more
Photo by ZACHARY STAINES on Unsplash Performing ad hoc analysis is a daily part of life for most data scientists and analysts on operations teams. They are often held back by not having direct and immediate access to their data because the data might not be in a data warehouse or it might be stored across…
Read more
Photo by Taylor Vick on Unsplash How companies manage their data is no longer limited to traditional relational databases. Amazon Web Services (AWS) for example offers a diverse collection of options when it comes to storing data. We recently wrote a piece solely focused on Redshift, but we wanted to introduce a few more options.…
Read more