For a long time, ETL has been the go-to workflow for data teams of all shapes and sizes. I was fortunate enough to start my analytics journey with a long-standing client of One51 Consulting, where I was exposed to an extremely rich ecosystem of data ingestion tools and orchestration techniques. The client’s ETL process involved…
Technologies: Dynamics 365 CRM Azure SQL Power BI Providing the right data access at the right time to the right people is a recurring and familiar issue for many businesses. On one hand, generalised access is a low-maintenance solution, but on the other, this approach presents a data security risk, the implications of which range…
It’s challenging and can be expensive to develop machine learning models, and thus, it is important to have solid foundations in place to enable teams to put those models to work and derive value from them. A Customer of One51 Consulting had the skills to create quality machine-learning models; however, their team worked in an…
Azure Data Factory (ADF) is one of the key components of the Microsoft Data platform, either as a standalone application or as part of Azure Synapse Analytics. In addition to ADF, Microsoft has been working on the Power BI Dataflows as another great tool for data load and transformation containing hundreds of out-of-box connections. …
In this video, Julio Acuna shows how we approach the challenge of transferring more than 40 million records from Amazon Redshift to Snowflake in less than 5 minutes.
In our Tech Challenge #1, we walked through the steps required to import Excel data into an Azure SQL Database using Azure Data Factory. This Tech Challenge will explore how Azure Data Factory helps to extract data from an RSS Feed. RSS is a web feed that allows users and applications to access updates to…