Understanding Azure Data Factory
Azure data factory is the cloud based ETL and data integration service that allows to create data driven workflows for orchestrating data movement, and transforming data at scale. Using Azure data factory, one can create and schedule data driven workflows called pipelines , that can ingest data from disparate data stores. B uild complex ETL processes, that transform data visually, with data flows or by using compute services such as Azure HD insight, Hadoop, Azure data bricks and Azure synapse analytics. Much of the functionality of Azure data factory appears in Azure synapse analytics, as a feature referred to as pipelines w hich enables to integrate data pipelines between SQL pools, Spark pools and SQL serverless, providing a one stop shop for all your analytical needs. Azure data factory also provides rich visualizations to display the lineage and dependencies between your data pipelines, and monitor all you...