Azure Data Factory and Data Lake – Building a Modern Cloud Data Architecture (AZRDF)

Databases, Data Analytics

This intensive two-day course guides you through migrating and modernizing on-premise ETL into Microsoft Azure. You will design and implement a scalable data platform using Azure Data Factory, Azure Data Lake Storage Gen2 and the Medallion Architecture for layered storage.

You will build a realistic pipeline framework to ingest data from relational databases, CSV files and REST APIs, implement a metadata-driven orchestration for incremental loads, and practice monitoring, security and production best practices with ADF, metadata-driven ETL and incremental loading.

THIS TRAINING COURSE WILL HELP YOU:

  • Understand core concepts of Azure cloud data platforms
  • Design and implement Medallion Architecture (Bronze/Silver/Gold)
  • Ingest data from databases, CSVs and REST APIs into Data Lake

WHO SHOULD ATTEND?

  • Data engineers and BI specialists looking to expand cloud skills
  • Data architects designing modern data platforms
  • Developers working with data platforms who want ADF orchestration
  • Anyone considering Azure Cloud for ETL frameworks

COURSE LOCATION AND AVAILABLE DATES



Choose whether to attend in person in our classroom or join online. You can select your preferred format during registration. Learn more about hybrid training.

Public courses are usually delivered in Czech, but this course is also available in English. We can arrange private training for your team online, at your premises or in our classrooms, and tailor the content to your needs.

For groups of around 4 or more participants, private training can already be comparable in price to booking individual places on a public course. Send us your requirements and we’ll recommend the best format and provide an exact quote.

Request training in English

Course content:

Hide details
  • Basics of cloud data architecture and Azure Data Factory
    1. Principles of a modern data platform in Azure
    2. The role of an orchestrator and data storage in the data architecture
    3. Overview of Azure Data Factory services
    4. Description of Integration Runtime and connection methods to data sources
    5. Working with Azure Data Lake Storage Gen2
    6. Medallion Architecture (Bronze / Silver / Gold)
    7. Creating your first ADF pipeline
    8. Loading data from a relational database into the data lake
    9. Ingesting file data (CSV) into ADLS
  • Metadata-driven ETL framework
    1. Orchestrating data pipelines in Azure Data Factory
    2. Loading data from multiple sources (SQL databases, files, REST API)
    3. Designing a metadata table to control ETL processes
    4. Implementing a metadata-driven pipeline (Lookup + ForEach)
    5. Incremental data loading
    6. Transformations between Bronze and Silver layers
    7. Monitoring and managing pipelines in Azure Data Factory
    8. Architecture summary and recommendations for production solutions
Prerequisites:
Basic SQL knowledge and general database concepts are expected.
Schedule:
2 days (9:00-17:00)
Price per person:
676.00 € ( 817.96 € incl. 21% VAT)

Training and learning environment