Lakehouse Platforms and Delta Lake

Entry requirements

D01; Python and SQL proficiency

What 36 hours means

Lessons

24 h

Capstone

8 h

Assessment

2 h

Remediation

2 h

Syllabus

Four modules, twelve lessons. Every lesson states what it covers and the evidence you produce for it.

• Module

  01

  3 lessons · 6 h

  

  Module 1

  Platform choices

  Data warehouse and lakehouse · Spark dataframes · Storage layout

  D02Show lessonsHide lessons▾

  1. D02.01 · 120 min

     Data warehouse and lakehouse

     Compare storage and compute patterns for a telemetry workload.

     Evidence: An architecture decision records cost, latency and governance needs.

  2. D02.02 · 120 min

     Spark dataframes

     Load and transform partitioned data with explicit schemas.

     Evidence: Output schema and aggregates match provided checks.

  3. D02.03 · 120 min

     Storage layout

• Module

  02

  3 lessons · 6 h

  

  Module 2

  Delta tables

  Delta transactions · Updates and merge · Schema evolution

  D02Show lessonsHide lessons▾

  1. D02.04 · 120 min

     Delta transactions

     Create a table and inspect transaction history.

     Evidence:

• Module

  03

  3 lessons · 6 h

  

  Module 3

  Governance

  Historical versions · Quality layers · Governance concepts

  D02Show lessonsHide lessons▾

  1. D02.07 · 120 min

     Historical versions

     Query earlier table state and plan retention implications.

     Evidence:

• Module

  04

  3 lessons · 6 h

  

  Module 4

  Production design

  Unity Catalog guided practice · Optimisation and observation · Migration and recovery

  D02Show lessonsHide lessons▾

  1. D02.10 · 120 min

     Unity Catalog guided practice

     Map the governance design to a licensed workspace if supplied; otherwise use a clearly labelled simulation.

Capstone

Build a bronze, silver and gold lakehouse for synthetic telemetry, including schema evolution, historical correction and governed access.

Lab environment

Data sandbox; optional licensed vendor workspace

Lab infrastructure is not yet provisioned, so this describes the environment the course is designed for rather than one you can launch today.

Part of a pathway

• Data Engineering Professional