Foundations.

This introductory course takes you from zero to fully operational: setup, first pipelines, core blocks, triggers, CI/CD, SQL blocks, and a final project.

54 lessons

Prerequisites: Intermediate SQL, basic Python

Module 1

Introduction

Learn the essentials to start building and delivering with Mage.

1.1What is data engineering?
1.2How does Mage fit into data engineering
1.3Introduction to blocks
1.4Project Preview
1.5Knowledge check

Module 2

Setup

Get up and running as quickly and easily as possible.

2.1Cluster Management
2.2Adding users
2.3Creating workspaces
2.4Creating pipelines
2.5Practical exercise
2.6Knowledge check

Module 3

Configurations

Take total control of the platform with in-depth config controls.

3.1Environment Variables
3.2Secrets
3.3Google Cloud Platform service account file
3.4io_config.yml file
3.5Practical exercise
3.6Practical exercise
3.7Knowledge check

Module 4

Blocks

Harness building blocks to create, enhance, and customize workflows.

4.1Data loaders
4.2Transformers
4.3Data exporter
4.4Scratchpad
4.5Sensor
4.6dbt
4.7Power ups
4.8Add on blocks
4.9R Blocks
4.10Adding blocks
4.11Practical exercise
4.12Knowledge check

Module 5

Triggers

Deliver data exactly where it needs to go, exactly when it needs it.

5.1Introduction to triggers
5.2Run settings
5.3Schedule trigger
5.4API trigger
5.5Trigger multiple pipelines
5.6Practice exercise
5.7Knowledge check

Module 6

CI / CD

Deploy pipelines at scale and keep them running efficiently.

6.1Introduction to CICD
6.2Git commands
6.3Set up Deployments
6.4Version Control Application
6.5Deploy code
6.6Practical Exercise
6.7Knowledge check

Module 7

SQL Blocks

Leverage familiar SQL conventions to shape data with agency.

7.1Introduction to SQL blocks
7.2Use Mage SQL UI
7.3Use raw SQL
7.4Practice exercise
7.5Knowledge check

Module 8

Final Project

Put everything you learned into practice with a real project.

8.1Building a Star Schema
8.2Part 1: Build the Dimension Tables
8.3Part 2: Build the Fact Table
8.4Wrap-up