N a n o d e g r e e p r o g r a m s y L l a b u s


Need Help? Speak with an Advisor:  www.udacity.com/advisor



Download 0,76 Mb.
Pdf ko'rish
bet6/16
Sana26.01.2022
Hajmi0,76 Mb.
#412237
1   2   3   4   5   6   7   8   9   ...   16
Bog'liq
Data Engineering Nanodegree Program Syllabus

Need Help? Speak with an Advisor: 

www.udacity.com/advisor

Course 4: Automate Data Pipelines

In this course, you’ll learn to schedule, automate, and monitor data pipelines using Apache Airflow. You’ll 

learn to run data quality checks, track data lineage, and work with data pipelines in production.



LEARNING OUTCOMES

LESSON ONE

Data Pipelines

• 

Create data pipelines with Apache Airflow 



• 

Set up task dependencies 

• 

Create data connections using hooks



LESSON TWO

Data Quality

• 

Track data lineage 



• 

Set up data pipeline schedules 

• 

Partition data to optimize pipelines



• 

Write tests to ensure data quality 

• 

Backfill data



LESSON THREE

Production Data

Pipelines

• 

Build reusable and maintainable pipelines 



• 

Build your own Apache Airflow plugins

• 

Implement subDAGs



• 

Set up task boundaries

• 

Monitor data pipelines



Course Project

 

Data Pipelines with Airflow



In this project, you’ll continue your work on the music streaming 

company’s data infrastructure by creating and automating a set of 

data pipelines. You’ll configure and schedule data pipelines with 

Airflow and monitor and debug production pipelines.




Data Engineering  |  8


Download 0,76 Mb.

Do'stlaringiz bilan baham:
1   2   3   4   5   6   7   8   9   ...   16




Ma'lumotlar bazasi mualliflik huquqi bilan himoyalangan ©hozir.org 2024
ma'muriyatiga murojaat qiling

kiriting | ro'yxatdan o'tish
    Bosh sahifa
юртда тантана
Боғда битган
Бугун юртда
Эшитганлар жилманглар
Эшитмадим деманглар
битган бодомлар
Yangiariq tumani
qitish marakazi
Raqamli texnologiyalar
ilishida muhokamadan
tasdiqqa tavsiya
tavsiya etilgan
iqtisodiyot kafedrasi
steiermarkischen landesregierung
asarlaringizni yuboring
o'zingizning asarlaringizni
Iltimos faqat
faqat o'zingizning
steierm rkischen
landesregierung fachabteilung
rkischen landesregierung
hamshira loyihasi
loyihasi mavsum
faolyatining oqibatlari
asosiy adabiyotlar
fakulteti ahborot
ahborot havfsizligi
havfsizligi kafedrasi
fanidan bo’yicha
fakulteti iqtisodiyot
boshqaruv fakulteti
chiqarishda boshqaruv
ishlab chiqarishda
iqtisodiyot fakultet
multiservis tarmoqlari
fanidan asosiy
Uzbek fanidan
mavzulari potok
asosidagi multiservis
'aliyyil a'ziym
billahil 'aliyyil
illaa billahil
quvvata illaa
falah' deganida
Kompyuter savodxonligi
bo’yicha mustaqil
'alal falah'
Hayya 'alal
'alas soloh
Hayya 'alas
mavsum boyicha


yuklab olish