Tuesday, February 15, 2022

Data Engineering Roadmap for beginner

1. Programming Languages

2. Learn Linux

Linux Essentials - Beginner Crash Course (Ubuntu) https://www.youtube.com/watch?v=n_2jPbQornY

3. Learn about Data Structures and Algorithms

DATA STRUCTURES you MUST know https://www.youtube.com/watch?v=sVxBVvlnJsM

4. Learn about Core DBMS (Database Management Systems)

Learn RDBMS in 6 minutes https://www.youtube.com/watch?v=t48TGntrX4s

5. Learn SQL

SQL Tutorial - Full Database Course for Beginners https://www.youtube.com/watch?v=HXV3zeQKqGY

6. Data Exploration Libraries (Pandas — NumPy — Spark)

7. Data Warehousing and Data Lake Concepts

8. Learn about Distributed Computing and Cloud Computing 

Cloud Computing Tutorial for Beginners https://www.youtube.com/watch?v=RWgW-CgdIk0
Distributed Systems | Distributed Computing Explained https://www.youtube.com/watch?v=ajjOEltiZm4

9. Workflow schedulers

Apache Airflow for beginners https://www.youtube.com/watch?v=YWtfU0MQZ_4

10. NoSQL Databases

11. Streaming Systems

Kafka Streams 101: Getting Started https://www.youtube.com/watch?v=y9a3fldlvnI

12. Dashboarding tools

14. Data Engineering in the Cloud

AWS Data Engineering Course - Full Course https://www.youtube.com/watch?v=ckQ7d6ca2J0
Google Cloud Platform Full Course https://www.youtube.com/watch?v=IUU6OR8yHCc

15. DevOps (Docker — Kubernetes)

Docker and Kubernetes Tutorial | Full Course [2021] https://www.youtube.com/watch?v=bhBSlnQcq2k

16. System Design

System Design Course for Beginners https://www.youtube.com/watch?v=MbjObHmDbZo
System Design Interview – Step By Step Guide https://www.youtube.com/watch?v=bUHFg8CZFws
System Design Mock Interview: Design Instagram https://www.youtube.com/watch?v=VJpfO6KdyWE

This series touches key areas in system design, which are used to design real world systems and interview questions.

  1. Load balancing
  2. Message Passing
  3. Microservice architecture
  4. NoSQL databases
  5. Distributed Systems