BAMU · Final Year B.E. Artificial Intelligence and Machine Learning · CBCGS
Data Engineering
AIM451 · Semester VIII · 4 credits · CT 20 + theory 80
The syllabus prints no unit titles for Data Engineering; they are named here from each unit's contents.
Unit 1: Introduction to Data Engineering
8 hoursWhat data engineering is, raw data, data-engineering roles and process; the modern data stack and data pipelines; data engineering compared with data science; data preprocessing and tools.
Examined in the 80-mark end-semester paper
- Data engineering lifecycle
- The modern data stack
- Data pipeline architecture
Unit 2: SQL with PostgreSQL
10 hoursPostgreSQL and psql; SQL basics and the kinds of join; advanced SQL with subqueries, common table expressions and window functions.
Examined in the 80-mark end-semester paper
- SQL joins, subqueries and CTEs
- Window functions in SQL
Unit 3: Data Storage and Ingestion
12 hoursData lakes, warehouses and lakehouses; source systems and replicating source data; batch processing; data ingestion, its kinds, its difference from ETL, tools, best practices and challenges; bulk ingestion with the COPY command.
Examined in the 80-mark end-semester paper
- Data lakes and lakehouses
- Data warehouse architecture
- Batch and real-time processing
- Data ingestion: types, tools and challenges
- ETL and ELT
Unit 4: Data Validation and Modelling
12 hoursData quality of source systems; statistical and rule-based validation; normalisation; dimensional modelling, creating tables and schema migration.
Examined in the 80-mark end-semester paper
- Data quality and validation
- Star and snowflake schemas
- Schema migration
Unit 5: Business Intelligence and Visualisation
10 hoursBusiness-intelligence tools; Apache Superset and building visualisations with it.
Examined in the 80-mark end-semester paper
- Business intelligence tools
- Business intelligence with Apache Superset
Unit 6: Data Quality, Observability and Governance
8 hoursData quality and observability, data catalogues, data lineage, data governance and DataOps.
Examined in the 80-mark end-semester paper
- Data lineage and catalogues
- Data governance
- Data observability and DataOps
Unit contents are summarised from the official BAMU syllabus . AiCanCode.org is not affiliated with Dr. Babasaheb Ambedkar Marathwada University (BAMU).