BAMU · Third Year B.E./B.Tech Artificial Intelligence and Data Science · NEP 2020
Data Engineering
PCCT-2 · Semester VI · 3 credits · CIA 40 + SEE 60
Module 1: Introduction to Data Engineering; Source Systems and Data Ingestion
15 hoursData engineering, its roles, process and the modern data stack, data pipelines, data engineering versus data science, preprocessing and tools; data lakes, warehouses and lakehouses, source systems and replication, batch processing, types of data ingestion, ingestion versus ETL, tools and best practices.
Examined in the 60-mark end-semester paper
- Data engineering lifecycle
- Data pipeline architecture
- Data lakes and lakehouses
- ETL and ELT
- Batch and real-time processing
- Data ingestion: types, tools and challenges
Module 2: Data Cleansing, Metadata and Governance; Introduction to Data Modelling
15 hoursData quality, statistical and rule-based validation, normalisation, dimensional modelling, schema migration, catalogues, lineage, governance, DataOps and observability; the purpose of data modelling, graph data models (Neo4j), event-driven and temporal models and time-series databases, semantic modelling, data mesh and data fabric.
Examined in the 60-mark end-semester paper
- Data quality and validation
- Data lineage and catalogues
- Data governance
- Graph data modelling
- Time-series and event data models
- Data mesh, data fabric and serverless data engineering
Module 3: Data Warehousing; Data Security, Privacy and Compliance
15 hoursOperational databases versus warehouses, multi-tier architecture, data cubes, star, snowflake and fact-constellation schemas, the design process, OLAP query processing, ROLAP, MOLAP and HOLAP; secure schema design, PII, anonymisation, pseudonymisation and masking, GDPR, HIPAA and CCPA, and retention and deletion policies.
Examined in the 60-mark end-semester paper
- Data warehouse architecture
- Star and snowflake schemas
- OLAP operations
- ROLAP, MOLAP and HOLAP
- Anonymisation and masking
- Data privacy regulations: GDPR, HIPAA and CCPA
Module contents are summarised from the official BAMU syllabus . AiCanCode.org is not affiliated with Dr. Babasaheb Ambedkar Marathwada University (BAMU).