BAMU Final Year AI & ML syllabus

BAMU · Final Year B.E. Artificial Intelligence and Machine Learning · CBCGS

Data Engineering

AIM451 · Semester VIII · 4 credits · CT 20 + theory 80

The syllabus prints no unit titles for Data Engineering; they are named here from each unit's contents.

All notes for this subject
  1. Unit 1: Introduction to Data Engineering

    8 hours

    What data engineering is, raw data, data-engineering roles and process; the modern data stack and data pipelines; data engineering compared with data science; data preprocessing and tools.

    Examined in the 80-mark end-semester paper

    • Data engineering lifecycle
    • The modern data stack
    • Data pipeline architecture
  2. Unit 2: SQL with PostgreSQL

    10 hours

    PostgreSQL and psql; SQL basics and the kinds of join; advanced SQL with subqueries, common table expressions and window functions.

    Examined in the 80-mark end-semester paper

    • SQL joins, subqueries and CTEs
    • Window functions in SQL
  3. Unit 3: Data Storage and Ingestion

    12 hours

    Data lakes, warehouses and lakehouses; source systems and replicating source data; batch processing; data ingestion, its kinds, its difference from ETL, tools, best practices and challenges; bulk ingestion with the COPY command.

    Examined in the 80-mark end-semester paper

    • Data lakes and lakehouses
    • Data warehouse architecture
    • Batch and real-time processing
    • Data ingestion: types, tools and challenges
    • ETL and ELT
  4. Unit 4: Data Validation and Modelling

    12 hours

    Data quality of source systems; statistical and rule-based validation; normalisation; dimensional modelling, creating tables and schema migration.

    Examined in the 80-mark end-semester paper

    • Data quality and validation
    • Star and snowflake schemas
    • Schema migration
  5. Unit 5: Business Intelligence and Visualisation

    10 hours

    Business-intelligence tools; Apache Superset and building visualisations with it.

    Examined in the 80-mark end-semester paper

    • Business intelligence tools
    • Business intelligence with Apache Superset
  6. Unit 6: Data Quality, Observability and Governance

    8 hours

    Data quality and observability, data catalogues, data lineage, data governance and DataOps.

    Examined in the 80-mark end-semester paper

    • Data lineage and catalogues
    • Data governance
    • Data observability and DataOps

Unit contents are summarised from the official BAMU syllabus . AiCanCode.org is not affiliated with Dr. Babasaheb Ambedkar Marathwada University (BAMU).