SPPU TE AI&DS syllabus

SPPU · Third Year Artificial Intelligence and Data Science · 2024 Pattern

Big Data Engineering

PEC-361B-AID · Elective II · Semester VI · 3 credits · CCE 30 + end-semester 70

One of the Elective II options.

All notes for this subject
  1. Unit 1: Big Data and Its Ecosystem

    6 hours

    The five Vs; structured, semi-structured and unstructured data; limits of traditional processing; distributed and parallel computing; big data architecture layers; the Hadoop ecosystem.

    Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)

    • Characteristics of big data
    • Distributed and parallel computing
    • Big data architecture
    • Hadoop ecosystem
  2. Unit 2: Hadoop and HDFS

    6 hours

    Hadoop architecture; HDFS NameNode, DataNode and secondary NameNode; blocks, replication and fault tolerance; MapReduce map, reduce and combiner; YARN.

    Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)

    • HDFS architecture
    • Replication and fault tolerance
    • MapReduce programming model
    • YARN
  3. Unit 3: Apache Spark

    6 hours

    Spark driver, executors and cluster manager; RDDs, transformations and actions; DataFrames and Spark SQL; Spark Streaming; MapReduce versus Spark and in-memory processing.

    Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)

    • Spark architecture
    • RDD transformations and actions
    • DataFrames and Spark SQL
    • Spark Streaming
    • MapReduce versus Spark
  4. Unit 4: Big Data Tools and Applications

    6 hours

    Data ingestion with Flume and Sqoop; batch and real-time processing; pipeline architecture; cloud big data platforms; governance; uses in healthcare, banking, e-commerce and smart cities.

    Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)

    • Data ingestion: Flume and Sqoop
    • Batch and real-time processing
    • Data pipeline architecture
  5. Unit 5: Big Data Security and Governance

    6 hours

    Authentication and authorisation; encryption at rest and in transit; RBAC and ABAC; audit, compliance and disaster recovery; privacy, governance and data lifecycle; anonymisation and masking; ethics.

    Marks: 14 in the end-semester exam · CCE: Seminar, open-book test or quiz (6 marks, Unit 5)

    • Big data security
    • Access control: RBAC and ABAC
    • Data governance
    • Anonymisation and masking

Unit contents are summarised from the official SPPU syllabus . AiCanCode.org is not affiliated with Savitribai Phule Pune University.