SPPU · Third Year Artificial Intelligence and Data Science · 2024 Pattern
Big Data Engineering
PEC-361B-AID · Elective II · Semester VI · 3 credits · CCE 30 + end-semester 70
One of the Elective II options.
Unit 1: Big Data and Its Ecosystem
6 hoursThe five Vs; structured, semi-structured and unstructured data; limits of traditional processing; distributed and parallel computing; big data architecture layers; the Hadoop ecosystem.
Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)
- Characteristics of big data
- Distributed and parallel computing
- Big data architecture
- Hadoop ecosystem
Unit 2: Hadoop and HDFS
6 hoursHadoop architecture; HDFS NameNode, DataNode and secondary NameNode; blocks, replication and fault tolerance; MapReduce map, reduce and combiner; YARN.
Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)
- HDFS architecture
- Replication and fault tolerance
- MapReduce programming model
- YARN
Unit 3: Apache Spark
6 hoursSpark driver, executors and cluster manager; RDDs, transformations and actions; DataFrames and Spark SQL; Spark Streaming; MapReduce versus Spark and in-memory processing.
Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)
- Spark architecture
- RDD transformations and actions
- DataFrames and Spark SQL
- Spark Streaming
- MapReduce versus Spark
Unit 4: Big Data Tools and Applications
6 hoursData ingestion with Flume and Sqoop; batch and real-time processing; pipeline architecture; cloud big data platforms; governance; uses in healthcare, banking, e-commerce and smart cities.
Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)
- Data ingestion: Flume and Sqoop
- Batch and real-time processing
- Data pipeline architecture
Unit 5: Big Data Security and Governance
6 hoursAuthentication and authorisation; encryption at rest and in transit; RBAC and ABAC; audit, compliance and disaster recovery; privacy, governance and data lifecycle; anonymisation and masking; ethics.
Marks: 14 in the end-semester exam · CCE: Seminar, open-book test or quiz (6 marks, Unit 5)
- Big data security
- Access control: RBAC and ABAC
- Data governance
- Anonymisation and masking
Unit contents are summarised from the official SPPU syllabus . AiCanCode.org is not affiliated with Savitribai Phule Pune University.