SPPU · Third Year Information Technology · 2024 Pattern
Data Science & Big Data Analytics
PCC-351-ITT · Semester VI · 3 credits · CCE 30 + end-semester 70
Unit 1: Big Data Overview
9 hoursStructured, semi-structured and unstructured data; big data definitions, the 3 Vs, types and handling techniques; MPP, cloud, grid and cluster computing; big data architecture layers; data sources, quality, preprocessing and cloud storage; applications.
Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)
- Big data and its characteristics
- Types of data
- Big data architecture
- Scalability: MPP, cloud, grid and cluster computing
- Data sources, quality and preprocessing
Unit 2: Data Analytics Using Python
9 hoursDescriptive, diagnostic, predictive and prescriptive analytics and the analytics life cycle; handling missing data, duplicates, mapping, renaming, binning and outliers; encoding categorical data; hierarchical indexing; merge, join and concat; pivot and melt; group operations.
Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)
- Types of analytics and the analytics life cycle
- Cleaning data with pandas
- Transforming data, binning and outliers
- Hierarchical indexing
- Merging, joining and concatenating
- Reshaping, pivoting and group operations
Unit 3: Hadoop Storage and Processing
9 hoursCentralised versus distributed computing; HDFS, MapReduce v1, YARN and MapReduce v2; the MapReduce model, key–value pairs, shuffle, sort, partitioning and combiners; the Hadoop ecosystem: ZooKeeper, Oozie, Sqoop, Flume, Hive, Pig and HBase.
Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)
- Hadoop and HDFS
- MapReduce programming model
- Shuffle, sort, partitioner and combiner
- YARN
- The Hadoop ecosystem
Unit 4: Spark Processing
9 hoursWhy Spark, its features and Hadoop versus Spark; in-memory computing; driver, context, cluster manager, workers and executors; Spark SQL and DataFrames: selection, filtering, aggregation and grouping.
Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)
- Apache Spark and in-memory computing
- Spark architecture
- Spark SQL and DataFrames
Unit 5: Big Data Visualization
9 hoursThe role of visualisation in analytics and decision support; bar, pie, line, histogram, scatter and heat-map charts; exploratory data analysis; Matplotlib, Seaborn and Tableau.
Marks: 14 in the end-semester exam · CCE: Seminar, open-book test or quiz (6 marks, Unit 5)
- Role of data visualisation
- Common chart types
- Exploratory data analysis
- Visualisation with Matplotlib and Seaborn
Unit contents are summarised from the official SPPU syllabus . AiCanCode.org is not affiliated with Savitribai Phule Pune University.