SPPU TE IT syllabus

SPPU · Third Year Information Technology · 2024 Pattern

Data Science & Big Data Analytics

PCC-351-ITT · Semester VI · 3 credits · CCE 30 + end-semester 70

All notes for this subject
  1. Unit 1: Big Data Overview

    9 hours

    Structured, semi-structured and unstructured data; big data definitions, the 3 Vs, types and handling techniques; MPP, cloud, grid and cluster computing; big data architecture layers; data sources, quality, preprocessing and cloud storage; applications.

    Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)

    • Big data and its characteristics
    • Types of data
    • Big data architecture
    • Scalability: MPP, cloud, grid and cluster computing
    • Data sources, quality and preprocessing
  2. Unit 2: Data Analytics Using Python

    9 hours

    Descriptive, diagnostic, predictive and prescriptive analytics and the analytics life cycle; handling missing data, duplicates, mapping, renaming, binning and outliers; encoding categorical data; hierarchical indexing; merge, join and concat; pivot and melt; group operations.

    Marks: 14 in the end-semester exam · CCE: Unit test (12 marks, Units 1 & 2)

    • Types of analytics and the analytics life cycle
    • Cleaning data with pandas
    • Transforming data, binning and outliers
    • Hierarchical indexing
    • Merging, joining and concatenating
    • Reshaping, pivoting and group operations
  3. Unit 3: Hadoop Storage and Processing

    9 hours

    Centralised versus distributed computing; HDFS, MapReduce v1, YARN and MapReduce v2; the MapReduce model, key–value pairs, shuffle, sort, partitioning and combiners; the Hadoop ecosystem: ZooKeeper, Oozie, Sqoop, Flume, Hive, Pig and HBase.

    Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)

    • Hadoop and HDFS
    • MapReduce programming model
    • Shuffle, sort, partitioner and combiner
    • YARN
    • The Hadoop ecosystem
  4. Unit 4: Spark Processing

    9 hours

    Why Spark, its features and Hadoop versus Spark; in-memory computing; driver, context, cluster manager, workers and executors; Spark SQL and DataFrames: selection, filtering, aggregation and grouping.

    Marks: 14 in the end-semester exam · CCE: Assignments or case study (12 marks, Units 3 & 4)

    • Apache Spark and in-memory computing
    • Spark architecture
    • Spark SQL and DataFrames
  5. Unit 5: Big Data Visualization

    9 hours

    The role of visualisation in analytics and decision support; bar, pie, line, histogram, scatter and heat-map charts; exploratory data analysis; Matplotlib, Seaborn and Tableau.

    Marks: 14 in the end-semester exam · CCE: Seminar, open-book test or quiz (6 marks, Unit 5)

    • Role of data visualisation
    • Common chart types
    • Exploratory data analysis
    • Visualisation with Matplotlib and Seaborn

Unit contents are summarised from the official SPPU syllabus . AiCanCode.org is not affiliated with Savitribai Phule Pune University.