PAHSU · Third Year B.Tech. Computer Science and Engineering · NEP 2020
Big Data Analytics
CSEPEC-03B · Programme Elective III · Semester VI · 4 credits · ISE 30 + ESE 70
One of the Programme Elective III options.
Unit 1: Introduction to Types of Digital Data
4 hoursClassification of digital data: structured, semi-structured and unstructured data, their sources and how to deal with unstructured data.
Examined in the 70-mark end-semester paper
- Characteristics and types of big data
Unit 2: Introduction to Big Data
4 hoursWhat big data is and why it matters; other characteristics of data; challenges with big data; the big data stack.
Examined in the 70-mark end-semester paper
- Big data stack and enabling technologies
Unit 3: Big Data Analytics
6 hoursAnalytics 1.0, 2.0 and 3.0; traditional BI versus the big data environment; the big data technology landscape; NoSQL versus RDBMS and NewSQL; Hadoop 1.0 versus 2.0; data science and the data scientist.
Examined in the 70-mark end-semester paper
- NoSQL and its business drivers
- CAP theorem, eventual consistency, ACID and BASE
- Predictive, descriptive and prescriptive analytics
Unit 4: Introduction to Hadoop
10 hoursWhy not an RDBMS; distributed computing challenges; Hadoop history, components and architecture; HDFS architecture, daemons and commands; processing data with MapReduce and the word-count example in Java; resource management with YARN; Hadoop 2; the ecosystem: Hive, Pig, HBase and Sqoop.
Examined in the 70-mark end-semester paper
- Hadoop and its ecosystem
- Distributed file systems and HDFS
- MapReduce: map, shuffle and reduce
- Apache Spark and YARN
- Apache Sqoop: importing data into Hadoop
Unit 5: Introduction to MongoDB
5 hoursNoSQL recap; MongoDB CRUD, arrays, JavaScript and cursors; MapReduce programming and aggregations.
Examined in the 70-mark end-semester paper
- MongoDB query language and schema design
- MongoDB: CRUD, indexing and aggregation
Unit 6: Introduction to Cassandra
4 hoursFeatures of Cassandra; CQLSH CRUD; collections, counters, lists, sets and maps; tracing.
Examined in the 70-mark end-semester paper
- Cassandra and HBase internals
- Cassandra Query Language: CRUD and collections
Unit 7: Introduction to Hive
8 hoursHive history, features, integration and workflow; data units and architecture; primitive and collection types and file formats; HiveQL DDL and DML; partitions and bucketing; views, subqueries and joins; user-defined functions, aggregation, GROUP BY and HAVING; SerDe; analytic functions.
Examined in the 70-mark end-semester paper
- Apache Hive and HiveQL
Unit 8: Introduction to Pig
4 hoursPig: history, anatomy and philosophy; Pig on Hadoop; ETL processing; Pig Latin and the word-count example.
Examined in the 70-mark end-semester paper
- Apache Pig and Pig Latin
Unit contents are summarised from the official PAHSU syllabus . AiCanCode.org is not affiliated with Punyashlok Ahilyadevi Holkar Solapur University (PAHSU).