BAMU · Final Year B.E. Computer Science and Engineering · CBCS (2019)
Big Data Computing
CSE451 · Semester VIII · 4 credits · CT 20 + theory 80
Unit 1: Statistics Essential for Analytics
6 hoursDescriptive and inferential statistics; mean, median and mode; range, IQR, standard deviation, variance, skewness and kurtosis; probability, conditional probability, Bayesian inference, normal and Poisson distributions.
Examined in the 80-mark end-semester paper
- Descriptive statistics: central tendency and spread
- Probability distributions and Bayesian inference
Unit 2: Data Extraction, Wrangling and Exploration
8 hoursTypes of data and variables; sampling, point estimation, parametric and non-parametric hypothesis testing; the analysis pipeline; extraction and wrangling; exploratory analysis and plots (case study: stock-market prediction).
Examined in the 80-mark end-semester paper
- Sampling, estimation and hypothesis testing
- Data wrangling and exploratory data analysis
- Visualising data: histograms, box plots and scatter plots
Unit 3: Fundamentals of Big Data
6 hoursBig data, its characteristics, types and five Vs; drivers and challenges; where RDBMSs fall short; NoSQL, the CAP theorem and key-value, document, column and graph stores.
Examined in the 80-mark end-semester paper
- Characteristics and types of big data
- NoSQL and its business drivers
- CAP theorem, eventual consistency, ACID and BASE
- Key-value and document stores
- Column-family and graph stores
Unit 4: Introduction to Hadoop
6 hoursHadoop's characteristics and history, Hadoop versus RDBMS, the ecosystem (1.x and 2.x) and commands; HDFS and MapReduce architecture and phases; YARN.
Examined in the 80-mark end-semester paper
- Hadoop and its ecosystem
- Distributed file systems and HDFS
- MapReduce: map, shuffle and reduce
- Apache Spark and YARN
Unit 5: Pig and Hive
8 hoursPig's architecture and execution modes, Pig Latin types, statements and operators, debugging; Hive's architecture and modes, HiveQL DDL and DML operations.
Examined in the 80-mark end-semester paper
- Apache Pig and Pig Latin
- Apache Hive and HiveQL
Unit 6: HBase and Sqoop
6 hoursHBase architecture, HBase versus RDBMS and shell commands; Sqoop architecture, importing tables and subsets, and incremental imports.
Examined in the 80-mark end-semester paper
- Cassandra and HBase internals
- Apache Sqoop: importing data into Hadoop
Unit contents are summarised from the official BAMU syllabus . AiCanCode.org is not affiliated with Dr. Babasaheb Ambedkar Marathwada University (BAMU).