BAMU · Final Year B.E. Information Technology · CBCS (2019)
Big Data Computing
CSE451 · Semester VIII · 4 credits · CT 20 + theory 80
Unit 1: Statistics Essential for Analytics
6 hoursInferential and descriptive statistics; central tendency and spread, skewness and kurtosis; probability, distributions, conditional probability, Bayesian inference, normal and Poisson distributions.
Examined in the 80-mark end-semester paper
- Descriptive statistics
- Correlation, covariance and hypothesis testing
Unit 2: Data Extraction, Wrangling and Exploration
8 hoursTypes of data and variables, sampling, estimation and hypothesis tests; the data analysis pipeline; data extraction and wrangling; exploratory analysis and plots (case study: stock-market prediction).
Examined in the 80-mark end-semester paper
- Types of data
- Data sources, quality and preprocessing
- Exploratory data analysis
- Common chart types
Unit 3: Fundamentals of Big Data
6 hoursBig data, its characteristics and five Vs; structured, semi-structured and unstructured data; drivers and challenges; the limits of RDBMS; NoSQL, the CAP theorem and NoSQL categories.
Examined in the 80-mark end-semester paper
- Big data and its characteristics
- Traditional versus big data approaches
- NoSQL data architecture patterns
Unit 4: Introduction to Hadoop
6 hoursHadoop's characteristics and history, Hadoop versus RDBMS, the ecosystem (1.x and 2.x), HDFS and MapReduce architecture, command-line HDFS operations, MapReduce phases and YARN.
Examined in the 80-mark end-semester paper
- Hadoop and HDFS
- MapReduce programming model
- YARN
- The Hadoop ecosystem
Unit 5: Pig and Hive Hadoop Projects
8 hoursPig architecture, execution modes, Pig Latin data types and statements, operators and debugging; Hive architecture, modes, HiveQL DDL and DML.
Examined in the 80-mark end-semester paper
- Apache Pig and Pig Latin
- Apache Hive and HiveQL
Unit 6: HBase and Sqoop Hadoop Projects
6 hoursHBase architecture, HBase versus RDBMS and shell commands; Sqoop architecture, importing tables, target directories, subsets and incremental imports.
Examined in the 80-mark end-semester paper
- Apache HBase and Sqoop
Unit contents are summarised from the official BAMU syllabus . AiCanCode.org is not affiliated with Dr. Babasaheb Ambedkar Marathwada University (BAMU).