Artificial Intelligence & Data Science is coming soon

We're still writing and reviewing the notes for every subject, and we'll open it when every subject is ready. Meanwhile you can practise aptitude, ask Aria about any subject, or see the branches that are ready.

Artificial Intelligence & Data Science

Big Data Engineering

Big data ecosystem, Hadoop and HDFS, MapReduce and YARN, Spark, ingestion pipelines, governance.

Interview questions
Notes for Big Data Engineering are being written and reviewed. Until they're up, Aria teaches every topic — ask for any part of the syllabus, with worked numericals.

Coming next in Big Data Engineering

  1. Characteristics of big data· notes coming
  2. Distributed and parallel computing· notes coming
  3. Big data architecture· notes coming
  4. Hadoop ecosystem· notes coming
  5. HDFS architecture· notes coming
  6. Replication and fault tolerance· notes coming
  7. MapReduce programming model· notes coming
  8. YARN· notes coming
  9. Spark architecture· notes coming
  10. RDD transformations and actions· notes coming
  11. DataFrames and Spark SQL· notes coming
  12. Spark Streaming· notes coming
  13. MapReduce versus Spark· notes coming
  14. Data ingestion: Flume and Sqoop· notes coming
  15. Batch and real-time processing· notes coming
  16. Data pipeline architecture· notes coming
  17. Big data security· notes coming
  18. Access control: RBAC and ABAC· notes coming
  19. Data governance· notes coming
  20. Anonymisation and masking· notes coming
  21. Data engineering lifecycle· notes coming
  22. Data warehouse architecture· notes coming
  23. Star and snowflake schemas· notes coming
  24. OLAP operations· notes coming
  25. ETL and ELT· notes coming
  26. Data lakes and lakehouses· notes coming
  27. Event-driven architecture and publish-subscribe· notes coming
  28. Apache Kafka architecture· notes coming
  29. Stream processing and windowing· notes coming
  30. Data lineage and catalogues· notes coming
  31. Workflow orchestration with Apache Airflow· notes coming
  32. Data mesh, data fabric and serverless data engineering· notes coming
  33. Data ingestion: types, tools and challenges· notes coming
  34. Data quality and validation· notes coming
  35. Graph data modelling· notes coming
  36. Time-series and event data models· notes coming
  37. ROLAP, MOLAP and HOLAP· notes coming
  38. Data privacy regulations: GDPR, HIPAA and CCPA· notes coming
  39. The modern data stack· notes coming
  40. SQL joins, subqueries and CTEs· notes coming
  41. Window functions in SQL· notes coming
  42. Schema migration· notes coming
  43. Business intelligence tools· notes coming
  44. Business intelligence with Apache Superset· notes coming
  45. Data observability and DataOps· notes coming
  46. Drivers for big data adoption· notes coming
  47. HDFS daemons, blocks and file operations· notes coming
  48. Advanced MapReduce: joins and graph algorithms· notes coming
  49. Hadoop cluster setup and administration· notes coming
  50. Hadoop Streaming· notes coming
  51. Hive partitioning and bucketing· notes coming
  52. OLTP versus the data warehouse· notes coming
  53. Top-down and bottom-up data warehouse development· notes coming
  54. Data warehouse planning and the Kimball lifecycle· notes coming
  55. Fact and dimension tables, factless facts and granularity· notes coming