All pages
- Apache Hadoop and MapReduce
- Apache Spark
- Central themes
- Central themes:
- Configure Spark cluster using Ansible
- Context
- Course description
- Course description:
- Course wiki for INFO319
- Create Spark cluster
- Create Spark cluster using Terraform
- Datasets
- Essay
- Exercises
- Final exam
- Getting started with Apache Spark
- Hadoop preparations
- Information meeting
- Information meeting via Zoom
- Install HDFS and YARN on the cluster
- Install Kafka on the cluster
- Install Spark on the cluster
- Literature
- Main Page
- NLP for EM and visualization/Dashboards
- P3-3.pdf
- Practical session, introduction to Spark
- Practical session, Spark streaming for sentiment analysis
- Practical session, Spark streaming for Twitter data analysis
- Practical session, trying emergency response tool (Ushahidi)
- Practical session, using Spark for emergency datasources
- Processing tweets with Spark
- Programming project
- Readings
- Running Hadoop
- Running Spark
- Sentiment analysis using Spark Streaming
- Session 10 - Student programming project presentations (mandatory)
- Session 1 - Introduction to INFO319 and Emergency Management
- Session 2 - Big Data for emergency management
- Session 3 - Emergency data sources
- Session 4 - Sensors/IoT for Emergency Management
- Session 5 - Social Media for Emergency Management
- Session 6 - Machine learning and NLP for EM
- Session 6 - NLP for EM and visualization/Dashboards
- Session 7 - Essay presentations (mandatory)
- Session 7 - Machine learning for Emergency Management
- Session 8 - Essay presentations (mandatory)
- Session 8 - Student programming project presentations (mandatory)
- Session 8 - Visualization/Dashboards for Emergency Management (Guest lecture)
- Session 9 - Essay presentations (mandatory)
- Session 9 - Student programming project presentations (mandatory)
- Sessions
- Spark preparations
- Spark Streaming Twitter
- Streaming tweets with Kafka and Spark
- Streaming tweets with Twitter API
- Student group programming project
- Student project
- Tools
- Variables.pdf
- Variables.png
