Readings: Difference between revisions
From info319
| Line 19: | Line 19: | ||
* Sigma: Cassavia, N., & Masciari, E. (2021, March). Sigma: a scalable high performance big data architecture. In 2021 29th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) (pp. 236-239). IEEE. [https://bibsys-almaprimo.hosted.exlibrisgroup.com/primo-explore/openurl?sid=google&auinit=N&aulast=Cassavia&atitle=Sigma:%20a%20scalable%20high%20performance%20big%20data%20architecture&id=doi:10.1109%2FPDP52278.2021.00044&vid=UBB&institution=UBB&url_ctx_val=&url_ctx_fmt=null&isSerivcesPage=true Paper] | * Sigma: Cassavia, N., & Masciari, E. (2021, March). Sigma: a scalable high performance big data architecture. In 2021 29th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) (pp. 236-239). IEEE. [https://bibsys-almaprimo.hosted.exlibrisgroup.com/primo-explore/openurl?sid=google&auinit=N&aulast=Cassavia&atitle=Sigma:%20a%20scalable%20high%20performance%20big%20data%20architecture&id=doi:10.1109%2FPDP52278.2021.00044&vid=UBB&institution=UBB&url_ctx_val=&url_ctx_fmt=null&isSerivcesPage=true Paper] | ||
* Maamouri, A., Sfaxi, L., & Robbana, R. (2021, December). Phi: A Generic Microservices-Based Big Data Architecture. In European, Mediterranean, and Middle Eastern Conference on Information Systems (pp. 3-16). Springer, Cham. [https://link.springer.com/chapter/10.1007/978-3-030-95947-0_1 Paper] | * Maamouri, A., Sfaxi, L., & Robbana, R. (2021, December). Phi: A Generic Microservices-Based Big Data Architecture. In European, Mediterranean, and Middle Eastern Conference on Information Systems (pp. 3-16). Springer, Cham. [https://link.springer.com/chapter/10.1007/978-3-030-95947-0_1 Paper] | ||
Marc: | |||
You found the other Phi architecture. 😃 The one I meant was: https://ieeexplore.ieee.org/abstract/document/8712381 But both have interesting contributions. The one you found considers the training part which it is not instantiated in the others. | |||
This is the "original publication" of Lambda: http://nathanmarz.com/blog/how-to-beat-the-cap-theorem.html , it is a blog entry. | |||
--> | --> | ||
Revision as of 19:01, 4 September 2022
Books
Text books:
- Rob Kitchin. The Data Revolution - Big Data, Open Data, Data Infrastructures & Their Consequences. Sage, 2014.
- chapters 1, 3-5, 12-19 are mandatory (I will make some of the latest chapters supplementary, perhaps 14, 18, and 19 - TBA)
- Bill Chambers and Matei Zaharia: Spark: The Definitive Guide - Big Data Processing Made Simple. O'Riley, 2018. File:Spark-TheDefinitiveGuide.pdf
- chapters 1-9, 12, 15, 20-21 are mandatory (chapter 10 on SQL is also highly relevant)
- GitHub repository with code and data examples
Papers
Selected papers will become available here, including:
- Section 1 in Opdahl, A. L., & Nunavath, V. (2020). Big Data. Big Data in Emergency Management: Exploitation Techniques for Social and Mobile Data, 15-29. Book chapter
- Paper on big-data architecture (TBA)
- Gallofré, M., Opdahl, A. L., Stoppel, S., Tessem, B., & Veres, C. (2021). The News Angler Project: Exploring the Next Generation of Journalistic Knowledge Platforms. In Proceedings of Norsk IKT-konferanse for forskning og utdanning. Short Paper and poster: File:A1-Poster-NIKT2021.pdf
Supplementary:
- Opdahl, A. L., & Tessem, B. (2021). Ontologies for finding journalistic angles. Software and Systems Modeling, 20(1), 71-87. Paper
- Berven, A., Christensen, O. A., Moldeklev, S., Opdahl, A. L., & Villanger, K. J. (2020). A knowledge-graph platform for newsrooms. Computers in Industry, 123, 103321. Paper
Technical introductions
Selected web pages will become available here, including:
- Kafka Introduction
- NREC and OpenStack, the following sections/pages: Introduction, Project application, Logging in, The dashboard, Create a Linux virtual machine (skip: Windows), Using SSH, Working with Security Groups, Create and manage volumes, Create and manage snapshots (skip: images), Instance console
- TerraForm and NREC part I, part II, and part III
- How Ansible Works and the Ansible Community portal
- Docker Docs: Docker overview and Get started
- Learn Kubernetes basics, modules 1-6
- What is GDPR, the EU’s new data protection law?
Supplementary:
- Spark 3.3.0 Overview and Quick Start (with Python examples)
- Twitter API v2
- Tweepy: Twitter for Python
- Tweepy Documentation
- EU's General Data Protection Regulation (GDPR) - the official legal text
Lecture slides
See the Session page for lecture slides after each session.
Readings for each sessionx
The Sessions page will suggest specific readings for each session and its associated exercise.
