Week 3

Spark/Core/RDD

Important

• Room: Halle 166E
• Monday 26 January 2026 10h45-12h45
• Calendar

Lecture : slides

• Spark RDD

We shall briefly come back to several parts of

• Python Data Science Stack

  • Data processing
  • Visualization

Notebooks

• Jupyter notebook V : Spark RDD

• You shall have gone through (on your own)

• Jupyter notebook I : tour of Python

• html: tour of Python
  

• Jupyter notebook II : tour of numpy

• html: tour of numpy
  

• Jupyter notebook III: tour of pandas

• html: tour of Pandas

References

• Dask Docs

• Dask Examples

• Dask Code

• Dask Blog

• Pandas cheatsheet

Logistics

To work the jupyter notebooks, install python 3, and modules related to jupyter: jupyter-cache, jupyter_client, jupyter_core, jupyterlab_widgets (this induces the installation of dependencies).

https://jupyter.org

Download the jupyter notebooks from notebooks listings.

If you do not already have an ENT account, follow instructions on Moodle to get one. You shall need this account to connect to PostGres cluster.

Back to Agenda ⏎