PyTorch-Deep-Learning-Minicourse

Minicourse in Deep Learning with PyTorch

These lessons, developed during the course of several years while I've been teaching at Purdue and NYU, are here proposed for the Computational and Data Science for High Energy Physics (CoDaS-HEP) summer school at Princeton University. I'll upload the videos and link to them as soon as they are made available to me. I'm also planning to record them in a more quiet environment and at a slower pace, add them to my YouTube channel, and made available here.

Table of contents

T: theory P: practice

1. T Learning paradigms: supervised-, unsupervised-, and reinforcement-learning
2. P Getting started with the tools: Jupyter notebook, PyTorch tensors and autodifferentiation
3. T+P Neural net's forward and backward propagation for classification
4. T+P Convolutional neural nets improve performance by exploiting data nature
5. T+P Unsupervised learning: vanilla and variational autoencoders, generative adversarial nets
6. T+P Recurrent nets natively support sequential data

Sessions

1. Time slot 1 (1h30min + 45 min = 2h15min) on Tuesday afternoon (1, 2, 3)
2. Time slot 2 (1h30min + 45 min = 2h15min) on Wednesday afternoon (4)
3. Extra section (45min) on Thursday afternoon (5)
4. Extra section (1h30min) on Friday morning (6)

Notebooks visualisation

Jupyter Notebooks are used throughout these lectures for interactive data exploration and visualisation.

I use dark styles for both GitHub and Jupyter Notebook. You better do the same, or they will look ugly. To see the content appropriately install the following:

• Jupyter Notebook dark theme;
• GitHub dark theme and comment out the invert #fff to #181818 code block.

Media coverage

• Princeton Research Computing article
• Princeton University main page article

Keeping in touch

Feel free to follow me on Twitter and subscribe to my YouTube channel to have the latest free educational material.

Getting started

To be able to follow the workshop exercises, you are going to need a laptop with Miniconda (a minimal version of Anaconda) and several Python packages installed. Following instruction would work as is for Mac or Ubuntu linux users, Windows users would need to install and work in the Gitbash terminal.

Download and install Miniconda

Please go to the Anaconda website. Download and install the latest Miniconda version for Python 3.6 for your operating system.

wget <http:// link to miniconda>
sh <miniconda .sh>

After that, type:

conda --help

and read the manual.

Check-out the git repository with the exercise

Once Miniconda is ready, checkout the course repository and and proceed with setting up the environment:

git clone https://github.com/Atcold/PyTorch-Deep-Learning-Minicourse 

If you do not have git and do not wish to install it, just download the repository as zip, and unpack it:

wget https://github.com/Atcold/PyTorch-Deep-Learning-Minicourse/archive/master.zip 
#For Mac users:
#curl -O https://github.com/Atcold/PyTorch-Deep-Learning-Minicourse/archive/master.zip 
unzip master.zip

Create isolated Miniconda environment

Change into the course folder, then type:

#cd PyTorch-Deep-Learning-Minicourse 
conda env create -f conda-envt.yml
source activate codas-ml

Enable anaconda kernel in Jupyter

To make newly created miniconda environment visible in the Jupyter, install ipykernel:

python -m ipykernel install --user --name codas-ml --display-name "Codas ML"

Start jupyter notebook

If you are working in a JupyterLab container double click on "Files" tab in the upper right corner. Locate first notebook, double click to open. Do not attempt to start jupyter from the terminal window.

If working on a laptop, start from terminal as usual:

jupyter notebook