SWAN¶
Preparation¶
-
Registration:
To require GPU resources for SWAN: According to this thread, one can create a ticket through this link to ask for GPU support at SWAN, it is now in beta version and limited to a small scale. 2. Setup SWAN with GPU resources:
-
Once the registration is done, one can login SWAN with Kerberes8 support and then create his SWAN environment.
-
Another important option is the environment script, which will be discussed later in this document.
Working with SWAN¶
-
After creation, one will browse the SWAN main directory
My Project
where all existing projects are displayed. A new project can be created by clicking the upper right "+" button. After creation one will be redirected to the newly created project, at which point the "+" button on the upper right panel can be used for creating new notebook. -
It is possible to use the terminal for installing new packages or monitoring computational resources.
-
For package installation, one can install packages with package management tools, e.g.
pip
forpython
. To use the installed packages, you will need to wrap the environment configuration in a scrip, which will be executed by SWAN. Detailed documentation can be found by clicking the upper right "?" button. -
In addition to using top and htop to monitor ordinary resources, you can use nvidia-smi to monitor GPU usage.
-
Examples¶
After installing package, you can then use GPU based machine learning algorithms. Two examples are supplied as an example.
-
The first example aims at using a CNN to perform handwritten digits classification with
MNIST
dataset. The whole notebook can be found at PytorchMNIST. This example is modified from an officialpytorch
example. -
The second example is modified from the simple MLP example from
weaver-benchmark
. The whole notebook can be found at TopTaggingMLP.