Setting up Knet

Setting up Knet

Knet.jl is a deep learning package implemented in Julia, so you should be able to run it on any machine that can run Julia. It has been extensively tested on Linux machines with NVIDIA GPUs and CUDA libraries, and it has been reported to work on OSX and Windows. If you would like to try it on your own computer, please follow the instructions on Installation. If you would like to try working with a GPU and do not have access to one, take a look at Using Amazon AWS. If you find a bug, please open a GitHub issue. If you would like to contribute to Knet, see Tips for developers. If you need help, or would like to request a feature, please use the knet-users mailing list.

Installation

For best results install (1) Julia, (2) a host compiler, (3) GPU support, and (4) Knet in that order. Step (2) can be skipped if you do not need convolutions or gpu support. Step (3) can be skipped if you do not have a GPU. An optional step (5) below describes how to interact with the Knet tutorial notebooks.

  1. Julia: Download and install the latest version of Julia from julialang.org. As of this writing the latest version is 1.1.1 and I have tested Knet using 64-bit Generic Linux binaries, the macOS package (10.8+ 64-bit dmg), and 64-bit Windows Self Extracting Archive (exe).

    (optional) Knet uses the CUDAapi library for discovery. Start Julia and run using Pkg; Pkg.add("CUDAapi") so we can test the next steps.

  2. Host compiler: On Linux, the gcc compiler that comes standard with all distributions is supported. On Mac you need to install Xcode which provides the clang compiler. On Windows you need the Visual C++ compiler which comes with Visual Studio or Build Tools. I have tested on Windows 10 with Build Tools for Visual Studio 2019 (67MB). On the setup screen I added "C++ build tools" (1.15GB) and rebooted the machine for settings to take effect. If you don't have a compiler, Knet will still work but will not support convolutions or GPU.

    (optional) start Julia and run using CUDAapi; find_host_compiler() to make sure the host compiler is detected.

  3. GPU support: If your machine has an NVIDIA GPU, Knet will automatically discover it and compile support code if you have the required host compiler (step 2), driver (400MB), toolkit (2.5GB) and cuDNN library (254MB) installed. cuDNN usually comes in a zip file – after unzipping you may need to copy its files to the CUDA installation directory.

    (optional) Once you install the gpu components, start Julia and run using CUDAapi; tk=find_toolkit() to make sure the CUDA Toolkit is detected and find_cuda_library("cudart",tk) and find_cuda_library("cudnn",tk) to make sure the libraries can be found.

  4. Knet: to install Knet start Julia and run using Pkg; Pkg.add("Knet").

    (optional) If you have a gpu, you can make sure Knet is set up properly with using Knet; include(Knet.dir("test/gpu.jl")). You can also run using Pkg; Pkg.test("Knet") for a more comprehensive set of tests that takes about 10 minutes.

  5. Tutorial: The best way to learn Knet is through the included Jupyter notebooks. You need the IJulia package to run the notebooks which can be installed with: using Pkg; Pkg.add("IJulia"). You can then interact with the tutorial notebooks with: using IJulia, Knet; notebook(dir=Knet.dir("tutorial")). This should open a browser with a list of tutorial notebooks. If you have not used Jupyter before, please take a look at Jupyter notebook tutorials online. Note that the first time notebook() is run, there may be a long startup time for installations.

Installation problems

Sometimes when Knet or CUDA libraries are updated or moved, the precompiled binaries get out of sync and you may get errors like:

ccall: could not find function xxx in library libknet8.so

I recommend the following steps to refresh everything:

shell> rm ~/.julia/compiled/v1.1/Knet/*.ji
shell> cd ~/.julia/packages/Knet/*/deps
shell> make clean
shell> julia
julia> using Pkg; Pkg.build("Knet")

This refreshes all precompiled binaries and should typically solve the problem. If problems continue, you can get support from knet-users.

Tips for developers

Knet is an open-source project and we are always open to new contributions: bug fixes, new machine learning models and operators, inspiring examples, benchmarking results are all welcome. If you'd like to contribute to the code base, please sign up at the knet-dev mailing list and follow these tips:

Using Amazon AWS

If you don't have access to a GPU machine, but would like to experiment with one, Amazon Web Services is a possible solution. I have prepared a machine image (AMI) with everything you need to run Knet. Here are step by step instructions for launching a GPU instance with a Knet image (the screens may have changed slightly since this writing):

1. First, you need to sign up and create an account following the instructions on Setting Up with Amazon EC2. Once you have an account, open the Amazon EC2 console and login. You should see the following screen:

image

2. Make sure you select the "Ohio" region in the upper right corner, then click on AMIs on the lower left menu. At the search box, choose "Public images" and search for "Knet". Click on the latest Knet image (Knet-1.0.0 as of this writing). You should see the following screen with information about the Knet AMI. Click on the "Launch" button on the upper left.

image

Note: Instead of "Launch", you may want to experiment with "Spot Request" under "Actions" to get a lower price. You may also qualify for an educational grant if you are a student or researcher.

3. You should see the "Step 2: Choose an Instance Type" page. Pick one of the GPU instances (I have tested with the g2 series and the p2 series). Click on "Review and Launch".

image

4. This should take you to the "Step 7: Review Instance Launch" page. You can just click "Launch" here:

image

5. You should see the "key pair" pop up menu. In order to login to your instance, you need an ssh key pair. If you have created a pair during the initial setup you can use it with "Choose an existing key pair". Otherwise pick "Create a new key pair" from the pull down menu, enter a name for it, and click "Download Key Pair". Make sure you keep the downloaded file, we will use it to login. After making sure you have the key file (it has a .pem extension), click "Launch Instances" on the lower right.

image

6. We have completed the request. You should see the "Launch Status" page. Click on your instance id under "Your instances are launching":

image

7. You should be taken to the "Instances" screen and see the address of your instance where it says something like "Public DNS: ec2-54-153-5-184.us-west-1.compute.amazonaws.com".

image

8. Open up a terminal (or Putty if you are on Windows) and type:

    ssh -i knetkey.pem ec2-user@ec2-54-153-5-184.us-west-1.compute.amazonaws.com

Replacing knetkey.pem with the path to your key file and ec2-54-153-5-184 with the address of your machine. If all goes well you should get a shell prompt on your machine instance.

9. There you can type julia, and at the julia prompt using Pkg, Pkg.update() and Pkg.build("Knet") to get the latest versions of the packages, as the versions in the AMI may be out of date:

[ec2-user@ip-172-31-24-60 deps]$ julia
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.0.0 (2018-08-08)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> using Pkg
julia> Pkg.update()
julia> Pkg.build("Knet")

Finally you can run Pkg.test("Knet") to make sure all is good. This should take about 10-15 minutes. If all tests pass, you are ready to work with Knet:

julia> Pkg.test("Knet")
INFO: Testing Knet
...
INFO: Knet tests passed

julia>