Tags:
create new tag
view all tags

Preparing the PC for Tensorflow

Setting up a virtual Python environment

The procedure is described in https://www.freecodecamp.org/news/virtualenv-with-virtualenvwrapper-on-ubuntu-18-04.

Once his is done you can create a new virtual environment with:

mkvirtualenv name_of_env (e.g. mkvirtualenv AI)

switch to a virtual environment with the "workon" command:

e.g. workon AI

The virtual environment used to build ML models should include

and maybe a few others.

Setting up the GPU

When trying my first simple TensorFlow program I saw this warning:

libcudart.png

My PC, being a "gaming machine", uses an nVIDIA GeForce GTX 950M graphics card whose GPU (Graphics Processing Unit) can be used by TensorFlow to speed up number crunching.

nvidia.png

When looking at the Software & Updates program we see that the nvidia-driver-535 is used to control the NVidia GeForce GTX 950 module. Make sure that the nouveau driver is disabled!

displayDriver.png

TensorFlow relies on the cuda toolkit and on the NVidia display driver. Even after installing the newest version of cuda, TensorFlow did not see the GPU. An intensive search with Google finally showed that (at the moment of writing this page) TensorFlow version 2 only works with cuda 11.8 and cuDNN 8.6.

https://medium.com/@juancrrn/installing-cuda-and-cudnn-in-ubuntu-20-04-for-deep-learning-dad8841714d6 and https://gist.github.com/MihailCosmin/affa6b1b71b43787e9228c25fe15aeba decribe how to install cuda-11.8 and cudnn-8.6 and how to test the installation.

The script testGPU.py below shows the number of GPUs that TensorFlow has fouind:   #!/home/uli/.virtualenvs/AI/bin/python
import tensorflow as tf
print("Num GPUs Available: ", len(tf.config.list_physical_devices('GPU')))

After installation of cuda-11.8 and cuDNN-8.6 this is what I get, when I run the script:

GPU_warnings.png

To get rid of these warnings I first had to install tensorrt from the NVidia WEB site.

To irradicate the NUMA mode warning I followed:

https://askubuntu.com/questions/1379119/how-to-set-the-numa-node-for-an-nvidia-gpu-persistently

When running the testGPU program now, things seem to be ok and I should be able to use my NVidia GPU.

GPU_ok.png

-- Uli Raich - 2022-01-31

Comments


Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng GPU_ok.png r1 manage 40.3 K 2023-09-21 - 19:12 UliRaich  
PNGpng GPU_warnings.png r1 manage 115.3 K 2023-09-21 - 18:26 UliRaich  
PNGpng cuda_download.png r1 manage 51.4 K 2022-01-31 - 10:56 UliRaich  
PNGpng displayDriver.png r1 manage 102.3 K 2023-09-21 - 17:59 UliRaich  
PNGpng driver_used.png r1 manage 74.9 K 2022-01-31 - 10:56 UliRaich  
PNGpng gpu_good.png r1 manage 45.9 K 2022-01-31 - 10:56 UliRaich  
PNGpng graphicsCard.png r1 manage 38.3 K 2022-01-31 - 11:01 UliRaich  
PNGpng libcudart.png r1 manage 37.0 K 2022-01-31 - 11:01 UliRaich  
PNGpng nvidia.png r1 manage 12.7 K 2022-01-31 - 10:56 UliRaich  
Edit | Attach | Watch | Print version | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r5 - 2023-10-17 - UliRaich
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback