PreparingThePC < IoT_Course

Tags: view all tags

---+ Preparing the PC for Tensorflow
---++ Setting up a virtual Python environment

The procedure is described in <a href="https://www.freecodecamp.org/news/virtualenv-with-virtualenvwrapper-on-ubuntu-18-04/" target="_blank">https://www.freecodecamp.org/news/virtualenv-with-virtualenvwrapper-on-ubuntu-18-04.<img alt="" border="0" height="12" src="http://localhost/pub/TWiki/TWikiDocGraphics/external-link.gif" width="13" /></a>

Once his is done you can create a new virtual environment with:

mkvirtualenv name_of_env (e.g. mkvirtualenv AI)

switch to a virtual environment with the "<i>workon"</i> command:

e.g. workon AI

The virtual environment used to build ML models should include
   * [[https://numpy.org/doc/][numpy]]
   * [[https://docs.scipy.org/doc/scipy/reference/][scipy]]
   * [[https://pandas.pydata.org/pandas-docs/stable/][pandas]]
   * [[https://matplotlib.org/stable/index.html][matplotlib]]
   * [[https://seaborn.pydata.org/][seaborn]]
   * [[https://www.tensorflow.org/api_docs/][tensorflow]]
   * [[https://scikit-learn.org/stable/user_guide.html][sklearn]]
   * [[https://pillow.readthedocs.io/en/stable/][pillow]]
   * [[https://docs.python.org/3/library/wave.html][wave]]
and maybe a few others.

---++ Setting up the GPU

When trying my first simple !TensorFlow program I saw this warning:

<img alt="libcudart.png" height="95" src="%ATTACHURL%/libcudart.png" title="libcudart.png" width="1014" />

My PC, being a "gaming machine", uses an nVIDIA !GeForce GTX 950M graphics card whose GPU (Graphics Processing Unit) can be used by !TensorFlow to speed up number crunching.

<img alt="nvidia.png" height="42" src="%ATTACHURL%/nvidia.png" title="nvidia.png" width="708" />

When looking at the Software & Updates program we see that the nvidia-driver-535 is used to control the !NVidia !GeForce GTX 950 module. Make sure that the nouveau driver is disabled!

<img alt="displayDriver.png" height="584" src="%ATTACHURL%/displayDriver.png" title="displayDriver.png" width="977" />

!TensorFlow relies on the <a href="https://developer.nvidia.com/cuda-toolkit" target="_blank">cuda toolkit<img alt="" border="0" height="12" src="http://localhost/pub/TWiki/TWikiDocGraphics/external-link.gif" width="13" /></a> and on the NVidia display driver. Even after installing the newest version of cuda, !TensorFlow did not see the GPU. An intensive search with Google finally showed that (at the moment of writing this page) !TensorFlow version 2 only works with cuda 11.8 and cuDNN 8.6.

https://medium.com/@juancrrn/installing-cuda-and-cudnn-in-ubuntu-20-04-for-deep-learning-dad8841714d6 and https://gist.github.com/MihailCosmin/affa6b1b71b43787e9228c25fe15aeba decribe how to install cuda-11.8 and cudnn-8.6 and how to test the installation.

The script testGPU.py below shows the number of GPUs that !TensorFlow has fouind:
<literal>&nbsp; #!/home/uli/.virtualenvs/AI/bin/python<br />import tensorflow as tf<br />print("Num GPUs Available: ", len(tf.config.list_physical_devices('GPU')))</literal>

After installation of cuda-11.8 and cuDNN-8.6 this is what I get, when I run the script:

<img alt="GPU_warnings.png" height="294" src="%ATTACHURL%/GPU_warnings.png" title="GPU_warnings.png" width="1294" />

To get rid of these warnings I first had to install tensorrt from the [[https://docs.nvidia.com/deeplearning/tensorrt/install-guide/index.html#downloading][NVidia WEB site]].

To irradicate the NUMA mode warning I followed:

https://askubuntu.com/questions/1379119/how-to-set-the-numa-node-for-an-nvidia-gpu-persistently

When running the testGPU program now, things seem to be ok and I should be able to use my !NVidia GPU.

<img alt="GPU_ok.png" height="118" src="%ATTACHURL%/GPU_ok.png" title="GPU_ok.png" width="1294" />

-- %USERSIG{UliRaich - 2022-01-31}%

---++ Comments

<br />%COMMENT%

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who
png	GPU_ok.png	r1	manage	40.3 K	2023-09-21 - 19:12	UliRaich
png	GPU_warnings.png	r1	manage	115.3 K	2023-09-21 - 18:26	UliRaich
png	cuda_download.png	r1	manage	51.4 K	2022-01-31 - 10:56	UliRaich
png	displayDriver.png	r1	manage	102.3 K	2023-09-21 - 17:59	UliRaich
png	driver_used.png	r1	manage	74.9 K	2022-01-31 - 10:56	UliRaich
png	gpu_good.png	r1	manage	45.9 K	2022-01-31 - 10:56	UliRaich
png	graphicsCard.png	r1	manage	38.3 K	2022-01-31 - 11:01	UliRaich
png	libcudart.png	r1	manage	37.0 K	2022-01-31 - 11:01	UliRaich
png	nvidia.png	r1	manage	12.7 K	2022-01-31 - 10:56	UliRaich

Topic revision: r5 - 2023-10-17 - UliRaich