サーバープロファイル

IBM CloudのVSI for VPC環境における、gx3d-24x120x1a100pというNVIDIA A100が１台搭載されている環境を利用

環境の確認とNVIDIA Driverのインストール

インストール手順はこちらを参考にしました。

モジュールの最新化

[root@syasuda-ollama ~]# dnf -y update
[root@syasuda-ollama ~]# reboot

環境の確認

[root@syasuda-ollama ~]# cat /etc/redhat-release
Red Hat Enterprise Linux release 9.6 (Plow)

[root@syasuda-ollama ~]# uname -a
Linux syasuda-ollama 5.14.0-570.37.1.el9_6.x86_64 #1 SMP PREEMPT_DYNAMIC Sat Aug 16 01:10:00 EDT 2025 x86_64 x86_64 x86_64 GNU/Linux

[root@syasuda-ollama ~]# hostnamectl
 Static hostname: syasuda-ollama
       Icon name: computer-vm
         Chassis: vm 🖴
      Machine ID: 09f2d8a3f371b99ff6e334c58749ec98
         Boot ID: 4032088c354a49efb3481bd2e061d564
  Virtualization: kvm
Operating System: Red Hat Enterprise Linux 9.6 (Plow)
     CPE OS Name: cpe:/o:redhat:enterprise_linux:9::baseos
          Kernel: Linux 5.14.0-570.37.1.el9_6.x86_64
    Architecture: x86-64
 Hardware Vendor: QEMU
  Hardware Model: Standard PC _i440FX + PIIX, 1996_
Firmware Version: 1.15.0-1

[root@syasuda-ollama ~]# lspci | grep -e VGA -e NVIDIA
00:02.0 VGA compatible controller: Cirrus Logic GD 5446
04:01.0 3D controller: NVIDIA Corporation GA100 [A100 PCIe 80GB] (rev a1)

現行のrepositoryの確認

[root@syasuda-ollama ~]# yum repolist all
Updating Subscription Management repositories.

This system has release set to 9.6 and it receives updates only for this release.

repo id                                                                      repo name                                                                                                              status
codeready-builder-for-rhel-9-x86_64-eus-rpms                                 Red Hat CodeReady Linux Builder for RHEL 9 x86_64 - Extended Update Support (RPMs)                                     disabled
codeready-builder-for-rhel-9-x86_64-rpms                                     Red Hat CodeReady Linux Builder for RHEL 9 x86_64 (RPMs)                                                               disabled
rhel-9-for-x86_64-appstream-eus-rpms                                         Red Hat Enterprise Linux 9 for x86_64 - AppStream - Extended Update Support (RPMs)                                     enabled
rhel-9-for-x86_64-appstream-rpms                                             Red Hat Enterprise Linux 9 for x86_64 - AppStream (RPMs)                                                               enabled
rhel-9-for-x86_64-baseos-eus-rpms                                            Red Hat Enterprise Linux 9 for x86_64 - BaseOS - Extended Update Support (RPMs)                                        enabled
rhel-9-for-x86_64-baseos-rpms                                                Red Hat Enterprise Linux 9 for x86_64 - BaseOS (RPMs)                                                                  enabled
rhel-9-for-x86_64-supplementary-eus-rpms                                     Red Hat Enterprise Linux 9 for x86_64 - Supplementary - Extended Update Support (RPMs)                                 enabled
rhel-9-for-x86_64-supplementary-rpms                                         Red Hat Enterprise Linux 9 for x86_64 - Supplementary (RPMs)                                                           enabled

repositoryの追加設定

[root@syasuda-ollama ~]# export distro=rhel9
[root@syasuda-ollama ~]# export arch=x86_64


[root@syasuda-ollama ~]# subscription-manager repos --enable=rhel-9-for-$arch-appstream-rpms
[root@syasuda-ollama ~]# subscription-manager repos --enable=rhel-9-for-$arch-baseos-rpms
[root@syasuda-ollama ~]# subscription-manager repos --enable=codeready-builder-for-rhel-9-$arch-rpms
[root@syasuda-ollama ~]# dnf install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-9.noarch.rpm
[root@syasuda-ollama ~]# dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/$distro/$arch/cuda-$distro.repo
[root@syasuda-ollama ~]# dnf clean expire-cache


[root@syasuda-ollama ~]# yum repolist all
Updating Subscription Management repositories.

This system has release set to 9.6 and it receives updates only for this release.

repo id                                                                      repo name                                                                                                              status
codeready-builder-for-rhel-9-x86_64-eus-rpms                                 Red Hat CodeReady Linux Builder for RHEL 9 x86_64 - Extended Update Support (RPMs)                                     disabled
codeready-builder-for-rhel-9-x86_64-rpms                                     Red Hat CodeReady Linux Builder for RHEL 9 x86_64 (RPMs)                                                               enabled
cuda-rhel9-x86_64                                                            cuda-rhel9-x86_64                                                                                                      enabled
epel                                                                         Extra Packages for Enterprise Linux 9 - x86_64                                                                         enabled
epel-cisco-openh264                                                          Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - x86_64                                                   enabled
epel-cisco-openh264-debuginfo                                                Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - x86_64 - Debug                                           disabled
epel-cisco-openh264-source                                                   Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - x86_64 - Source                                          disabled
epel-debuginfo                                                               Extra Packages for Enterprise Linux 9 - x86_64 - Debug                                                                 disabled
epel-source                                                                  Extra Packages for Enterprise Linux 9 - x86_64 - Source                                                                disabled
epel-testing                                                                 Extra Packages for Enterprise Linux 9 - Testing - x86_64                                                               disabled
epel-testing-debuginfo                                                       Extra Packages for Enterprise Linux 9 - Testing - x86_64 - Debug                                                       disabled
epel-testing-source                                                          Extra Packages for Enterprise Linux 9 - Testing - x86_64 - Source                                                      disabled
rhel-9-for-x86_64-appstream-eus-rpms                                         Red Hat Enterprise Linux 9 for x86_64 - AppStream - Extended Update Support (RPMs)                                     enabled
rhel-9-for-x86_64-appstream-rpms                                             Red Hat Enterprise Linux 9 for x86_64 - AppStream (RPMs)                                                               enabled
rhel-9-for-x86_64-baseos-eus-rpms                                            Red Hat Enterprise Linux 9 for x86_64 - BaseOS - Extended Update Support (RPMs)                                        enabled
rhel-9-for-x86_64-baseos-rpms                                                Red Hat Enterprise Linux 9 for x86_64 - BaseOS (RPMs)                                                                  enabled
rhel-9-for-x86_64-supplementary-eus-rpms                                     Red Hat Enterprise Linux 9 for x86_64 - Supplementary - Extended Update Support (RPMs)                                 enabled
rhel-9-for-x86_64-supplementary-rpms                                         Red Hat Enterprise Linux 9 for x86_64 - Supplementary (RPMs)                                                           enabled

Driverのインストール

[root@syasuda-ollama ~]# dnf -y module install nvidia-driver:latest-dkms

CUDA Toolkitのインストール

[root@syasuda-ollama ~]# dnf -y install cuda-toolkit

.bashrcに以下の環境変数を設定

export PATH=/usr/local/cuda-13.0/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-13.0/lib ${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

再起動

[root@syasuda-ollama ~]# reboot

GPUの確認。NVIDIA A100 80GB PCIeが認識されている。Driverインストールするだけでもこのコマンドは実行可能。

[root@syasuda-ollama ~]# nvidia-smi
Wed Aug 27 00:05:31 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.65.06              Driver Version: 580.65.06      CUDA Version: 13.0     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA A100 80GB PCIe          Off |   00000000:04:01.0 Off |                    0 |
| N/A   42C    P0             48W /  300W |       0MiB /  81920MiB |      0%      Default |
|                                         |                        |             Disabled |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

nvcc（コンパイラー）はCUDA Toolkitをインストールすることで利用可能。

[root@syasuda-ollama ~]# which nvcc
/usr/local/cuda-13.0/bin/nvcc

[root@syasuda-ollama ~]# nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Wed_Aug_20_01:58:59_PM_PDT_2025
Cuda compilation tools, release 13.0, V13.0.88
Build cuda_13.0.r13.0/compiler.36424714_0

モニタリング目的で、nvtopもインストールしておく

[root@syasuda-ollama ~]# dnf install -y nvtop

nvtopの実行例