rocm 7.1.1

[durzo]

Just curious, have you tested using rocm 7.1.1 from https://repo.radeon.com/rocm/apt/7.1.1 released a few days ago (Nov 26th) ?

I'm about to clone this repo onto my Proxmox 9.1.1 server and wondering if I should stick with 7.1 or modify the scripts for 7.1.1

https://rocm.docs.amd.com/en/docs-7.1.1/about/release-notes.html

[jammsen]

Just curious, have you tested using rocm 7.1.1 from https://repo.radeon.com/rocm/apt/7.1.1 released a few days ago (Nov 26th) ?

I'm about to clone this repo onto my Proxmox 9.1.1 server and wondering if I should stick with 7.1 or modify the scripts for 7.1.1

https://rocm.docs.amd.com/en/docs-7.1.1/about/release-notes.html

Hey @durzo i have not tested it yet, but this would only be the drivers on the host.

You dont have to adjust the script, the repo thats been added is 7.1, which would be including 7.1.1 too. If you however want to version-pin to 7.1.0 then you would need to adjust things, yes.

I can test this if you want, sure.

But without a never ollama image that supports 7.1.1 too, there is "limited" functionality to test here.

Maybe @phueper will update his image for ollama to 7.1.1 ( https://github.com/phueper/ollama-linux-amd-apu ) and that way we can really test working 7.1.1, not just drivers in a kernel, but an old ROCm implementation in tools like Ollama itself.

[phueper]

fwiw ... i updated my PR to ROCm 7.1.1 ollama/ollama#13000 .. but until yet no update, sry

[jammsen]

fwiw ... i updated my PR to ROCm 7.1.1 ollama/ollama#13000 .. but until yet no update, sry

Hey @phueper - awesome to hear that.
Regarding the PR, yeah, i agree, it feels like they are much more laser-focussed on ollama/ollama#2033 compared to ollama/ollama#13000 - Maybe because AMD is such a small segement and doing vulkan sets the almost equal to lm-studio and also basically covers a basic gpu-path for NV, Intel and AMD?

Did you already release a new image on your address with 7.1.1 too?

[lcotonea]

Hi,
Follow my tests (on debian LXC container):

> >>> Docker version installed:
Docker version 29.1.3, build f52814d
>>> Docker Compose version installed:
Docker Compose version v5.0.0
>>> Containerd version installed:
containerd containerd.io v2.2.1 dea7da592f5d1d2b7755e3a161be07f43fad8f75
>>> Docker installation completed.
>>> Installing Docker bash completion...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  111k  100  111k    0     0  2338k      0 --:--:-- --:--:-- --:--:-- 2378k

==========================================
Installing AMD ROCm Libraries
==========================================

>>> Adding AMD ROCm repository...
--2026-01-01 15:59:26--  https://repo.radeon.com/rocm/rocm.gpg.key
Resolving repo.radeon.com (repo.radeon.com)... 23.73.0.177, 2a02:26f0:6d00:2b::210:1b5d, 2a02:26f0:6d00:2b::210:1b4d
Connecting to repo.radeon.com (repo.radeon.com)|23.73.0.177|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3126 (3.1K) [application/octet-stream]
Saving to: 'STDOUT'

-                                                  100%[=============================================================================================================>]   3.05K  --.-KB/s    in 0s      

2026-01-01 15:59:26 (342 MB/s) - written to stdout [3126/3126]

deb [arch=amd64 signed-by=/etc/apt/keyrings/rocm.gpg] https://repo.radeon.com/rocm/apt/7.1.1 noble main
deb [arch=amd64 signed-by=/etc/apt/keyrings/rocm.gpg] https://repo.radeon.com/graphics/7.1.1/ubuntu noble main
Package: *
Pin: release o=repo.radeon.com
Pin-Priority: 600
Hit:1 http://security.debian.org trixie-security InRelease
Hit:2 http://deb.debian.org/debian trixie InRelease                                                                      
Hit:3 http://deb.debian.org/debian trixie-updates InRelease                                                              
Hit:4 https://download.docker.com/linux/debian trixie InRelease                                                          
Get:5 https://repo.radeon.com/rocm/apt/7.1.1 noble InRelease [2605 B]
Get:6 https://repo.radeon.com/graphics/7.1.1/ubuntu noble InRelease [3194 B]
Get:7 https://repo.radeon.com/rocm/apt/7.1.1 noble/main amd64 Packages [62.8 kB]
Get:8 https://repo.radeon.com/graphics/7.1.1/ubuntu noble/main amd64 Packages [10.3 kB]
Fetched 78.9 kB in 1s (132 kB/s)     
All packages are up to date.    
>>> Installing AMD ROCm libraries...
rocm-libs is already the newest version (7.1.1.70101-38~24.04).
rocm-smi is already the newest version (6.1.2-1).
rocminfo is already the newest version (1.0.0.70101-38~24.04).
rocm-device-libs is already the newest version (1.0.0.70101-38~24.04).
rocm-utils is already the newest version (7.1.1.70101-38~24.04).
Summary:
  Upgrading: 0, Installing: 0, Removing: 0, Not Upgrading: 0
rocm-core is already the newest version (7.1.1.70101-38~24.04).
rocm-dev is already the newest version (7.1.1.70101-38~24.04).
hipcc is already the newest version (1.1.1.70101-38~24.04).
Summary:
  Upgrading: 0, Installing: 0, Removing: 0, Not Upgrading: 0
nvtop is already the newest version (3.2.0-1).
radeontop is already the newest version (1.4-2).
Summary:
  Upgrading: 0, Installing: 0, Removing: 0, Not Upgrading: 0

==========================================
Verifying ROCm LXC installation...
==========================================

/opt/rocm/bin/rocm-smi
/opt/rocm/bin/rocminfo
/usr/bin/nvtop
/usr/bin/radeontop
Agent 1                  
*******                  
  Name:                    AMD Ryzen 7 8745H w/ Radeon 780M Graphics
  Uuid:                    CPU-XX                             
  Marketing Name:          AMD Ryzen 7 8745H w/ Radeon 780M Graphics
  Vendor Name:             CPU                                
--
Agent 2                  
*******                  
  Name:                    gfx1151                            
  Uuid:                    GPU-XX                             
  Marketing Name:          AMD Radeon Graphics                
  Vendor Name:             AMD                                


WARNING: AMD GPU device(s) is/are in a low-power state. Check power control/runtime_status

======================================= ROCm System Management Interface =======================================
============================================ Concise Hardware Info =============================================
GPU  NODE  DID     GUID   GFX VER  GFX RAS  SDMA RAS  UMC RAS  VBIOS               BUS           PARTITION ID  
0    1     0x1900  61695  gfx1103  N/A      N/A       N/A      113-PHXGENERIC-001  0000:C5:00.0  0             
================================================================================================================
============================================= End of ROCm SMI Log ==============================================
=================================== % time GPU is busy ===================================
GPU[0]		: GPU use (%): 0
==========================================================================================
=================================== Current Memory Use ===================================
GPU[0]		: GPU Memory Allocated (VRAM%): 0
GPU[0]		: Memory Activity: N/A
GPU[0]		: Not supported on the given system
==========================================================================================
================================== Memory Usage (Bytes) ==================================
GPU[0]		: VRAM Total Memory (B): 17179869184
GPU[0]		: VRAM Total Used Memory (B): 105476096
GPU[0]		: VIS_VRAM Total Memory (B): 17179869184
GPU[0]		: VIS_VRAM Total Used Memory (B): 105476096
GPU[0]		: GTT Total Memory (B): 42053488640
GPU[0]		: GTT Total Used Memory (B): 14176256
==========================================================================================
====================================== Product Info ======================================
GPU[0]		: Card Series: 		AMD Radeon Graphics
GPU[0]		: Card Model: 		0x1900
GPU[0]		: Card Vendor: 		Advanced Micro Devices, Inc. [AMD/ATI]
GPU[0]		: Card SKU: 		PHXGENERIC
GPU[0]		: Subsystem ID: 	-0x4fea
GPU[0]		: Device Rev: 		0xb3
GPU[0]		: Node ID: 		1
GPU[0]		: GUID: 		61695
GPU[0]		: GFX Version: 		gfx1103
==========================================================================================

==========================================
Testing GPU Access in Docker
==========================================

>>> Verifying AMD ROCm installation with Docker...

Test 1: ROCM Info and SMI test
Image: rocm/rocm:5.4.3-ubuntu22.04 (~1GB)
Command: docker run --rm --name rcom-smi --device /dev/kfd --device /dev/dri -e HSA_OVERRIDE_GFX_VERSION=11.5.1 -e HSA_ENABLE_SDMA=0 --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ipc=host rocm/rocm-terminal bash -c "rocm-smi --showmemuse --showuse --showmeminfo all --showhw --showproductname && rocminfo | grep -i -A5 'Agent [0-9]'"

Run Test 1? This will download ~1GB. [Y/n]: Y
Unable to find image 'rocm/rocm-terminal:latest' locally
latest: Pulling from rocm/rocm-terminal
4f4fb700ef54: Pull complete 
6d3e0ad5399b: Pull complete 
dde23d29fd4b: Pull complete 
30a9c22ae099: Pull complete 
df933558dd3d: Pull complete 
b6457c4e1a2e: Pull complete 
74a6f5c7f5b1: Pull complete 
Digest: sha256:72b323c5d56c511ea75f7353d0fee04e637390dd4874d414020284627a658014
Status: Downloaded newer image for rocm/rocm-terminal:latest


======================================= ROCm System Management Interface =======================================
============================================ Concise Hardware Info =============================================
GPU  NODE  DID     GUID   GFX VER  GFX RAS  SDMA RAS  UMC RAS  VBIOS               BUS           PARTITION ID  
0    1     0x1900  61695  gfx1103  N/A      N/A       N/A      113-PHXGENERIC-001  0000:C5:00.0  0             
================================================================================================================
============================================= End of ROCm SMI Log ==============================================
=================================== % time GPU is busy ===================================
GPU[0]		: GPU use (%): 0
==========================================================================================
=================================== Current Memory Use ===================================
GPU[0]		: GPU Memory Allocated (VRAM%): 0
GPU[0]		: % memory use, Not supported on the given system
GPU[0]		: Memory Activity: N/A
GPU[0]		: Not supported on the given system
==========================================================================================
================================== Memory Usage (Bytes) ==================================
GPU[0]		: VRAM Total Memory (B): 17179869184
GPU[0]		: VRAM Total Used Memory (B): 105476096
GPU[0]		: VIS_VRAM Total Memory (B): 17179869184
GPU[0]		: VIS_VRAM Total Used Memory (B): 105476096
GPU[0]		: GTT Total Memory (B): 42053488640
GPU[0]		: GTT Total Used Memory (B): 14176256
==========================================================================================
====================================== Product Info ======================================
GPU[0]		: Card Series: 		AMD Radeon Graphics
GPU[0]		: Card Model: 		0x1900
GPU[0]		: Card Vendor: 		Advanced Micro Devices, Inc. [AMD/ATI]
GPU[0]		: Card SKU: 		PHXGENERIC
GPU[0]		: Subsystem ID: 	-0x4fea
GPU[0]		: Device Rev: 		0xb3
GPU[0]		: Node ID: 		1
GPU[0]		: GUID: 		61695
GPU[0]		: GFX Version: 		gfx1103
==========================================================================================
Agent 1                  
*******                  
  Name:                    AMD Ryzen 7 8745H w/ Radeon 780M Graphics
  Uuid:                    CPU-XX                             
  Marketing Name:          AMD Ryzen 7 8745H w/ Radeon 780M Graphics
  Vendor Name:             CPU                                
--
Agent 2                  
*******                  
  Name:                    gfx1151                            
  Uuid:                    GPU-XX                             
  Marketing Name:          AMD Radeon Graphics                
  Vendor Name:             AMD                                

✓ Test 1 passed!

==========================================
Installation Complete!
==========================================

Your LXC container is now ready to use AMD GPUs in Docker containers.

According to rocminfo information, my card is see as gfx1103.
But when I tried to launch ollama with docker run -d --device /dev/kfd --device /dev/dri -e HSA_OVERRIDE_GFX_VERSION=11.0.3 -p 11434:11434 --name ollama ollama/ollama:rocm ollama crashed.

Even after updating ROCM to version 7.1.1 (host + LXC container), I still have to run OLLAMA via docker run -d --device /dev/kfd --device /dev/dri -e HSA_OVERRIDE_GFX_VERSION=11.0.2 -p 11434:11434 --name ollama ollama/ollama:rocm

Until the PR of @phueper ollama/ollama#13000, the update of ROCM to version 7.1.1 can be done via this PR #4

[phueper]

I would love to get the rocmv7 PR merged into ollama, and believe it is ready for quite some time but honestly don't know how to push it into being considered... I asked few times but no reaction from the maintainers ... I also tried in discord but didn't get any reaction there either... For now I'll just try to keep it up to date 🤷🏼

[jammsen]

Even after updating ROCM to version 7.1.1 (host + LXC container), I still have to run OLLAMA via docker run -d --device /dev/kfd --device /dev/dri -e HSA_OVERRIDE_GFX_VERSION=11.0.2 -p 11434:11434 --name ollama ollama/ollama:rocm

@lcotonea Well thats because your Host and LXC know 7.1.1 ROCM but the ollama Image you use is maybe even less den 6.3.X just use the image of @phueper - Then you can use the latest.

fwiw ... i updated my PR to ROCm 7.1.1 ollama/ollama#13000 .. but until yet no update, sry

@phueper did you also release an interim 7.1.1 image in the meantime? I asked a few times for this. You just wrote you did update the PR but not if you released a new image on your end for usage right now.

[phueper]

@jammsen no i didnt, and i dont want to tbh ... there are enough different images flying around already :) ... but you can use rjmalaggon image https://github.com/rjmalagon/ollama-linux-amd-apu he regularly releases an image and tracks ollama upstream and also contains my patches for ROCm 7.1.1

[jammsen]

@jammsen no i didnt, and i dont want to tbh ... there are enough different images flying around already :) ... but you can use rjmalaggon image https://github.com/rjmalagon/ollama-linux-amd-apu he regularly releases an image and tracks ollama upstream and also contains my patches for ROCm 7.1.1

Thy!