Transformers on GPU AMD Radeon in Docker

Basic configuration of the docker container hardandheavy/llama-rocm for working with llama models on GPU from Radeon. Based on transformers-rocm-docker.

Requirements

• Ubuntu
• make
• Docker
• ROCm (see the installation in transformers-rocm-docker)

Testing

Tested on AMD Radeon RX 7900 XTX.

make bash
make test