Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Issue]: migraphx-driver fails to compile a Yolov8n model #3760

Open
nlbutts opened this issue Jan 12, 2025 · 4 comments
Open

[Issue]: migraphx-driver fails to compile a Yolov8n model #3760

nlbutts opened this issue Jan 12, 2025 · 4 comments
Assignees
@aarushjain29
Labels
Under Investigation

Comments

@nlbutts
Copy link

nlbutts commented Jan 12, 2025

Problem Description

I do the following:

virtualenv -p python3 venv
. ./venv/bin/activate
pip install -U pip
pip install ultralytics
yolo export model=yolov8n.pt format=onnx

In a different window (without the virtualenv) I run:

nlbutts@AMDDesktop:~/projects/reefscape_ai$ /opt/rocm/bin/migraphx-driver compile -o test.mxr yolov8n.onnx
Running [ MIGraphX Version: 2.10.0.379310e4 ]: /opt/rocm/bin/migraphx-driver compile -o test.mxr yolov8n.onnx
Compiling ... 
Reading: yolov8n.onnx
terminate called after throwing an instance of 'migraphx::version_2_10_0::exception'
  what():  /long_pathname_so_that_rpms_can_package_the_debug_info/src/extlibs/AMDMIGraphX/src/targets/gpu/mlir.cpp:728: run_high_level_pipeline: Invalid MLIR created: Error: num_cu=30 : i64 cannot be lower than arch minNumCU=48
Note: see current operation: %7 = "tosa.conv2d"(%1, %2, %0) <{dilation = array<i64: 1, 1>, group = 1 : i64, pad = array<i64: 0, 0, 0, 0>, stride = array<i64: 1, 1>}> {filter_layout = "kcyx", input_layout = "nhcw", output_layout = "nhkw"} : (tensor<1x4x16x8400xf32>, tensor<1x16x1x1xf32>, tensor<1xf32>) -> tensor<1x4x1x8400xf32>
Error: Disjointed yx or hw!
Note: see current operation: %7 = "rock.conv"(%5, %4, %6) <{arch = "gfx1100", dilations = [1 : index, 1 : index], features = #rock<GemmFeatures dot|atomic_add|atomic_fmax_f32>, padding = [0 : index, 0 : index, 0 : index, 0 : index], strides = [1 : index, 1 : index]}> {filter_layout = ["g", "k", "c", "y", "x"], input_layout = ["ni", "hi", "gi", "ci", "wi"], output_layout = ["no", "ho", "go", "ko", "wo"]} : (tensor<1x1x16x1x1xf32>, tensor<1x4x1x16x8400xf32>, tensor<1x4x1x1x8400xf32>) -> tensor<1x4x1x1x8400xf32>

Aborted (core dumped)

MIGraphx core dumps.

This was after a fresh update following these instructions:
https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native_linux/install-radeon.html

nlbutts@AMDDesktop:~/projects/reefscape_ai$ echo "OS:" && cat /etc/os-release | grep -E "^(NAME=|VERSION=)";
echo "CPU: " && cat /proc/cpuinfo | grep "model name" | sort --unique;
echo "GPU:" && /opt/rocm/bin/rocminfo | grep -E "^\s*(Name|Marketing Name)";
OS:
NAME="Ubuntu"
VERSION="22.04.5 LTS (Jammy Jellyfish)"
CPU: 
model name	: AMD Ryzen 7 5800X3D 8-Core Processor
GPU:
  Name:                    AMD Ryzen 7 5800X3D 8-Core Processor
  Marketing Name:          AMD Ryzen 7 5800X3D 8-Core Processor
  Name:                    gfx1100                            
  Marketing Name:          AMD Radeon RX 7800 XT              
      Name:                    amdgcn-amd-amdhsa--gfx1100

Ubuntu version:

DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=22.04
DISTRIB_CODENAME=jammy
DISTRIB_DESCRIPTION="Ubuntu 22.04.5 LTS"
PRETTY_NAME="Ubuntu 22.04.5 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.5 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy

Operating System

Ubuntu Jammy Jellyfish

CPU

Ryzen 5800X3D

GPU

Other

Other

RX 7800 XT

ROCm Version

ROCm 6.0.0

Steps to Reproduce

See above.

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

rocminfo.txt

Additional Information

No response
@lucbruni-amd
Copy link

Hi @nlbutts, an internal ticket has been opened regarding this issue and it is being investigated. Thank you!

@lucbruni-amd
Copy link

lucbruni-amd commented Jan 15, 2025 •
edited
Loading

Hi @nlbutts, thank you for your patience. I have some developments for your issue.

I can see from the steps you linked here, an older ROCm version is documented. I actually reproduced your issue on my Ubuntu 24.04.1 LTS (Noble Numbat) system with a RX 7900 XT GPU and your ROCm version to ensure it was not specific to your environment and likely related to ROCm code, which it is.

Could you try upgrading to the latest ROCm version, 6.3.1 (at the time of writing)? After I upgraded, I no longer hit your issue and did make it further, but I hit the following issue:

$ /opt/rocm/bin/migraphx-driver compile -o test.mxr yolov8n.onnx
Running [ MIGraphX Version: 2.12.0. ]: /opt/rocm/bin/migraphx-driver compile -o test.mxr yolov8n.onnx
Compiling ...
Reading: yolov8n.onnx
terminate called after throwing an instance of 'migraphx::version_2_12_0::exception'
  what():  /code/AMDMIGraphX/src/targets/gpu/mlir.cpp:765: run_high_level_pipeline: Invalid MLIR created: Error: Disjointed yx or hw!
Note: see current operation: %7 = "rock.conv"(%5, %4, %6) <{arch = "gfx1101", dilations = [1 : index, 1 : index], features = #rock<GemmFeatures dot|atomic_add|atomic_fmax_f32>, numCU = 24 : i32, padding = [0 : index, 0 : index, 0 : index, 0 : index], strides = [1 : index, 1 : index]}> {filter_layout = ["g", "k", "c", "y", "x"], input_layout = ["ni", "hi", "gi", "ci", "wi"], output_layout = ["no", "ho", "go", "ko", "wo"]} : (tensor<1x1x16x1x1xf32>, tensor<1x4x1x16x8400xf32>, tensor<1x4x1x1x8400xf32>) -> tensor<1x4x1x1x8400xf32>

I can see there's an open PR #3729 that addresses this. I have tested this on the same setup and both issues appear to be resolved, and I was able to subsequently generate a performance report with migraphx-driver perf. If you are building from source, I recommend you give this a try on the latest ROCm version. Do note that this change has not yet been merged into the develop branch, so assume it is not risk-free as it has not been completely vetted. Let me know if you have any problems with this. Thanks!

@lucbruni-amd lucbruni-amd linked a pull request Jan 15, 2025 that will close this issue
Layout convolution as NHWC or NCHW only #3729
Open
@lucbruni-amd lucbruni-amd removed a link to a pull request Jan 15, 2025
Layout convolution as NHWC or NCHW only #3729
Open
@nlbutts
Copy link
Author

nlbutts commented Jan 16, 2025 •
edited
Loading

I followed these instructions to fully remove amdgpu-install and all extra software.
https://amdgpu-install.readthedocs.io/en/latest/install-script.html
and these instructions to re-install
https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/amdgpu-install.html

nlbutts@AMDDesktop:~$ amdgpu-uninstall 
[sudo] password for nlbutts: 
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were automatically installed and are no longer required:
  dctrl-tools dkms icu-devtools libatomic1:i386 libavcodec-dev libavformat-dev libavutil-dev libbsd0:i386 libdrm-amdgpu1:i386
  libdrm-dev libdrm-intel1:i386 libdrm-nouveau2:i386 libdrm-radeon1:i386 libdrm2:i386 libedit2:i386 libegl-mesa0:i386 libegl1:i386
  libelf-dev libelf1:i386 libexpat1:i386 libffi-dev libfile-copy-recursive-perl libfile-which-perl libgbm1:i386 libgl-dev libgl1:i386
  libgl1-mesa-dri:i386 libglapi-mesa:i386 libglvnd0:i386 libglx-dev libglx-mesa0:i386 libglx0:i386 libicu-dev libicu70:i386
  libllvm15:i386 libmd0:i386 libncurses5 libnuma-dev libomxil-bellagio-bin libomxil-bellagio0 libpciaccess-dev libpciaccess0:i386
  libsensors5:i386 libset-scalar-perl libstdc++-12-dev libstdc++6:i386 libswresample-dev libswscale-dev libsystemd-dev libtinfo5
  libva-dev libva-glx2 libvdpau1:i386 libwayland-bin libwayland-dev libx11-6:i386 libx11-xcb1:i386 libxau6:i386 libxcb-dri2-0:i386
  libxcb-dri3-0:i386 libxcb-glx0:i386 libxcb-present0:i386 libxcb-randr0:i386 libxcb-shm0:i386 libxcb-sync1:i386 libxcb-xfixes0:i386
  libxcb1:i386 libxdmcp6:i386 libxext6:i386 libxfixes3:i386 libxml2:i386 libxml2-dev libxshmfence1:i386 libxxf86vm1:i386
  mesa-common-dev mesa-vdpau-drivers:i386 pkg-config python3-argcomplete valgrind vdpau-driver-all:i386
Use 'sudo apt autoremove' to remove them.
The following packages will be REMOVED:
  amd-smi-lib* amdgpu-core* amdgpu-dkms* amdgpu-dkms-firmware* amdgpu-lib* amdgpu-lib32* comgr* composablekernel-dev* gst-omx-amdgpu*
  half* hip-dev* hip-doc* hip-runtime-amd* hip-samples* hipblas* hipblas-dev* hipblaslt* hipblaslt-dev* hipcc* hipcub-dev* hipfft*
  hipfft-dev* hipfort-dev* hipify-clang* hiprand* hiprand-dev* hipsolver* hipsolver-dev* hipsparse* hipsparse-dev* hipsparselt*
  hipsparselt-dev* hiptensor* hiptensor-dev* hsa-amd-aqlprofile* hsa-rocr* hsa-rocr-dev* hsakmt-roct-dev* libdrm-amdgpu-amdgpu1*
  libdrm-amdgpu-amdgpu1:i386* libdrm-amdgpu-common* libdrm-amdgpu-dev* libdrm-amdgpu-radeon1* libdrm-amdgpu-radeon1:i386*
  libdrm2-amdgpu* libdrm2-amdgpu:i386* libegl1-amdgpu-mesa* libegl1-amdgpu-mesa:i386* libegl1-amdgpu-mesa-drivers*
  libegl1-amdgpu-mesa-drivers:i386* libgbm1-amdgpu* libgbm1-amdgpu:i386* libgl1-amdgpu-mesa-dri* libgl1-amdgpu-mesa-dri:i386*
  libgl1-amdgpu-mesa-glx* libgl1-amdgpu-mesa-glx:i386* libglapi-amdgpu-mesa* libglapi-amdgpu-mesa:i386* libllvm17.0-amdgpu*
  libllvm17.0-amdgpu:i386* libllvm18.1-amdgpu* libllvm18.1-amdgpu:i386* libva-amdgpu-drm2* libva-amdgpu-drm2:i386* libva-amdgpu-glx2*
  libva-amdgpu-glx2:i386* libva-amdgpu-wayland2* libva-amdgpu-wayland2:i386* libva-amdgpu-x11-2* libva-amdgpu-x11-2:i386*
  libva2-amdgpu* libva2-amdgpu:i386* libwayland-amdgpu-client0* libwayland-amdgpu-client0:i386* libwayland-amdgpu-egl1:i386*
  libwayland-amdgpu-server0* libwayland-amdgpu-server0:i386* libxatracker2-amdgpu* libxatracker2-amdgpu:i386* mesa-amdgpu-omx-drivers*
  mesa-amdgpu-va-drivers* mesa-amdgpu-va-drivers:i386* mesa-amdgpu-vdpau-drivers* mesa-amdgpu-vdpau-drivers:i386* migraphx*
  migraphx-dev* miopen-hip* miopen-hip-dev* mivisionx* mivisionx-dev* openmp-extras-dev* openmp-extras-runtime* rccl* rccl-dev*
  rocalution* rocalution-dev* rocblas* rocblas-dev* rocdecode* rocdecode-dev* rocfft* rocfft-dev* rocm* rocm-cmake* rocm-core*
  rocm-dbgapi* rocm-debug-agent* rocm-dev* rocm-developer-tools* rocm-device-libs* rocm-gdb* rocm-hip-libraries* rocm-hip-runtime*
  rocm-hip-runtime-dev* rocm-hip-sdk* rocm-language-runtime* rocm-llvm* rocm-ml-libraries* rocm-ml-sdk* rocm-opencl* rocm-opencl-dev*
  rocm-opencl-icd-loader* rocm-opencl-runtime* rocm-opencl-sdk* rocm-openmp-sdk* rocm-smi-lib* rocm-utils* rocminfo* rocprim-dev*
  rocprofiler* rocprofiler-dev* rocprofiler-plugins* rocprofiler-register* rocprofiler-sdk* rocprofiler-sdk-roctx* rocrand*
  rocrand-dev* rocsolver* rocsolver-dev* rocsparse* rocsparse-dev* rocthrust-dev* roctracer* roctracer-dev* rocwmma-dev* rpp* rpp-dev*
  xserver-xorg-amdgpu-video-amdgpu*
0 upgraded, 0 newly installed, 148 to remove and 0 not upgraded.
After this operation, 36.3 GB disk space will be freed.
Do you want to continue? [Y/n] y
(Reading database ... 367245 files and directories currently installed.)
Removing rocm (6.2.3.60203-124~22.04) ...
Removing rocm-developer-tools (6.2.3.60203-124~22.04) ...
Removing rocm-dev (6.2.3.60203-124~22.04) ...
Removing amd-smi-lib (24.6.3.60203-124~22.04) ...
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Removed AMD-SMI python library (amdsmi)...
Removed /etc/systemd/system/timers.target.wants/logrotate.timer.
Created symlink /etc/systemd/system/timers.target.wants/logrotate.timer → /lib/systemd/system/logrotate.timer.
Removing amdgpu-lib32 (1:6.2.60203-2044426.22.04) ...
Removing amdgpu-lib (1:6.2.60203-2044426.22.04) ...
Removing libllvm17.0-amdgpu:amd64 (1:17.0.60103-1787201.22.04) ...
Removing mesa-amdgpu-vdpau-drivers:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libgl1-amdgpu-mesa-dri:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing mesa-amdgpu-va-drivers:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libdrm-amdgpu-amdgpu1:i386 (1:2.4.120.60203-2044426.22.04) ...
Removing libxatracker2-amdgpu:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing xserver-xorg-amdgpu-video-amdgpu (1:22.0.0.60203-2044426.22.04) ...
Removing libllvm17.0-amdgpu:i386 (1:17.0.60103-1787201.22.04) ...
Removing amdgpu-dkms (1:6.8.5.60203-2044426.22.04) ...
Module amdgpu-6.8.5-2044426.22.04 for kernel 6.8.0-51-generic (x86_64).
Before uninstall, this module version was ACTIVE on this kernel.

amdgpu.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.


amdttm.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.


amdkcl.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.


amd-sched.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.


amddrm_ttm_helper.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.


amddrm_buddy.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.


amdxcp.ko:
 - Uninstallation
   - Deleting from: /lib/modules/6.8.0-51-generic/updates/dkms/
 - Original module
   - No original module was found for this module on this kernel.
   - Use the dkms install command to reinstall any previous module version.

depmod...
Deleting module amdgpu-6.8.5-2044426.22.04 completely from the DKMS tree.
update-initramfs: Generating /boot/initrd.img-6.8.0-51-generic
Removing amdgpu-dkms-firmware (1:6.8.5.60203-2044426.22.04) ...
Removing rocm-opencl-sdk (6.2.3.60203-124~22.04) ...
Removing rocm-opencl-runtime (6.2.3.60203-124~22.04) ...
Removing rocm-openmp-sdk (6.2.3.60203-124~22.04) ...
Removing rocm-ml-sdk (6.2.3.60203-124~22.04) ...
Removing rocm-hip-sdk (6.2.3.60203-124~22.04) ...
Removing composablekernel-dev (1.1.0.60203-124~22.04) ...
Removing gst-omx-amdgpu (1:1.0.0.1.60203-2044426.22.04) ...
Removing mivisionx-dev (3.0.0.60203-124~22.04) ...
Removing rpp-dev (1.8.0.60203-124~22.04) ...
Removing rocm-ml-libraries (6.2.3.60203-124~22.04) ...
Removing rocdecode-dev (0.6.0.60203-124~22.04) ...
Removing rocm-hip-runtime-dev (6.2.3.60203-124~22.04) ...
Removing hip-doc (6.2.41134.60203-124~22.04) ...
Removing migraphx-dev (2.10.0.60203-124~22.04) ...
Removing rocsparse-dev (3.2.0.60203-124~22.04) ...
Removing rocm-hip-libraries (6.2.3.60203-124~22.04) ...
Removing rocthrust-dev (3.1.0.60203-124~22.04) ...
Removing hip-samples (6.2.41134.60203-124~22.04) ...
Removing hipblas-dev (2.2.0.60203-124~22.04) ...
Removing hipblaslt-dev (0.8.0.60203-124~22.04) ...
Removing hipblaslt (0.8.0.60203-124~22.04) ...
Removing hipblas (2.2.0.60203-124~22.04) ...
Removing hipcc (1.1.1.60203-124~22.04) ...
Removing hipcub-dev (3.2.0.60203-124~22.04) ...
Removing hipfft-dev (1.0.15.60203-124~22.04) ...
Removing hipfft (1.0.15.60203-124~22.04) ...
Removing hipfort-dev (0.4.0.60203-124~22.04) ...
Removing hipify-clang (18.0.0.60203-124~22.04) ...
Removing hiprand-dev (2.11.0.60203-124~22.04) ...
Removing hiprand (2.11.0.60203-124~22.04) ...
Removing hipsolver-dev (2.2.0.60203-124~22.04) ...
Removing hipsolver (2.2.0.60203-124~22.04) ...
Removing hipsparse-dev (3.1.1.60203-124~22.04) ...
Removing hipsparselt-dev (0.2.1.60203-124~22.04) ...
Removing hipsparselt (0.2.1.60203-124~22.04) ...
Removing hipsparse (3.1.1.60203-124~22.04) ...
Removing hiptensor-dev (1.3.0.60203-124~22.04) ...
Removing hiptensor (1.3.0.60203-124~22.04) ...
Removing hsa-amd-aqlprofile (1.0.0.60203.60203-124~22.04) ...
Removing rocprofiler-plugins (2.0.60203.60203-124~22.04) ...
Removing rocprofiler-dev (2.0.60203.60203-124~22.04) ...
Removing rocprofiler (2.0.60203.60203-124~22.04) ...
Removing mivisionx (3.0.0.60203-124~22.04) ...
Removing rpp (1.8.0.60203-124~22.04) ...
Removing rocm-opencl-dev (2.0.0.60203-124~22.04) ...
Removing libdrm-amdgpu-dev:amd64 (1:2.4.120.60203-2044426.22.04) ...
Removing mesa-amdgpu-vdpau-drivers:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libgl1-amdgpu-mesa-dri:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libdrm-amdgpu-radeon1:i386 (1:2.4.120.60203-2044426.22.04) ...
Removing mesa-amdgpu-omx-drivers:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libegl1-amdgpu-mesa-drivers:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libegl1-amdgpu-mesa:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libegl1-amdgpu-mesa-drivers:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libegl1-amdgpu-mesa:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libgbm1-amdgpu:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libgbm1-amdgpu:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libgl1-amdgpu-mesa-glx:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libgl1-amdgpu-mesa-glx:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libglapi-amdgpu-mesa:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libglapi-amdgpu-mesa:i386 (1:24.2.0.60203-2044426.22.04) ...
Removing libllvm18.1-amdgpu:i386 (1:18.1.60203-2044426.22.04) ...
Removing libxatracker2-amdgpu:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libva-amdgpu-drm2:i386 (2.16.0.60203-2044426.22.04) ...
Removing libva-amdgpu-glx2:amd64 (2.16.0.60203-2044426.22.04) ...
Removing libva-amdgpu-glx2:i386 (2.16.0.60203-2044426.22.04) ...
Removing libva-amdgpu-wayland2:i386 (2.16.0.60203-2044426.22.04) ...
Removing libva-amdgpu-x11-2:i386 (2.16.0.60203-2044426.22.04) ...
Removing libva2-amdgpu:i386 (2.16.0.60203-2044426.22.04) ...
Removing libwayland-amdgpu-client0:i386 (1.22.0.60203-2044426.22.04) ...
Removing libwayland-amdgpu-egl1:i386 (1.22.0.60203-2044426.22.04) ...
Removing libwayland-amdgpu-server0:i386 (1.22.0.60203-2044426.22.04) ...
Removing libwayland-amdgpu-server0:amd64 (1.22.0.60203-2044426.22.04) ...
Removing miopen-hip-dev (3.2.0.60203-124~22.04) ...
Removing openmp-extras-dev (18.62.0.60203-124~22.04) ...
Removing rccl-dev (2.20.5.60203-124~22.04) ...
Removing rccl (2.20.5.60203-124~22.04) ...
Removing rocalution-dev (3.2.0.60203-124~22.04) ...
Removing rocalution (3.2.0.60203-124~22.04) ...
Removing rocblas-dev (4.2.1.60203-124~22.04) ...
Removing rocsolver-dev (3.26.0.60203-124~22.04) ...
Removing rocsolver (3.26.0.60203-124~22.04) ...
Removing rocdecode (0.6.0.60203-124~22.04) ...
Removing rocfft-dev (1.0.29.60203-124~22.04) ...
Removing rocfft (1.0.29.60203-124~22.04) ...
Removing rocm-utils (6.2.3.60203-124~22.04) ...
Removing rocm-cmake (0.13.0.60203-124~22.04) ...
Removing rocwmma-dev (1.5.0.60203-124~22.04) ...
Removing roctracer-dev (4.1.60203.60203-124~22.04) ...
Removing rocm-gdb (14.2.60203-124~22.04) ...
Removing rocm-debug-agent (2.0.3.60203-124~22.04) ...
Removing rocm-dbgapi (0.76.0.60203-124~22.04) ...
Removing rocm-device-libs (1.0.0.60203-124~22.04) ...
Removing rocm-opencl-icd-loader (1.2.60203-124~22.04) ...
Removing rocm-smi-lib (7.3.0.60203-124~22.04) ...
Removing rocprofiler-sdk (0.4.0-124~22.04) ...
Removing rocprofiler-sdk-roctx (0.4.0-124~22.04) ...
Removing rocrand-dev (3.1.0.60203-124~22.04) ...
Removing libdrm2-amdgpu:i386 (1:2.4.120.60203-2044426.22.04) ...
Removing rocm-opencl (2.0.0.60203-124~22.04) ...
Removing migraphx (2.10.0.60203-124~22.04) ...
Removing hip-dev (6.2.41134.60203-124~22.04) ...
Removing rocsparse (3.2.0.60203-124~22.04) ...
Removing rocprim-dev (3.2.0.60203-124~22.04) ...
Removing rocm-hip-runtime (6.2.3.60203-124~22.04) ...
Removing hsa-rocr-dev (1.14.0.60203-124~22.04) ...
Removing hsakmt-roct-dev (20240607.4.05.60203-124~22.04) ...
Removing mesa-amdgpu-va-drivers:amd64 (1:24.2.0.60203-2044426.22.04) ...
Removing libdrm-amdgpu-radeon1:amd64 (1:2.4.120.60203-2044426.22.04) ...
Removing libllvm18.1-amdgpu:amd64 (1:18.1.60203-2044426.22.04) ...
Removing libva-amdgpu-drm2:amd64 (2.16.0.60203-2044426.22.04) ...
Removing libva-amdgpu-wayland2:amd64 (2.16.0.60203-2044426.22.04) ...
Removing libva-amdgpu-x11-2:amd64 (2.16.0.60203-2044426.22.04) ...
Removing libva2-amdgpu:amd64 (2.16.0.60203-2044426.22.04) ...
Removing libwayland-amdgpu-client0:amd64 (1.22.0.60203-2044426.22.04) ...
Removing miopen-hip (3.2.0.60203-124~22.04) ...
Removing rocblas (4.2.1.60203-124~22.04) ...
Removing rocm-llvm (18.0.0.24355.60203-124~22.04) ...
Removing rocrand (3.1.0.60203-124~22.04) ...
Removing roctracer (4.1.60203.60203-124~22.04) ...
Removing rocm-language-runtime (6.2.3.60203-124~22.04) ...
Removing half (1.12.0.60203-124~22.04) ...
Removing hip-runtime-amd (6.2.41134.60203-124~22.04) ...
Removing rocminfo (1.0.0.60203-124~22.04) ...
Removing libdrm-amdgpu-amdgpu1:amd64 (1:2.4.120.60203-2044426.22.04) ...
Removing libdrm-amdgpu-common (1.0.0.60203-2044426.22.04) ...
Removing libdrm2-amdgpu:amd64 (1:2.4.120.60203-2044426.22.04) ...
Removing openmp-extras-runtime (18.62.0.60203-124~22.04) ...
Removing amdgpu-core (1:6.2.60203-2044426.22.04) ...
Removing comgr (2.8.0.60203-124~22.04) ...
Removing hsa-rocr (1.14.0.60203-124~22.04) ...
Removing rocprofiler-register (0.4.0.60203-124~22.04) ...
Removing rocm-core (6.2.3.60203-124~22.04) ...
dpkg: warning: while removing rocm-core, directory '/opt' not empty so not removed
Processing triggers for libc-bin (2.35-0ubuntu3.8) ...
(Reading database ... 352001 files and directories currently installed.)
Purging configuration files for gst-omx-amdgpu (1:1.0.0.1.60203-2044426.22.04) ...
Purging configuration files for amdgpu-dkms (1:6.8.5.60203-2044426.22.04) ...
Hit:1 http://us.archive.ubuntu.com/ubuntu jammy InRelease
Get:2 http://us.archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
Get:3 http://us.archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
Get:4 http://us.archive.ubuntu.com/ubuntu jammy-updates/main amd64 DEP-11 Metadata [103 kB]
Get:5 http://us.archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 DEP-11 Metadata [212 B]
Get:6 http://us.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,182 kB]
Get:7 http://us.archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [754 kB]
Get:8 http://us.archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [289 kB]
Get:9 http://us.archive.ubuntu.com/ubuntu jammy-updates/universe amd64 DEP-11 Metadata [356 kB]
Get:10 http://us.archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 DEP-11 Metadata [940 B]
Get:11 http://us.archive.ubuntu.com/ubuntu jammy-backports/main amd64 DEP-11 Metadata [7,028 B]
Get:12 http://us.archive.ubuntu.com/ubuntu jammy-backports/restricted amd64 DEP-11 Metadata [212 B]
Get:13 http://us.archive.ubuntu.com/ubuntu jammy-backports/universe amd64 DEP-11 Metadata [17.7 kB]
Get:14 http://us.archive.ubuntu.com/ubuntu jammy-backports/multiverse amd64 DEP-11 Metadata [212 B]
Get:15 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
Get:16 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2,041 kB]
Get:17 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [321 kB]                                                   
Get:18 http://security.ubuntu.com/ubuntu jammy-security/main amd64 DEP-11 Metadata [43.1 kB]                                           
Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 DEP-11 Metadata [208 B]                                       
Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 DEP-11 Metadata [126 kB]                                        
Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 DEP-11 Metadata [208 B]                                       
Hit:22 https://repo.radeon.com/amdgpu/6.2.3/ubuntu jammy InRelease                                                                     
Hit:23 https://packages.microsoft.com/repos/code stable InRelease                                                                      
Hit:24 https://repo.radeon.com/rocm/apt/6.2.3 jammy InRelease                                                                          
Hit:25 https://ppa.launchpadcontent.net/deadsnakes/ppa/ubuntu jammy InRelease                                                          
Fetched 5,625 kB in 11s (528 kB/s)                                                                                                     
Reading package lists... Done
nlbutts@AMDDesktop:~$ sudo apt-get purge amdgpu-install
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were automatically installed and are no longer required:
  dctrl-tools dkms icu-devtools libatomic1:i386 libavcodec-dev libavformat-dev libavutil-dev libbsd0:i386 libdrm-amdgpu1:i386
  libdrm-dev libdrm-intel1:i386 libdrm-nouveau2:i386 libdrm-radeon1:i386 libdrm2:i386 libedit2:i386 libegl-mesa0:i386 libegl1:i386
  libelf-dev libelf1:i386 libexpat1:i386 libffi-dev libfile-copy-recursive-perl libfile-which-perl libgbm1:i386 libgl-dev libgl1:i386
  libgl1-mesa-dri:i386 libglapi-mesa:i386 libglvnd0:i386 libglx-dev libglx-mesa0:i386 libglx0:i386 libicu-dev libicu70:i386
  libllvm15:i386 libmd0:i386 libncurses5 libnuma-dev libomxil-bellagio-bin libomxil-bellagio0 libpciaccess-dev libpciaccess0:i386
  libsensors5:i386 libset-scalar-perl libstdc++-12-dev libstdc++6:i386 libswresample-dev libswscale-dev libsystemd-dev libtinfo5
  libva-dev libva-glx2 libvdpau1:i386 libwayland-bin libwayland-dev libx11-6:i386 libx11-xcb1:i386 libxau6:i386 libxcb-dri2-0:i386
  libxcb-dri3-0:i386 libxcb-glx0:i386 libxcb-present0:i386 libxcb-randr0:i386 libxcb-shm0:i386 libxcb-sync1:i386 libxcb-xfixes0:i386
  libxcb1:i386 libxdmcp6:i386 libxext6:i386 libxfixes3:i386 libxml2:i386 libxml2-dev libxshmfence1:i386 libxxf86vm1:i386
  mesa-common-dev mesa-vdpau-drivers:i386 pkg-config python3-argcomplete valgrind vdpau-driver-all:i386
Use 'sudo apt autoremove' to remove them.
The following packages will be REMOVED:
  amdgpu-install*
0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded.
After this operation, 74.8 kB disk space will be freed.
Do you want to continue? [Y/n] y
(Reading database ... 351998 files and directories currently installed.)
Removing amdgpu-install (6.2.60203-2044426.22.04) ...
(Reading database ... 351986 files and directories currently installed.)
Purging configuration files for amdgpu-install (6.2.60203-2044426.22.04) ...
nlbutts@AMDDesktop:~$ sudo apt update
Hit:1 http://us.archive.ubuntu.com/ubuntu jammy InRelease
Hit:2 http://us.archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:3 http://us.archive.ubuntu.com/ubuntu jammy-backports InRelease
Hit:4 https://packages.microsoft.com/repos/code stable InRelease                                                                       
Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease                                                                       
Hit:6 https://ppa.launchpadcontent.net/deadsnakes/ppa/ubuntu jammy InRelease     
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
All packages are up to date.
nlbutts@AMDDesktop:~$ cd Downloads/
nlbutts@AMDDesktop:~/Downloads$ sudo apt install ./amdgpu-install_6.3.60301-1_all.deb 
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'amdgpu-install' instead of './amdgpu-install_6.3.60301-1_all.deb'
The following packages were automatically installed and are no longer required:
  dctrl-tools dkms icu-devtools libatomic1:i386 libavcodec-dev libavformat-dev libavutil-dev libbsd0:i386 libdrm-amdgpu1:i386
  libdrm-dev libdrm-intel1:i386 libdrm-nouveau2:i386 libdrm-radeon1:i386 libdrm2:i386 libedit2:i386 libegl-mesa0:i386 libegl1:i386
  libelf-dev libelf1:i386 libexpat1:i386 libffi-dev libfile-copy-recursive-perl libfile-which-perl libgbm1:i386 libgl-dev libgl1:i386
  libgl1-mesa-dri:i386 libglapi-mesa:i386 libglvnd0:i386 libglx-dev libglx-mesa0:i386 libglx0:i386 libicu-dev libicu70:i386
  libllvm15:i386 libmd0:i386 libncurses5 libnuma-dev libomxil-bellagio-bin libomxil-bellagio0 libpciaccess-dev libpciaccess0:i386
  libsensors5:i386 libset-scalar-perl libstdc++-12-dev libstdc++6:i386 libswresample-dev libswscale-dev libsystemd-dev libtinfo5
  libva-dev libva-glx2 libvdpau1:i386 libwayland-bin libwayland-dev libx11-6:i386 libx11-xcb1:i386 libxau6:i386 libxcb-dri2-0:i386
  libxcb-dri3-0:i386 libxcb-glx0:i386 libxcb-present0:i386 libxcb-randr0:i386 libxcb-shm0:i386 libxcb-sync1:i386 libxcb-xfixes0:i386
  libxcb1:i386 libxdmcp6:i386 libxext6:i386 libxfixes3:i386 libxml2:i386 libxml2-dev libxshmfence1:i386 libxxf86vm1:i386
  mesa-common-dev mesa-vdpau-drivers:i386 pkg-config python3-argcomplete valgrind vdpau-driver-all:i386
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
  dialog
The following NEW packages will be installed:
  amdgpu-install dialog
0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded.
Need to get 303 kB/320 kB of archives.
After this operation, 1,333 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 /home/nlbutts/Downloads/amdgpu-install_6.3.60301-1_all.deb amdgpu-install all 6.3.60301-2095006.22.04 [17.0 kB]
Get:2 http://us.archive.ubuntu.com/ubuntu jammy/universe amd64 dialog amd64 1.3-20211214-1 [303 kB]
Fetched 303 kB in 0s (940 kB/s) 
Selecting previously unselected package amdgpu-install.
(Reading database ... 351980 files and directories currently installed.)
Preparing to unpack .../amdgpu-install_6.3.60301-1_all.deb ...
Unpacking amdgpu-install (6.3.60301-2095006.22.04) ...
Selecting previously unselected package dialog.
Preparing to unpack .../dialog_1.3-20211214-1_amd64.deb ...
Unpacking dialog (1.3-20211214-1) ...
Setting up dialog (1.3-20211214-1) ...
Setting up amdgpu-install (6.3.60301-2095006.22.04) ...
Processing triggers for man-db (2.10.2-1) ...
N: Download is performed unsandboxed as root as file '/home/nlbutts/Downloads/amdgpu-install_6.3.60301-1_all.deb' couldn't be accessed by user '_apt'. - pkgAcquire::Run (13: Permission denied)

I then installed pretty much everything:

nlbutts@AMDDesktop:~/Downloads$ sudo amdgpu-install --usecase=graphics,rocm,opencl,hip,mllib,rocmdev,rocmdevtools,hip,hiplibsdk,mlsdk
Hit:1 http://us.archive.ubuntu.com/ubuntu jammy InRelease
Hit:2 http://us.archive.ubuntu.com/ubuntu jammy-updates InRelease
Hit:3 http://us.archive.ubuntu.com/ubuntu jammy-backports InRelease
Hit:4 https://ppa.launchpadcontent.net/deadsnakes/ppa/ubuntu jammy InRelease
Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease
Hit:6 https://repo.radeon.com/amdgpu/6.3.1/ubuntu jammy InRelease
Hit:7 https://packages.microsoft.com/repos/code stable InRelease
Hit:8 https://repo.radeon.com/rocm/apt/6.3.1 jammy InRelease
Reading package lists... Done
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
linux-headers-6.8.0-51-generic is already the newest version (6.8.0-51.52~22.04.1).
The following packages were automatically installed and are no longer required:
  libatomic1:i386 libdrm-amdgpu1:i386 libdrm-intel1:i386 libdrm-nouveau2:i386 libdrm-radeon1:i386 libdrm2:i386 libegl-mesa0:i386
  libegl1:i386 libffi-dev libgbm1:i386 libgl1:i386 libgl1-mesa-dri:i386 libglapi-mesa:i386 libglvnd0:i386 libglx-mesa0:i386
  libglx0:i386 libicu70:i386 libllvm15:i386 libncurses5 libomxil-bellagio-bin libomxil-bellagio0 libpciaccess0:i386 libsensors5:i386
  libset-scalar-perl libstdc++-12-dev libsystemd-dev libtinfo5 libva-dev libva-glx2 libvdpau1:i386 libwayland-bin libwayland-dev
  libxcb-dri2-0:i386 libxfixes3:i386 libxml2:i386 mesa-vdpau-drivers:i386 vdpau-driver-all:i386
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
  amd-smi-lib amdgpu-core amdgpu-dkms-firmware amdgpu-multimedia comgr composablekernel-dev half hip-dev hip-doc hip-runtime-amd
  hip-samples hipblas hipblas-common-dev hipblas-dev hipblaslt hipblaslt-dev hipcc hipcub-dev hipfft hipfft-dev hipfort-dev
  hipify-clang hiprand hiprand-dev hipsolver hipsolver-dev hipsparse hipsparse-dev hipsparselt hipsparselt-dev hiptensor hiptensor-dev
  hsa-amd-aqlprofile hsa-rocr hsa-rocr-dev libdrm-amdgpu-amdgpu1 libdrm-amdgpu-amdgpu1:i386 libdrm-amdgpu-common libdrm-amdgpu-dev
  libdrm-amdgpu-radeon1 libdrm-amdgpu-radeon1:i386 libdrm2-amdgpu libdrm2-amdgpu:i386 libegl1-amdgpu-mesa libegl1-amdgpu-mesa:i386
  libegl1-amdgpu-mesa-drivers libegl1-amdgpu-mesa-drivers:i386 libgbm1-amdgpu libgbm1-amdgpu:i386 libgl1-amdgpu-mesa-dri
  libgl1-amdgpu-mesa-dri:i386 libgl1-amdgpu-mesa-glx libgl1-amdgpu-mesa-glx:i386 libglapi-amdgpu-mesa libglapi-amdgpu-mesa:i386
  libllvm19.1-amdgpu libllvm19.1-amdgpu:i386 libva-amdgpu-drm2 libva-amdgpu-wayland2 libva-amdgpu-x11-2 libva2-amdgpu
  libwayland-amdgpu-client0 libwayland-amdgpu-client0:i386 libwayland-amdgpu-egl1:i386 libwayland-amdgpu-server0
  libwayland-amdgpu-server0:i386 libxatracker2-amdgpu libxatracker2-amdgpu:i386 mesa-amdgpu-libgallium mesa-amdgpu-libgallium:i386
  mesa-amdgpu-va-drivers mesa-amdgpu-va-drivers:i386 mesa-amdgpu-vdpau-drivers migraphx migraphx-dev miopen-hip miopen-hip-dev
  mivisionx mivisionx-dev openmp-extras-dev openmp-extras-runtime rccl rccl-dev rocalution rocalution-dev rocblas rocblas-dev rocfft
  rocfft-dev rocm-cmake rocm-core rocm-dbgapi rocm-debug-agent rocm-device-libs rocm-gdb rocm-hip-libraries rocm-hip-runtime-dev
  rocm-language-runtime rocm-llvm rocm-opencl rocm-opencl-dev rocm-opencl-sdk rocm-openmp-sdk rocm-smi-lib rocminfo rocprim-dev
  rocprofiler rocprofiler-dev rocprofiler-plugins rocprofiler-register rocprofiler-sdk rocprofiler-sdk-roctx rocrand rocrand-dev
  rocsolver rocsolver-dev rocsparse rocsparse-dev rocthrust-dev roctracer roctracer-dev rocwmma-dev rpp rpp-dev
  xserver-xorg-amdgpu-video-amdgpu
The following NEW packages will be installed:
  amd-smi-lib amdgpu-core amdgpu-dkms amdgpu-dkms-firmware amdgpu-lib amdgpu-lib32 amdgpu-multimedia comgr composablekernel-dev half
  hip-dev hip-doc hip-runtime-amd hip-samples hipblas hipblas-common-dev hipblas-dev hipblaslt hipblaslt-dev hipcc hipcub-dev hipfft
  hipfft-dev hipfort-dev hipify-clang hiprand hiprand-dev hipsolver hipsolver-dev hipsparse hipsparse-dev hipsparselt hipsparselt-dev
  hiptensor hiptensor-dev hsa-amd-aqlprofile hsa-rocr hsa-rocr-dev libdrm-amdgpu-amdgpu1 libdrm-amdgpu-amdgpu1:i386
  libdrm-amdgpu-common libdrm-amdgpu-dev libdrm-amdgpu-radeon1 libdrm-amdgpu-radeon1:i386 libdrm2-amdgpu libdrm2-amdgpu:i386
  libegl1-amdgpu-mesa libegl1-amdgpu-mesa:i386 libegl1-amdgpu-mesa-drivers libegl1-amdgpu-mesa-drivers:i386 libgbm1-amdgpu
  libgbm1-amdgpu:i386 libgl1-amdgpu-mesa-dri libgl1-amdgpu-mesa-dri:i386 libgl1-amdgpu-mesa-glx libgl1-amdgpu-mesa-glx:i386
  libglapi-amdgpu-mesa libglapi-amdgpu-mesa:i386 libllvm19.1-amdgpu libllvm19.1-amdgpu:i386 libva-amdgpu-drm2 libva-amdgpu-wayland2
  libva-amdgpu-x11-2 libva2-amdgpu libwayland-amdgpu-client0 libwayland-amdgpu-client0:i386 libwayland-amdgpu-egl1:i386
  libwayland-amdgpu-server0 libwayland-amdgpu-server0:i386 libxatracker2-amdgpu libxatracker2-amdgpu:i386 mesa-amdgpu-libgallium
  mesa-amdgpu-libgallium:i386 mesa-amdgpu-va-drivers mesa-amdgpu-va-drivers:i386 mesa-amdgpu-vdpau-drivers migraphx migraphx-dev
  miopen-hip miopen-hip-dev mivisionx mivisionx-dev openmp-extras-dev openmp-extras-runtime rccl rccl-dev rocalution rocalution-dev
  rocblas rocblas-dev rocfft rocfft-dev rocm rocm-cmake rocm-core rocm-dbgapi rocm-debug-agent rocm-dev rocm-developer-tools
  rocm-device-libs rocm-gdb rocm-hip-libraries rocm-hip-runtime rocm-hip-runtime-dev rocm-hip-sdk rocm-language-runtime rocm-llvm
  rocm-ml-libraries rocm-ml-sdk rocm-opencl rocm-opencl-dev rocm-opencl-runtime rocm-opencl-sdk rocm-openmp-sdk rocm-smi-lib
  rocm-utils rocminfo rocprim-dev rocprofiler rocprofiler-dev rocprofiler-plugins rocprofiler-register rocprofiler-sdk
  rocprofiler-sdk-roctx rocrand rocrand-dev rocsolver rocsolver-dev rocsparse rocsparse-dev rocthrust-dev roctracer roctracer-dev
  rocwmma-dev rpp rpp-dev xserver-xorg-amdgpu-video-amdgpu
0 upgraded, 137 newly installed, 0 to remove and 0 not upgraded.
Need to get 2,867 MB of archives.
After this operation, 35.6 GB of additional disk space will be used.

I then try to run migraphx-driver again:

nlbutts@AMDDesktop:~/projects/reefscape_ai$ /opt/rocm/bin/migraphx-driver perf reefscape_yolov8n.onnx
Running [ MIGraphX Version: 2.11.0.4b20cbc9 ]: /opt/rocm/bin/migraphx-driver perf reefscape_yolov8n.onnx
Compiling ... 
Reading: reefscape_yolov8n.onnx
terminate called after throwing an instance of 'migraphx::version_2_11_0::exception'
  what():  /long_pathname_so_that_rpms_can_package_the_debug_info/src/AMDMIGraphX/src/targets/gpu/mlir.cpp:771: run_high_level_pipeline: Invalid MLIR created: Error: Disjointed yx or hw!
Note: see current operation: %7 = "rock.conv"(%5, %4, %6) <{arch = "gfx1100", dilations = [1 : index, 1 : index], features = #rock<GemmFeatures dot|atomic_add|atomic_fmax_f32>, numCU = 30 : i32, padding = [0 : index, 0 : index, 0 : index, 0 : index], strides = [1 : index, 1 : index]}> {filter_layout = ["g", "k", "c", "y", "x"], input_layout = ["ni", "hi", "gi", "ci", "wi"], output_layout = ["no", "ho", "go", "ko", "wo"]} : (tensor<1x1x16x1x1xf32>, tensor<1x4x1x16x8400xf32>, tensor<1x4x1x1x8400xf32>) -> tensor<1x4x1x1x8400xf32>

Aborted (core dumped)

So this is the most recent version that is distrubted. Do I need to build everything from source to get it to work?
Also according to this page:
https://rocm.docs.amd.com/en/latest/about/release-notes.html

I have the latest version.

@lucbruni-amd
Copy link

Hi @nlbutts,

Thanks for showing your detailed reinstallation steps, I can see you're on the latest ROCm version and are now reproducing the same error as I did. To answer your question, you will not need to build everything from source. Your ROCm installation looks good, but in order to avoid this MIGraphX issue (src/targets/gpu/mlir.cpp:771: run_high_level_pipeline: Invalid MLIR created: Error: Disjointed yx or hw!), for now you will need to build the MIGraphX component from source adding the work-in-progress fix mentioned in my previous comment. To do this, first git clone this repository, then git cherry-pick the commits from that PR, then follow the steps in README.md to build. This should replace the /opt/rocm/bin/migraphx-driver binary with one including the fix. As I mentioned earlier this fix is currently still in review and is subject to change to meet our standards.

Thank you for your patience with this, and let me know if I can help with anything else.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aarushjain29 aarushjain29

Labels
Under Investigation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@nlbutts @aarushjain29 @ppanchad-amd @lucbruni-amd