Core dumped with performance counter mode profiling about rocprofiler HOT 9 OPEN

@eshcherb It was down to libhsa-amd-aqlprofile64.so missing from the install. Issuing sudo apt install --reinstall hsa-amd-aqlprofile did the trick. Thank you for the pointer.

Even though I work for a company subcontracted by AMD and am fairly well versed in the ways of administering a ROCm install, even I don't know where to report issues regarding the "bigger picture" of installing ROCm libraries. Few things to note:

• When looking for the package that provides said missing library, common APT tools can't fetch file information from the repository. If I'm not mistaken, it's Contents.gz missing from the dist, but I may be mistaken here. Something along the lines of this.

PS /home/mate> apt search aqlprofile
Sorting... Done
Full Text Search... Done
hsa-amd-aqlprofile/Ubuntu 16.04,now 1.0.0 amd64 [installed]
  AQLPROFILE library for AMD HSA runtime API extension support

hsa-amd-aqlprofile4.0.0/Ubuntu 16.04 1.0.0 amd64
  AQLPROFILE library for AMD HSA runtime API extension support

PS /home/mate> apt-file show hsa-amd-aqlprofile
PS /home/mate> apt-file show hsa-amd-aqlprofile4.0.0

Downloading the actual deb file and listing it's contents show that indeed this is the pacakge.

dpkg --contents ./hsa-amd-aqlprofile_1.0.0_amd64.deb
drwxr-xr-x root/root         0 2020-12-14 12:03 ./opt/
drwxr-xr-x root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/
drwxr-xr-x root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/hsa-amd-aqlprofile/
drwxr-xr-x root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/hsa-amd-aqlprofile/lib/
lrwxrwxrwx root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/hsa-amd-aqlprofile/lib/libhsa-amd-aqlprofile64.so -> libhsa-amd-aqlprofile64.so.1
lrwxrwxrwx root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/hsa-amd-aqlprofile/lib/libhsa-amd-aqlprofile64.so.1 -> libhsa-amd-aqlprofile64.so.1.0.40000
-rw-r--r-- root/root    249304 2020-12-14 12:03 ./opt/rocm-4.0.0/hsa-amd-aqlprofile/lib/libhsa-amd-aqlprofile64.so.1.0.40000
drwxr-xr-x root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/lib/
lrwxrwxrwx root/root         0 2020-12-14 12:03 ./opt/rocm-4.0.0/lib/libhsa-amd-aqlprofile64.so -> ../hsa-amd-aqlprofile/lib/libhsa-amd-aqlprofile64.so

• While it is the recommended way of always doing a clean install of ROCm, it's not how users of APT repos have been socialized. Spamming apt upgrade and things breaking is generally bad experience. I'm fairly certain nobody went and started deleting libraries inside a ROCm install. The package maintainers should really up their game in terms of test coverage of system upgrades. I'm not sure what's inside the current battery of deployment testing, but changes to the repo contents should likely test upgrade paths from the past 1-2 versions inside docker containers, VMs or anything.

from rocprofiler.

Thank you for reporting the issue.
I will try to reproduce it.

from rocprofiler.

This is the error I get when I simply run --list-basic.

from rocprofiler.

Hi, it looks like you have corrupted ROCM installation.
ROCr runtime cannot find 'libhsa-amd-aqlprofile64.so' library.

Run the profiling with 'LD_DEBUG=libs':
$ LD_DEBUG=libs rocprof > log.txt 2>&1

And you can check where it looks 'libhsa-amd-aqlprofile64.so' library.
It should be there '/opt/rocm/lib/libhsa-amd-aqlprofile64.so'.
If you have it then it might that you didn't update the ROCM properly and you have an old version with incompatible API.

So I would recommend to wipe out your current ROCM completely and install the latest according the instructions from ROCM GitHub page: https://rocmdocs.amd.com/en/latest/Installation_Guide/Installation-Guide.html

from rocprofiler.

@eshcherb Any update on this thread? I recently noticed that even simply running rocprof --list-basic can cause the same problem.

from rocprofiler.

Abort (core dumped) is exit of profiler on an error.
Could you provide complete log with the error message?

from rocprofiler.

I'm seeing the same error when trying to collect perf counters via the CLI tool (rocprof) and also while just trying to list the counters. ROCm 4.0 and the issue is the same. When I'm reading counters from an app that doesn't launch kernels (rocminfo for eg.) it doesn't crash, so at least init and cleanup aren't at fault.

@syifan are you looking for the actual dump file?

from rocprofiler.

And please upload the 'log.txt' with the output from 'LD_DEBUG=libs'.

from rocprofiler.

I have been upgrading to ROCm 4.0 and the problem is not there anymore. So I guess @MathiasMagnus is right, it should be an installation issue.

from rocprofiler.