Comments (8)
kikimych
commented on July 28, 2024
1
My bad. It's not related to feature_count. You have a typo in metric name. "SQ_INSTS_VALU", not "SQ_INST_VALU".
from rocprofiler.
gcongiu
commented on July 28, 2024
Example source code:
vectoradd_hip.cpp.txt
from rocprofiler.
kikimych
commented on July 28, 2024
Could you please check small fix? #77
Value of feature_count in https://github.com/ROCm-Developer-Tools/rocprofiler/files/7933103/vectoradd_hip.cpp.txt. can't be greater than actual number of features in vector.
from rocprofiler.
gcongiu
commented on July 28, 2024
@kikimych I will check it. Thanks
from rocprofiler.
gcongiu
commented on July 28, 2024
Previously I was getting:
LD_LIBRARY_PATH=$HOME/rocm-4.5.0/rocprofiler/lib:$LD_LIBRARY_PATH ./vectoradd_hip.exe
System minor 0
System major 9
agent prop name
hip Device prop succeeded
kernel symbol(0x7f051040a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67149) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
kernel symbol(0x7f051040a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67149) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
kernel symbol(0x7f051040a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67149) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
kernel symbol(0x7f051040a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67149) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
error(4096) "SetCallbacks(), reassigning queue callbacks - not supported"
HSA_STATUS_ERROR: A generic error has occurred.
Aborted (core dumped)
Now, with the fix that sets callback_data_ = NULL I am getting:
$ LD_LIBRARY_PATH=$HOME/rocm-4.5.0/rocprofiler/lib:$LD_LIBRARY_PATH ./vectoradd_hip.exe
System minor 0
System major 9
agent prop name
hip Device prop succeeded
kernel symbol(0x7f5dfe40a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67314) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
kernel symbol(0x7f5dfe40a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67314) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
kernel symbol(0x7f5dfe40a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67314) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
kernel symbol(0x7f5dfe40a800) name("vectoradd_float(float*, float const*, float const*, int, int) [clone .kd]") tid(67314) queue-id(0) gpu-id(0) > SQ_WAVES = (16384)
vectoradd_hip.exe: vectoradd_hip.cpp:160: hsa_status_t _rocp_dispatch_callback(const rocprofiler_callback_data_t *, void *, rocprofiler_group_t *): Assertion `status == HSA_STATUS_SUCCESS' failed.
Aborted (core dumped)
from rocprofiler.
kikimych
commented on July 28, 2024
You are adding 2 features to profile, but setting feature count to 1. I have fixed it locally, but forgot to report. Could you please check with feature_count set to number of actual features?
from rocprofiler.
gcongiu
commented on July 28, 2024
The feature_count=1 was intended not a typo. However, if I set it to 2 instead, start/stop monitoring, then change it back to 1 and start/stop monitoring again, I get the same error(4096) "SetCallbacks(), reassigning queue callbacks - not supported" I used to see.
from rocprofiler.
gcongiu
commented on July 28, 2024
[Update] Still not resolved with ROCm 5.4.x:
$ ./kernel-intercept
Tool lib "/home/gcongiu/rocprofiler/build/librocprofiler64.so" failed to load.
System minor 0
System major 9
agent prop name AMD Instinct MI210
hip Device prop succeeded
error(4096) "SetCallbacks(), reassigning queue callbacks - not supported"
HSA_STATUS_ERROR: A generic error has occurred.
Aborted (core dumped)
from rocprofiler.
Related Issues (20)
- rocprofv2 session name is not recognized when used with mpiexec
- Is rocprofv2 part of ROCm? HOT 1
- Please add gfx1100 support for aqlprofie HOT 1
- /opt/rocm/libexec/rocprofiler/tblextr.py: ROCTX range begin not found, pid()
- Overlapping kernel in profiler trace HOT 1
- Do I need --parallel-kernels option for multi-kernel on multi-device scenario?
- Question: what is the recommended way to profile multi-gpu code?
- spack error building `[email protected]` HOT 3
- ROCr error when running papi_command_line with specific event
- Tool for reading CSV files? HOT 1
- Build rocprof source code error
- [Feature]: controlling the profiling scope
- [Feature]: add cmake imported target
- [Feature]: Ignore unsupported architectures HOT 1
- [Issue]: Unable to compile, receive error: ld.lld: error: relocation R_X86_64_32 HOT 1
- [Issue]: rocprofile doesn't work with dlopen hip
- [Issue]: what's correct way to use --plugins att auto? "Could not find att output kernel: ./*_kernel.txt" HOT 1
- [Issue]: rocprofv2 --hip-trace --roctx-trace --plugin perfetto, no ROCTX in Perfetto UI viewer
- rocprof bash sets PATH to the wrong location, then fails to find rocminfo
- [Issue]: rocprofv2 --plugin file --plugin-version 1 --kernel-trace -o file_name output csv header columns number doesn't match the number of data columns
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rocprofiler.