Comments (3)
The update to CUDNN 9 was easy enough: #2267
That PR includes updated wrappers, including the graph API: https://github.com/JuliaGPU/CUDA.jl/blob/master/lib/cudnn/src/libcudnn.jl
from cuda.jl.
I looked into the graph APIs a few months ago for perf- and flexibility-related reasons. The problem I see is that they are lower-level and require far more manual work than the imperative API. There also appear to be exactly zero tutorials or in-depth learning resources on how to use the graph API to accomplish the same functionality as the imperative API? This is less of a problem outside of Julia because NVIDIA provides https://github.com/NVIDIA/cudnn-frontend, but obviously we can't make use of that higher-level C++ layer in Julia.
All this to say that I don't foresee us being able to migrate all of cuDNN.jl to the graph API any time soon. The best we could probably do is fix all the functionality using removed APIs to use just deprecated ones instead before cuDNN 9.0 becomes widespread. In parallel, a good first step to allow people to help with porting imperative -> graph code would be to generate bindings for the graph API (which IIRC existed in v8 as well). Grepping through res/wrap
those do not appear to exist right now.
from cuda.jl.
Generating bindings is trivial, I'll do that as part of the PR upgrading to cuDNN 9.0 here.
The best we could probably do is fix all the functionality using removed APIs to use just deprecated ones instead before cuDNN 9.0 becomes widespread.
Yep, I don't think we have a problem right now, I just wanted to get some people involved/interested so that we have enough time to adapt before the imperative API inevitably gets removed 🙂
from cuda.jl.
Related Issues (20)
- Improve error message when assigning real valued arrray with complex numbers HOT 4
- `@device_code_sass` broken HOT 3
- Readme says Cuda 11 is supported but also the last version to support it is v4.4 HOT 1
- `@gcsafe_ccall` breaks inlining of ccall wrappers HOT 5
- Mixed eltype contraction failing with CuTensor HOT 1
- Add helper function to recompile CUDA stack HOT 1
- Unable to use local CUDA runtime toolkit HOT 1
- Kron Support for CuSparseMatrixCSC HOT 1
- Enzyme prevents testing on 1.11
- Segfault during multiGPU tests
- EnzymeCore is an unconditional dependency. HOT 4
- Adapt + strictly-typed fields can trigger confusing errors
- cuBLASLt wrappers ccall into cuBLAS
- generic_trimatmul! error HOT 1
- CUFFT plans seem to leak GPU memory
- Use dynamic pipelines HOT 1
- [cuTENSOR] Issue when contracting views of CuArrays with cuTENSOR HOT 1
- Non-contiguous inputs to GEMM result in wrong results
- Incorrect grid size in `kron`
- Scalar Indexing error when performing `mul!(A, B, C)` with `A` a view of a Matrix
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cuda.jl.