Comments (4)
Hello everyone, I am also very interested in weld. I read two papers related to weld and ran several test cases using WeldNumpy. I did see performance improvements in some scenarios. During my use, I found that the current version does not support python3. I made some minor modifications to make it support python3. I noticed that some operations need to be added to WeldNumpy, and I hope to contribute some code. I am also very interested in the potential of weld in the parallel development of multiple machines. I hope to do some work for the weld community. Looking forward to your reply.
from weld.
Thanks for your interest in Weld! Currently, none of us are actively working on the project, though I hope to return to it as a side project at some point.
When I was last working on it, I was "modernizing" the Python bindings and integrations. The python
directory contains the old code with hacky NumPy and Pandas integrations that only work with Python 2.7 (plan is to eventually delete this). The weld-python
directory contains the new code and a new version of Grizzly that works only with Python 3.x, and also contains many more tests, documentation on the functions, etc. This is where all the active development was last happening, but it does not have a NumPy integration yet.
from weld.
I am exploring Weld for gpu to optimize LLM models written in Pytorch. But first, I need gpu support in Weld. Please see https://www.modular.com/ and their Mojo lang to speed up ML workloads. I think Weld is a better tool than Modular.
from weld.
In our private repo of Weld, my company has modified Weld as follows.
- Refactored hardcoded llvm backend so that common backend code sits in the
codegen
directory and thellvm2
directory contains only LLVM specific code. So now, new backends can be added with ease. - Modified Weld to use LLVM 14.0.
- Modified Weld to build and test on Apple Mac machine.
A question, what app do folks want to run on gpu?
from weld.
Related Issues (20)
- License file in python sdists
- Weld as a Foundation for ML in Rust
- unable to import grizzly.grizzly HOT 1
- Is there any benchmark between pandas and grizzly?
- Incorrect website grizzly install command HOT 3
- "simplify_assignments" creates infinite loop with iterate
- Getting compile error: Invalid input token: 'name' HOT 3
- Build error while on Fedora HOT 2
- Error "ModuleNotFoundError: No module named 'weldarray'" when using python3. HOT 1
- Standardizing Weld's IR code HOT 1
- An active weld community
- An IR which returns a wrong answer.
- Cannot build on aarch64 (Apple Silicon Chips)
- example udfs run error
- Using REPL for weld code using CUDFs
- Running Python UDFs in Weld.
- unique() function on weld-capi.
- movielens_grizzly.py code not working.
- Bump framework versions in Weld probe core
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from weld.