slai-labs / get-beam Goto Github PK
View Code? Open in Web Editor NEWRun GPU inference and training jobs on serverless infrastructure that scales with you.
Home Page: https://beam.cloud
Run GPU inference and training jobs on serverless infrastructure that scales with you.
Home Page: https://beam.cloud
The fine-tuning script provided does not work with custom datasets. It appears there is a bug related to PEFT. The InvalidHeaderDeserialization message has been reported by other users. Strangely, the recommended changes of not calling torch.compile didn’t work for me. However, after looking at this comment I removed the following code and training completed successfully.
In this replit-code, I feel the model is not being moved to GPU:
https://github.com/slai-labs/get-beam/blob/main/examples/replit-code/replit-code.py
Also the cache_dir is not being used in the instantiation of AutoModelForCausalLM
Please correct me if I am wrong
The install documentation has a curl command to install beam, which is also used to update beam. (https://docs.beam.cloud/getting-started/installation)
The Mac/Linux and Windows instructions include only that curl command to install, and does not include the instructions to install the python cli:
python3 -m pip install --upgrade beam-sdk
The uninstall instructions do mention the beam-sdk, so the install instructions were just missed.
To replicate:
curl https://raw.githubusercontent.com/slai-labs/get-beam/main/get-beam.sh -sSfL | sh
python> import beam
ModuleNotFoundError: No module named 'beam'
To verify the fix:
curl https://raw.githubusercontent.com/slai-labs/get-beam/main/get-beam.sh -sSfL | sh
python3 -m pip install --upgrade beam-sdk
python
python> import beam
I am having tons of problems ---
last are
beam-sdk was not found using "python3 -m pip freeze | grep beam-sdk"... Proceeding to install beam-sdk into the environment
! App file 'app.py' not found.
Can someone help please?
Thanks I am justtrying to follow your instructions - https://github.com/slai-labs/get-beam/tree/main/examples/t5- but it seems much harder than it seemed --- :D
Running beam to deploy T5+ :
(venv) [XXX@gpu-server codeT5+]$ beam deploy app.py
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'importlib.metadata'
! beam-sdk was not found using "python3 -m pip freeze | grep beam-sdk"... Proceeding to install beam-sdk into the environment
Requirement already satisfied: beam-sdk in ./venv/lib/python3.6/site-packages (0.1.0)
Traceback (most recent call last):
File "/usr/lib64/python3.6/runpy.py", line 183, in _run_module_as_main
mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
File "/usr/lib64/python3.6/runpy.py", line 109, in _get_module_details
import(pkg_name)
File "/home/XXX/llm/codeT5+/venv/lib64/python3.6/site-packages/beam/init.py", line 24, in
_config = Config.resolve()
File "/home/XXX/llm/codeT5+/venv/lib64/python3.6/site-packages/beam/config.py", line 164, in resolve
raise RuntimeError('Unable to locate config file')
RuntimeError: Unable to locate config file
! Invalid app definition.
Usage:
beam deploy [filename.py:function_name] [flags]
Flags:
-h, --help help for deploy
-p, --profile string Authenticate with a specific beam profile. (default "default")
(venv) [XXX@gpu-server codeT5+]$ uname -a
Linux gpu-server 3.10.0-1127.10.1.el7.x86_64 #1 SMP Wed Jun 3 14:28:03 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
(venv) [XXX@gpu-server codeT5+]$ python3 --version
Python 3.6.8
(venv) [XXX@gpu-server codeT5+]$ cat /etc/redhat-release
CentOS Linux release 7.9.2009 (Core)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.