Visual Instruction model about llama-adapter HOT 10 CLOSED

LLaMa Adapter V2 support chat and visual instruction following separately. We will release the MM-LLM (llama-adapter V1) and chat model recently. The release of visual instruction model (LLaMa Adapter V2) still takes several weeks. Stay tuned.

from llama-adapter.

@jpgard Sure. All training code will be released. The pretrained weights/inference code will be released within 2-3 days. Full pretraining/finetuning of multimodal code will be released within 10 days. Sorry for the long waiting.

from llama-adapter.

@gaopengpjlab do you still plan to release training code for the multimodal model (not just demo and pretrained weights)?

from llama-adapter.

Demo and pretrained checkpoint of LLaMa Adapter V2 (visual instruction part) will be released in a few days. Sorry for the long waiting.

from llama-adapter.

Pretrained weights have been released.
https://github.com/ZrrSkywalker/LLaMA-Adapter/tree/main/llama_adapter_v2_multimodal

Full finetuning code coming soon.

from llama-adapter.

https://github.com/ZrrSkywalker/LLaMA-Adapter/tree/main/imagebind_LLM

pretraining/finetuning/inference code has been released. We support image/video/text/autio/point cloud input and bilingual(chinese/english) response.

Sorry for the long waiting. Hope you enjoy our code.

from llama-adapter.

Please check out demo page http://llama-adapter.opengvlab.com/

from llama-adapter.

Very impressive! Good job.

from llama-adapter.

Got it @gaopengpjlab ! Thanks for your contributions and for making it open-source, looking forward to it!

from llama-adapter.

It works! Thank you for the code!
P.S. I added M1 Mac Acceleration for multi-modal version in a separate branch of my llama-mps fork

from llama-adapter.