Giter Club home page Giter Club logo

uellama's Introduction

๐ŸŒธ This dude put LLaMA 2 inside UE5 ๐ŸŒธ 41 / 100 ๐ŸŒธ

Llama.cpp Build Parameters

Llama.cpp was built from git hash: a40f2b656fab364ce0aff98dbefe9bd9c3721cc9

With the following build commands:

mkdir build
cd build/
cmake .. -DLLAMA_CUBLAS=ON -DLLAMA_CUDA_DMMV_X=64 -DLLAMA_CUDA_MMV_Y=2 -DLLAMA_CUDA_F16=true -DBUILD_SHARED_LIBS=ON
cd ..
cmake --build build --config Release -j --verbose

Then the .so or .lib file was copied into the Libraries directory and all the .h files were copied to the Includes directory. In Windows you should put the build/bin/llama.dll into Binaries/Win64 directory.

You will need to have CUDA 12.2 installed or you will have an error loading the "UELlama" Module, this is because the llama.dll was compiled with that CUDA version, if you want to switch the version you will re-compile the binary.

uellama's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

uellama's Issues

Failed to load language model file

Hello, I'm developing chatbot models with Unreal Engine. You made a great plugin and I'm trying to use it, but I can't load the language model. I'm using it in Windows environment.

In the 'LlamaComponent.cpp', 'LlamaComponent.h files', I changed the pathToModel variable to: pathToModel="D:\unreal_project\PlayfabMenu_retire_3\Plugins\UELlama\Content\llama-2-13b-chat.ggmlv3.q4_0.bin";

Obviously, the file exists in the folder, but in the logs I get the error message "LogTemp: Error: 0000043995E7C000 unable to load model". What can I do to resolve this issue?

Can't package project - llama.h not found

I'm having issues trying to package my project on Unreal Engine 5.3 when compiling this plugin.
The plugin works fine in the editor but while packaging I get the error message:

UATHelper: Packaging (Android (ASTC)): In file included from ../../Projects/MixedReality/Intermediate/Build/Android/a/MixedReality/Development/UELlama/Module.UELlama.cpp:4:
UATHelper: Packaging (Android (ASTC)): C:/Unreal Engine 5/UnrealEngine/Projects/MixedReality/Plugins/UELlama/Source/UELlama/Private/LlamaComponent.cpp(18,10): fatal error: 'llama.h' file not found
UATHelper: Packaging (Android (ASTC)): #include "llama.h"
UATHelper: Packaging (Android (ASTC)):          ^~~~~~~~~
UATHelper: Packaging (Android (ASTC)): 1 error generated.

Has anyone else encountered this issue and know a solution?

The plugin doesn't work for windows

I recompiled the plugin and updated the library with the .lib version for work in windows, but the plugin still not working, I also tried another cmake flags, or another versions of llama.cpp, but I'm still having the following error when I start Unreal:
imagen

I have CUDA 9.0, 11.6, 11.8 and 12.2

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.