Comments (2)
Thanks @jasperslot ! I checked this and got those below error.
jan:dev: 2024-06-10T03:48:39.878Z [CORTEX]::Error: llama_model_loader: - kv 16: tokenizer.ggml.merges arr[str,50000] = ["Ġ t", "Ġ a", "h e", "i n", "r e",...
jan:dev: llama_model_loader: - kv 17: tokenizer.ggml.bos_token_id u32 = 50295
jan:dev: llama_model_loader: - kv 18: tokenizer.ggml.eos_token_id u32 = 50296
jan:dev: llama_model_loader: - kv 19: tokenizer.ggml.unknown_token_id u32 = 50256
jan:dev: llama_model_loader: - kv 20: tokenizer.ggml.padding_token_id u32 = 50296
jan:dev: llama_model_loader: - kv 21: tokenizer.chat_template str = {% for message in messages %}{{'<|im_...
jan:dev: llama_model_loader: - kv 22: general.quantization_version u32 = 2
jan:dev: llama_model_loader: - type f32: 259 tensors
jan:dev: llama_model_loader: - type q8_0: 194 tensors
jan:dev:
jan:dev: 2024-06-10T03:48:39.910Z [CORTEX]::Error: llama_model_load: error loading model: error loading model vocabulary: unknown pre-tokenizer type: 'phi-2'
jan:dev: llama_load_model_from_file: failed to load model
jan:dev:
jan:dev: 2024-06-10T03:48:39.912Z [CORTEX]::Error: llama_init_from_gpt_params: error: failed to load model '/Users/_/jan/models/Q8_0/fietje-2b-chat-Q8_0.gguf/fietje-2b-chat-Q8_0.gguf'
jan:dev:
jan:dev: 2024-06-10T03:48:39.912Z [CORTEX]::Debug: {"timestamp":1717991319,"level":"ERROR","function":"LoadModel","line":168,"message":"llama.cpp unable to load model","model":"/Users/_/jan/models/Q8_0/fietje-2b-chat-Q8_0.gguf/fietje-2b-chat-Q8_0.gguf"}
jan:dev: 20240610 03:48:39.912616 UTC 3911969 ERROR Error loading the model - llama_engine.cc:385
from jan.
Adding related ticket: ggerganov/llama.cpp#7219
from jan.
Related Issues (20)
- bug: different region is causing input box not allowing float number with "."
- Github Projects Setup
- Threads settings & Settings Template (presets) HOT 1
- Opt-in Analytics / Crash reporting for Jan HOT 2
- epic: Change API server to use Cortex Platform API server & show the logs
- epic: Jan and Cortex support Llama-3s
- bug: Unable to use nitro.tensorRT-llm on linux HOT 1
- Jan unit tests & code coverage HOT 2
- epic: Hardware Detection and Recommendations HOT 1
- epic: Hub Search Bar
- epic: Analytics Infra
- epic: Opt-in Analytics + Analytics Infra
- epic: Crash Report Submission + Crash Report Infra
- epic: Remote API Extension that is modular and with easily updateable model lists
- epic: Automated QA Strategy HOT 1
- feat: Unit test for UI component & code coverage
- feat: Sync Model Settings Across Jan, Cortex, and llama.cpp
- feat: Add Text Width Settings Options for Chat Area
- feat: Capture console log error with Playwright for Jan Electron App
- feat: Double click/F2 to edit title
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jan.