monadkai's Projects
π§βAutoDev: The AI-powered coding wizard with multilingual support π, auto code generation ποΈ, and a helpful bug-slaying assistant π! Customizable prompts π¨ and a magic Auto Testing feature π§ͺ included! π
AutoML SGE
Distributed LLM inference for mobile, desktop and server.
JetBrains extension providing access to state-of-the-art LLMs, such as GPT-4, Code Llama, and others, all for free
Your new coding buddy, designed exclusively for IntelliJ IDEA.
Disaggregated serving system for Large Language Models (LLMs).
LSP server leveraging LLMs for code completion (and more?)
The Mojo Programming Language
About me
Benchmark between different paillier encryption implemenetations
Rust solution for project euler
SWE-agent: Agent Computer Interfaces Enable Software Engineering Language Models
High performance Transformer implementation in C++.
Large Language Model Text Generation Inference
Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
A lightweight llama2 inference framework. It can inference llama2-7b with 5000+ tokens/s on signle 4090.