will-thompson-k Goto Github PK

alignment-handbook

Robust recipes to align language models with human and AI preferences

alpacare

axolotl

Go ahead and axolotl questions

babyagi

chain-of-verification

This repository implements the chain of verification paper by Meta AI

cv

Print-friendly, minimalist CV page

deepchem

Democratizing Deep-Learning for Drug Discovery, Quantum Chemistry, Materials Science and Biology

deeplearning-nlp-models

A small, interpretable codebase containing the re-implementation of a few "deep" NLP models in PyTorch. Colab notebooks to run with GPUs. Models: word2vec, CNNs, transformer, gpt.

dna-diffusion

🧬 Understanding the code of life: Generative modeling of regulatory DNA sequences with diffusion probabilistic models 💨

dont_know_jax

learning jax

flash-attention

Fast and memory-efficient exact attention

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

gpt-engineer

Specify what you want it to build, the AI asks for clarification, and then builds it.

jax-triton

jax-triton contains integrations between JAX and OpenAI Triton

langchain

⚡ Building applications with LLMs through composability ⚡

lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

llm-benchmark-logs

Just a bunch of benchmark logs for different LLMs

llm-swarm

Manage scalable open LLM inference endpoints in Slurm clusters

llm_steer

Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vectors

lora

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

mesh

Mesh TensorFlow: Model Parallelism Made Easier

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

microstructure-plotter

visualize financial microstructure 📈 & debug trading bots 🤖

mistral-src

Reference implementation of Mistral AI 7B v0.1 model.

mistral_7b_lora_example

A simple example illustrating how to fine-tune Mistal7b via (q)LoRA

mpire

A Python package for easy multiprocessing, but faster than multiprocessing

neurips_llm_efficiency_challenge

NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day

open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

paxml

Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.