Lorenzo Pacchiardi's Projects
Simple python implementation of Approximate Bayesian Computation for Model Choice
ABCpy package
The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.
Python implementation of Bayesian Probabilistic matrix Factorization algorithm.
Conformal Bayes with importance sampling
Finetuning LLaMA with DeepSpeed
Code for 'Emergent Analogical Reasoning in Large Language Models'
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Gemini is a modern LaTex beamerposter theme 🖼
Code for the paper "Generalized Bayesian Likelihood-Free Inference Using Scoring Rules Estimators"
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).
Testing methods for estimating KL-divergence from samples.
Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
My personal webpage
MINE: Mutual Information Neural Estimation in pytorch
A free React / Next.js landing page template designed to showcase open source projects, SaaS products, online services, and more. Made by
Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
Bayesian IRT models in Python
Python framework for short-term ensemble prediction systems.
recommendation system with python
Code for the paper: "Simulation-Based Inference with Generative Neural Networks via Scoring Rule Minimization"
Simulation-based inference benchmark
Code for the paper: "Score Matched Conditional Exponential Families for Likelihood-Free Inference", https://jmlr.org/papers/v23/21-0061.html
Evaluating LLMs with fewer examples