Alex Spies's Projects
Academic Page
Advanced Deep Learning course site
draft page for advanced deep learning course
automatically replace Arxiv.org pdf links with ar5iv
Jupyter Notebook tutorial on Attention Mechanisms, Position Embeddings and Random Fourier Feature based approximations. Created for Imperial College Deep Learning Course
Superposition in Attention Heads
A fully biased list of ML resources on certain topics. There are too many good resources - if you think you have a better resource, or there is a topic missing, make a PR!
Material for Coding Classes run by HackSoc for Non-CS Majors
Evolution Through Large Models Implementation
VSCode project for taking notes on papers with Foam, and extracting annotations in a well-structured manner through a simple Python script. Not stable!
Google Research
[discontinued] A high quality and stable music bot for discord
A set of lightweight tools for probing ANNs built in Haiku and visualizing the results.
Utility functions for ICL DL CW2
Use conference template to generate schedule for iclp 2023 @ ICL
LLM-Merging: Building LLMs Efficiently through Merging
A light-weight framework for running experiments on arbitrary compute nodes
collection of miscellaneous python utilities -- including but not limited to serialization, logging, tensor shenanigans, and more
NDC 2019 Neuropixel Dataset
A Python and R autograding solution
Collection of utilities
Design your own matplotlib stylefile interactively
Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
Schnell and Dirty PyTorch Research Template
discord bot to help dump raid helper info to google sheets
Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
Some scripts to make SGE job submission easier, as well as create a read-friendly log of job submissions. Intended for use on CSF clusters @UoM