Self Learn LLMs

This repository constitutes some of the resources which I will use to learn about Large Language Models. I will also try to come up with a roadmap as I go forward in this self-learning journey, since a clear roadmap with milestones will be one of the best ways to learn about LLMs in a proper manner.

For this, I will include a mix of theoretical and practical hands-on resources to learn.

PS: Need to make this more visual

Courses

NLP Fundamentals

Transformers

Large Language Models

Industrial and Open-Source courses

Activeloop Learn, this initiative GenAI360 provides 3 free courses on RAGs, fine-tuning LLMs, LangChain and VectorDBs.
LLM Course by Maxime Labonne, Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
Hands on LLM Course, Learn about LLMs, LLMOps, and Vector DBs for free by designing, training, and deploying a real-time financial advisor LLM system source code + video & reading materials.
Full Stack Deep Learning, started out as a deep learning bootcamp and evolved into LLM bootcamp around April 2023, now is free to take up.
LLM University by Cohere, this course consists of 8 modules taught by the famous Luis Serrano, who is known for teaching concepts in a easy and visually appealing manner. The course contains topics like fundamentals, deployment, semantic search and RAG.
Deeplearning.ai Short Courses, Short courses by DL.AI on various domains of LLMs and Generative AI. These short courses are really useful as they have the perfect blend of theoretical and practical sessions. The courses are usually made in collaborations with companies like Hugging Face, Mistral, OpenAI, Microsoft, Meta, Google etc.
LLM Zoomcamp by DataTalksClub, LLM Zoomcamp - a free online course about building a Q&A system.
Applied LLMs Mastery 2024 Course by Aishwarya N Reganti, free 10 weeks course with a definite roadmap ranging from LLM Fundamentals, Tools and techniques, Deployment and evaluation to Challenges and future trends.
Weights and Biases Courses, provides different courses on MLOps, LLM Powered Apps etc.
LLM Models course, DataBricks x ed, professional certification by DataBricks.
Deeplearning.ai offers various short courses on LLMs like LangChain for LLM App Development, Serverless LLMs with AWS Bedrock, Fine-tuning LLMs, LLMs with Semantic Search etc.
Introduction to Generative AI Learning Path, Google Cloud.
Arize University hosts courses like llm-evaluation, llm agents tools and chains, llm-observability etc.

University Courses

1. [CS 324, Stanford](https://stanford-cs324.github.io/winter2022/) 2. [COMP790-101: Large Language Models, UNC Chapel Hill](https://github.com/craffel/llm-seminar) 3. [Large Language Models S-23, ETH Zurich](https://rycolab.io/classes/llm-s23/) 4. [Foundations of Large Language Models, University of Waterloo](https://uwaterloo.ca/watspeed/programs-and-courses/foundations-large-language-models)

Books

Natural Language Processing with Transformers Book

Blogs and Guides

Langchain Blogs

Important Papers

A Survey of Large Language Models Also check out this Repo: https://github.com/RUCAIBox/LLMSurvey
Understanding Large Language Models -- A Transformative Reading List, Sebastian Raschka

Reading Groups

Wiki CLSP, NLP Reading Group, a list of reading groups related to NLP which is updated frequently.

Tutorials and Talks

TED Talks

Upcoming Talks

Datasets, Notebooks and Spaces

Datasets

Notebooks

Spaces

Libraries, Frameworks and Toolkits

Language Models

Communities

Usecases

ShareGPT

Projects and Ideas

Vector Databases

Autonomous Agents

LLM Influencers

People you should definitely follow to keep updated about LLMs. Researchers/Founders/Developers/AI Content Creators involved in LLM production/research/development

Sebastian Raschka, he is a legend and will burst your hype-up LLM bubble with his amazing tweets, blogs and tutorials. Subscribe to his newsletter Ahead of AI
Andrej Karpathy, so this legend worked in Tesla, took a break, started his YouTube channel to teach the fundamentals and blew us all with his amazing video on implementing GPT from scratch and finally rejoined OpenAI. I guess you cannot lose a legend :D
Jay Alammar, yup if you don't know about his ELI blog on Transformers go read that out first and be sure to follow him for updates.
Tomaz Bratanic, he is the author of famous book Graph Algorithms for Data Science, and currently writes great blogs on Medium related to GPT, Langchain and stuff.

snehilsanyal / self-learn-llms Goto Github PK

self-learn-llms's Introduction