A curated list of curated lists of awesome resources across various machine learning and deep learning topics.

With 380+ items (Dec 2021), this repository aims to:

• help beginners understand the branches and latest developments in machine learning;
• help researchers follow new machine learning research directions;
• help engineers find suitable tutorials and libraries to solve practical problems.

Note:

• ⭐ Please leave a STAR if you like this project! ⭐
• Contributing: If you find any incorrect / inappropriate / outdated content, please kindly consider opening an issue or a PR. We would greatly appreciate your contribution to this list!
• Mark: ⚠️ indicates inactive, i.e., the corresponding list has stopped updating (for 12+ months), but can still be a good reference for starters.

• [12/2021] Update section Clustering.
• [12/2021] Update section Natural Language Processing (NLP) & Fairness in AI.
• [12/2021] The Chinese version is now available!
• [12/2021] Add section Interdisciplinary - Software Engineering (MLonCode).
• [12/2021] Add section Paradigm - Dimensionality Reduction (Feature Selection/Extraction).
• More

  [12/2021] Awesome Awesome Machine Learning first commit!
  

Check out Zhining's other open-source projects!

Imbalanced-Ensemble [PythonLib]

Imbalanced Learning [Awesome]

Self-paced Ensemble [ICDE]

Meta-Sampler [NeurIPS]

• Table of Contents
• General Machine Learning
• Machine Learning Paradigm
  • Semi/Self-Supervised Learning
  • Contrastive Learning
  • Representation Learning (Embedding)
  • Metric Learning
  • Reinforcement Learning
  • Transfer Learning
  • Meta-learning
  • Multi-task Learning
  • Imbalanced/Long-tail Learning
  • Few-shot Learning
  • Adversarial Learning
  • Robust Learning
  • Active Learning
  • Lifelong/Incremental/Continual Learning
  • Ensemble Learning
  • Automated Machine Learning (AutoML)
  • Federated Learning
  • Anomaly Detection
  • Clustering
  • Dimensionality Reduction (Feature Selection/Extraction)
• Machine Learning Task & Application
  • Computer Vision (CV)
  • Natural Language Processing (NLP)
  • Multi-modal & Cross-modal Learning
  • Graph Learning
  • Knowledge Graph
  • Time-series/Stream Learning
  • Recommender Systems
  • Information Retrieval
  • Gaming & Searching
• Machine Learning Model
  • Pretrained & Foundation Model
    • in NLP (BERT, RoBERTa, GPT, etc.)
    • in CV (Visual Transformers, etc.)
    • in other topics
  • Convolutional Neural Network (CNN)
  • Recurrent Neural Network (RNN, LSTM, GRU, etc.)
  • Graph Neural Network (GNN, GCN, GAT, etc.)
  • Generative Model & Generative Adversarial Network (GAN)
  • Variational Autoencoder
  • Tree-based & Ensemble Model
• Machine Learning Interpretability & Fairness & Ethics
  • Interpretability in AI
  • Fairness in AI
  • Ethics in AI
• Interdisciplinary: Machine Learning + X
  • System (MLSys/SysML)
  • Database (AIDB/ML4DB)
  • Software Engineering (MLonCode)
  • Cyber Security
  • Quantum Computing
  • Medical & Healthcare
  • Bioinformatics
  • Biology & Chemistry
  • Finance & Trading
  • Business
  • Law
• Machine Learning Datasets
• Production Machine Learning
  • Open-source Libraries
  • Big Data Frameworks
• Acknowledgement ✨
• Contributors ✨

• Practice

  • [List, Library] Awesome Machine Learning
    • A curated list of awesome machine learning frameworks, libraries and software (by language).
  • [Library] scikit-learn
    • scikit-learn: machine learning in Python.

• Research

  • [List] Papers-Literature-ML-DL-RL-AI
    • Impactful and widely cited papers and literature on ML/DL/RL/AI.
  • [List] Awesome Deep Learning [⚠️Inactive]
    • A curated list of awesome deep learning books, courses, videos, lectures, tutorials, and more.
  • [List] Awesome Deep Learning Papers [⚠️Inactive]
    • A curated list of the most cited deep learning papers (2012-2016).

• General

  • [List] Awesome Semi-Supervised Learning
    • A curated list of awesome Semi-Supervised Learning resources.
  • [List] Awesome Self-Supervised Learning
    • A curated list of awesome Self-Supervised Learning resources.
  • [List] Awesome Self-Supervised Papers
    • Collecting papers about Self-Supervised Learning, Representation Learning.

• Sub-topics

  • [List] Awesome Graph Self-Supervised Learning
    • A curated list for awesome self-supervised graph representation learning resources.
  • [List] Awesome Self-supervised GNN
    • Papers about self-supervised learning on Graph Neural Networks (GNNs).

• Practice

  • [Library] mmselfsup
    • OpenMMLab Self-Supervised Learning Toolbox and Benchmark.
  • [Library] unilm
    • Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities.
  • [Library] albert
    • A Lite BERT for Self-supervised Learning of Language Representations.

• General

  • [List] PyContrast
    • This repo lists recent contrastive learning papers, and includes code for many of them.
  • [List] Awesome Contrastive Learning
    • A comprehensive list of awesome contrastive self-supervised learning papers.
  • [List] Awesome Contrastive Learning Papers & Codes
    • A comprehensive list of awesome Contrastive Learning Papers&Codes.

• Practice

  • [Library] PyGCL
    • Graph Contrastive Learning Library for PyTorch.

• General

  • [List] awesome-embedding-models [⚠️Inactive]
    • A curated list of awesome embedding models tutorials, projects and communities.
  • [List] awesome-representation-learning
    • Reading List for Topics in Representation Learning.

• Sub-topics

  • [List] awesome-sentence-embedding
    • A curated list of pretrained sentence and word embedding models.
  • [List] Awesome Implicit Neural Representations
    • A curated list of resources on implicit neural representations.
  • [List] awesome-2vec
    • Curated list of 2vec-type embedding models.
  • [List] Awesome-VAEs
    • Awesome work on the VAE, disentanglement, representation learning, and generative models.
  • [List] Awesome Visual Representation Learning with Transformers
    • Awesome Transformers (self-attention) in Computer Vision.
  • [List] Awesome Deep Graph Representation Learning
    • A curated list for awesome deep graph representation learning resources.
  • [List] awesome-network-embedding [⚠️Inactive]
    • Network representation learning, graph embedding, knowledge embedding.
  • [List] Must-read papers on NRL/NE. [⚠️Inactive]
    • NRL: network representation learning. NE: network embedding.
  • [List] disentangled-representation-papers [⚠️Inactive]
    • Papers on disentangled (and an occasional "conventional") representation learning.
  • [List] Representation Learning on Heterogeneous Graph [⚠️Inactive]
    • Heterogeneous Graph Embedding, Heterogeneous GNNs and Applications.

• Practice
  • [Library] pytorch-metric-learning
    • The easiest way to use deep metric learning in your application.
  • [Library] metric-learn
    • metric-learn: Metric Learning in Python.
  • [Code Collection] Deep-Metric-Learning-Baselines [⚠️Inactive]
    • PyTorch Implementation for Deep Metric Learning Pipelines.

• General

  • [List] Awesome Reinforcement Learning
    • A curated list of resources dedicated to reinforcement learning.
  • [List] Awesome DL & RL Papers and Other Resources
    • A list of recent papers regarding deep learning and deep reinforcement learning.
  • [List] Awesome Deep RL
    • A curated list of awesome Deep Reinforcement Learning resources.
  • [List] Awesome Reinforcement Learning (CH/中文) [⚠️Inactive]
    • 强化学习从入门到放弃的资料

• Sub-topics

  • [List] Awesome Offline RL
    • This is a collection of research and review papers for offline reinforcement learning.
  • [List] Awesome Real World RL
    • Great resources for making Reinforcement Learning work in Real Life situations. Papers, projects and more.
  • [List] Awesome Game AI
    • A curated, but incomplete, list of game AI resources on multi-agent learning.
  • [List] Awesome RL Competitions
    • Collection of competitions for Reinforcement Learning.
  • [List] Awesome Robotics
    • This is a list of various books, courses and other resources for robotics
  • [List] Awesome RL for Natural Language Processing (NLP) [⚠️Inactive]
    • Curated List of Reinforcement Learning Resources for Natural Language Processing.

• Practice

  • [Library] gym
    • A toolkit for developing and comparing reinforcement learning algorithms.
  • [Library] trfl
    • TensorFlow Reinforcement Learning.
  • [Library] rlpyt
    • Reinforcement Learning in PyTorch.
  • [Library] rlkit
    • Reinforcement learning framework and algorithms implemented in PyTorch.
  • [Library] MARO
    • Multi-Agent Resource Optimization (MARO) platform is an instance of Reinforcement Learning as a Service (RaaS) for real-world resource optimization problems.
  • [Library] bandits
    • Python library for Multi-Armed Bandits.
  • [Library] BanditLib
    • Library of contextual bandits algorithms.
  • [Tutorial] reinforcement-learning-an-introduction
    • Python replication for Sutton & Barto's book Reinforcement Learning: An Introduction (2nd Edition).
  • [Code Collection] reinforcement-learning [⚠️Inactive]
    • Implementation of Reinforcement Learning Algorithms. Python, OpenAI Gym, Tensorflow.
  • [Tutorial] Reinforcement-learning-with-tensorflow (English&Chinese) [⚠️Inactive]
    • Reinforcement Learning Methods and Tutorials.
  • [Code Collection] reinforcement-learning [⚠️Inactive]
    • Minimal and Clean Reinforcement Learning Examples.

• General

  • [List] 迁移学习 Transfer Learning
    • Everything about Transfer Learning.
  • [List] Awesome Transfer Learning
    • A list of awesome papers and cool resources on transfer learning, domain adaptation and domain-to-domain translation in general.

• Sub-topics

  • [List] Awesome Domain Adaptation
    • This repo is a collection of AWESOME things about domain adaptation, including papers, code, etc.
  • [List] Domain Generalization
    • Domain generalization papers and datasets.

• Practice

  • [Library] Transfer-Learning-Library
    • Transfer Learning Library for Domain Adaptation, Task Adaptation, and Domain Generalization.
  • [Code Collection] deep-transfer-learning
    • A collection of implementations of deep domain adaptation algorithms
  • [Tutorial] hands-on-transfer-learning-with-python [⚠️Inactive]
    • Deep learning simplified by transferring prior learning using the Python deep learning ecosystem.

• General

  • [Code Collection] Torchmeta
    • A collection of extensions and data-loaders for few-shot learning & meta-learning in PyTorch.
  • [List] Meta-Learning Papers [⚠️Inactive]
    • Meta Learning/ Learning to Learn/ One Shot Learning/ Lifelong Learning.
  • [List] Awesome Meta Learning [⚠️Inactive]
    • A curated list of Meta Learning papers, code, books, blogs, videos, datasets and other resources.
  • [List] awesome-meta-learning [⚠️Inactive]
    • A curated list of Meta-Learning resources.

• Practice

  • [Library] learn2learn
    • A PyTorch Library for Meta-learning Research.
  • [Code Collection] pytorch-meta
    • A collection of extensions and data-loaders for few-shot learning & meta-learning in PyTorch.
  • [Tutorial] Hands-On-Meta-Learning-With-Python [⚠️Inactive]
    • Learning to Learn using One-Shot Learning, MAML, Reptile, Meta-SGD and more with Tensorflow.

• General

  • [List] Multitask-Learning
    • Multitask-Learning scholars, papers, surveys, slides, proceedings, and open-source projects.
  • [List] Awesome Multi-Task Learning
    • 2021 up-to-date list of papers on Multi-Task Learning (MTL), from ML perspective.

• Sub-topics

  • [List] Awesome Multi-Task Learning (for vision)
    • A list of papers on multi-task learning for computer vision.

• Practice

  • [Code Collection] Multi-Task-Learning-PyTorch
    • Implement several multi-task learning models and training strategies in PyTorch.

• General

  • [List] Awesome Imbalanced Learning
    • Everything about imbalanced (long-tail) learning. Frameworks and libraries (grouped by programming language), research papers (grouped by research field), imbalanced datasets, algorithms, utilities, Jupyter Notebooks, and Talks.
  • [List] Awesome Long-Tailed Learning
    • Related papers are sumarized, including its application in computer vision, in particular image classification, and extreme multi-label learning (XML), in particular text categorization.
  • [List] Awesome Long-Tailed Learning*
    • A curated list of awesome deep long-tailed learning resources.

• Sub-topics

  • [List] Awesome Long-tailed Recognition
    • A curated list of long-tailed recognition and related resources.
  • [List] Awesome Imbalanced Time-series Classification [⚠️Inactive]
    • Paper list of Imbalanced Time-series Classification with Deep Learning.

• Practice

  • [Library] imbalanced-learn
    • A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning.
  • [Library] imbalanced-ensemble (English&Chinese)
    • 类别不平衡/长尾机器学习 | Class-imbalanced/Long-tailed ensemble learning in Python

• General

  • [List] Awesome Papers Few shot
    • Few-shot learning papers published on top conferences.

• Sub-topics

  • [List] Few Shot Semantic Segmentation Papers
    • Papers pertaining to few-shot semantic segmentation.
  • [List] Awesome Few-Shot Image Generation
    • Papers, datasets, and relevant links pertaining to few-shot image generation.

• Practice

  • [Code Collection] Few-shot learning [⚠️Inactive]
    • Clean, readable and tested code to reproduce few-shot learning research.

See also: Machine Learning Model -> Generative Model & Generative Adversarial Network (GAN)

• General

  • [List] Awesome Adversarial Machine Learning [⚠️Inactive]
    • A curated list of awesome adversarial machine learning resources.
  • [List] Awesome Adversarial Examples for Deep Learning [⚠️Inactive]
    • A list of amazing resources for adversarial examples in deep learning.

• Sub-topics

  • [List] Must-read Papers on Textual Adversarial Attack and Defense (TAAD)
  • [List] Graph Adversarial Learning Literature
    • A curated list of adversarial attacks and defenses papers on graph-structured data.

• Practice

  • [Library] adversarial-robustness-toolbox
    • Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security.
  • [Library] AdversarialDNN-Playground
    • Web-based visualization tool for adversarial machine learning / LiveDemo.

• General

  • [List] Clean, readable and tested code to reproduce few-shot learning research.Awesome Learning with Label Noise
    • A curated list of resources for Learning with Noisy Labels
  • [List] Papers of Robust ML (Defense)
    • Related papers for robust machine learning (we mainly focus on defenses).

• Practice

  • [Library] adversarial-robustness-toolbox
    • Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security.
  • [Library] robustness-gym
    • Robustness Gym is an evaluation toolkit for machine learning.
  • [Library] robustdg
    • Toolkit for building machine learning models that generalize to unseen domains and are robust to privacy and other attacks.

• General

  • [List] Awesome Active Learning
    • Previous works of active learning were categorized.
  • [List] Awesome Active Learning*
    • A curated list of awesome Active Learning.
  • [List] Awesome Active Learning**
    • A list of resources related to Active learning in machine learning.

• Practice

  • [Library] modAL
    • A modular active learning framework for Python.
  • [Library] libact
    • libact: Pool-based Active Learning in Python
  • [Library] pytorch_active_learning
    • PyTorch Library for Active Learning to accompany Human-in-the-Loop Machine Learning book.
  • [Code Collection] deep-active-learning
    • Python implementations of several active learning algorithms.
  • [Code Collection] Active Learning Playground [⚠️Inactive]
    • A python module for experimenting with different active learning algorithms.

• General

  • [List] Awesome Incremental Learning / Lifelong learning
    • Papers in Incremental Learning / Lifelong Learning.
  • [List] Continual Learning Literature
    • Papers in Continual Learning.
  • [List] Awesome Continual/Lifelong Learning
    • Papers, blogs, datasets and softwares.
  • [List] Continual Learning Papers
    • Continual Learning papers list, curated by ContinualAI.
  • [List] Lifelong Learning Paper List [⚠️Inactive]
    • Papers in Lifelong Learning / Continual Learning.

• Practice

  • [Code Collection] continual-learning
    • PyTorch implementation of various methods for continual learning.
  • [Code Collection] incremental_learning.pytorch
    • A collection of incremental learning paper implementations.
  • [Code Collection] Continual-Learning-Benchmark [⚠️Inactive]
    • Evaluate three types of task shifting with popular continual learning algorithms.

See also: Machine Learning Model -> Tree-based & Ensemble Model

• General

  • [List] Awesome Ensemble Learning [⚠️Inactive]
    • Books, papers, courses, tutorials, libraries, datasets.

• Sub-topics

  • [List] Awesome Gradient Boosting Research Papers
    • A curated list of gradient and adaptive boosting papers with implementations.
  • [List] Awesome Random Forest [⚠️Inactive]
    • A curated list of resources regarding tree-based methods and more, including but not limited to random forest, bagging and boosting.

• Practice

  • [Library] xgboost
    • Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
  • [Library] LightGBM
    • A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework.
  • [Library] catboost
    • A fast, scalable, high performance Gradient Boosting on Decision Trees library.
  • [Library] combo
    • A Python Toolbox for Machine Learning Model Combination,
  • [Library] imbalanced-ensemble (English&Chinese)
    • 类别不平衡/长尾机器学习 | Class-imbalanced/Long-tailed ensemble learning in Python
  • [Library] mlens [⚠️Inactive]
    • A Python library for high performance ensemble learning.

• General

  • [List] Awesome AutoML Papers
    • Automated machine learning papers, articles, tutorials, slides and projects.
  • [List] Awesome AutoDL
    • A curated list of automated deep learning related resources.
  • [List] Awesome AutoML
    • Curating a list of AutoML-related research, tools, projects and other resources.

• Sub-topics

  • [List] Awesome Neural Architecture Search Papers
    • Neural Architecture Search Papers
  • [List] Awesome Architecture Search [⚠️Inactive]
    • A curated list of awesome architecture search and hyper-parameter optimization resources.
  • [List] Awesome AutoML and Lightweight Models [⚠️Inactive]

• Practice

  • [Library] NNI (Neural Network Intelligence)
    • An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
  • [Library] tpot
    • A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
  • [Library] ludwig
    • Data-centric declarative deep learning framework.
  • [Library] autokeras
    • AutoML library for deep learning.
  • [Library] automl
    • (Google Brain AutoML) list of AutoML related models and libraries.
  • [Library] autogluon
    • AutoGluon: AutoML for Text, Image, and Tabular Data
  • [Library] adanet
    • Fast and flexible AutoML with learning guarantees.
  • [Library] FLAML
    • A fast library for AutoML and tuning.

• General

  • [List] Awesome Federated Learning
    • A curated list of federated learning publications, re-organized from Arxiv (mostly).
  • [List] Awesome Federated Learning*
    • A list of resources releated to federated learning and privacy in machine learning.
  • [List] Awesome Federated Learning
    • A curated list of research in federated learning.
  • [List] 联邦学习 Federated Learning
    • Everything about federated learning.
  • [List] Federated Learning
    • Federated Learning Papers (grouped by topic).

• Sub-topics

  • [List] Awesome Federated Computing
    • A collection of research papers, codes, tutorials and blogs on ML carried out in a federated manner (distributed;decentralized).
  • [List] Awesome Federated Learning on Graph and GNN Papers
    • Federated learning on graph, especially on GNNs, knowledge graph, and private GNN.

• Practice

  • [Library] FATE
    • An Industrial Grade Federated Learning Framework.
  • [Library] federated
    • A framework for implementing federated learning (TensorFlow).
  • [Code] Federated-Learning-PyTorch
    • Implementation of the vanilla federated learning paper.

• General

  • [List] Anomaly Detection Learning Resources
    • Books & Academic Papers & Online Courses and Videos & Outlier Datasets & Open-source and Commercial Libraries & Toolkits & Key Conferences & Journals.
  • [List] Awesome Anomaly Detection
    • A curated list of awesome anomaly detection resources.
  • [List] Awesome Anomaly Detection* [⚠️Inactive]
    • A list of Papers on anomaly detection.

• Sub-topics

  • [List] Awesome Time-series Anomaly Detection
    • List of tools & datasets for anomaly detection on time-series data.
  • [List] Awesome Fraud Detection Research Papers
    • A curated list of fraud detection papers.
  • [List] Awesome Video Anomaly Detection
    • Papers for Video Anomaly Detection, released codes collections.
  • [List] Awesome Log Analysis
    • Publications and researchers on log analysis, anomaly detection, fault localization, and AIOps.

• Practice

  • [Library] pyod
    • A Python Toolbox for Scalable Outlier Detection (Anomaly Detection).
  • [Code] RNN-Time-series-Anomaly-Detection
    • RNN based Time-series Anomaly detector model implemented in Pytorch.
  • [Library (R)] AnomalyDetection [⚠️Inactive]
    • Anomaly Detection with R.
  • [Library] luminol [⚠️Inactive]
    • Anomaly Detection and Correlation library.

• General

  • [List] Deep Clustering
    • Deep Clustering: methods and implements

• Sub-topics

  • [List] Awesome Community Detection Research Papers
    • A collection of community detection papers.
  • [List] Awesome Multi-view Clustering
    • Collections for state-of-the-art (SOTA), novel multi-view clustering methods (papers, codes and datasets).
  • [List] Awesome-Deep-Graph-Clustering
    • A collection of state-of-the-art (SOTA), novel deep graph clustering methods (papers, codes, and datasets).

• Practice

  • [Library] faiss
    • A library for efficient similarity search and clustering of dense vectors.
  • [Library] hdbscan
    • A high performance implementation of HDBSCAN clustering.
  • [Code Collection] time-series-classification-and-clustering [⚠️Inactive]
    • Time series classification and clustering code written in Python.

• General

  • [List] Awesome Feature Engineering [⚠️Inactive]
    • A curated list of resources dedicated to Feature Engineering Techniques for Machine Learning.

• Practice

  • [Library] featuretools
    • An open source python library for automated feature engineering.
  • [Library] feature-selector [⚠️Inactive]
    • Feature Selector: Simple Feature Selection in Python.
  • [Library] scikit-feature [⚠️Inactive]
    • Open-source feature selection repository in python.
  • [Tutorial] DimensionalityReduction_alo_codes (Chinese) [⚠️Inactive]
    • xx特征提取/数据降维:PCA、LDA、MDS、LLE、TSNE等降维算法的python实现xxx.
  • [Tutorial] feature-engineering-and-feature-selection [⚠️Inactive]
    • A Guide for Feature Engineering and Feature Selection, with implementations and examples in Python.
  • [Tutorial] Feature-Selection-for-Machine-Learning [⚠️Inactive]
    • Methods with examples for Feature Selection during Pre-processing in Machine Learning.

• General

  • [List] Awesome Computer Vision
    • A curated list of awesome computer vision resources.
  • [List] Awesome Visual-Transformer
    • Collect some Transformer with Computer-Vision (CV) papers.
  • [List] Awesome Deep Vision [⚠️Inactive]
    • A curated list of deep learning resources for computer vision.

• Sub-topics

  • [List] Awesome Visual Representation Learning with Transformers
    • Awesome Transformers (self-attention) in Computer Vision.
  • [List] Awesome Face Recognition
    • Face Detection & Segmentation & Alignment & Tracking, and more.
  • [List] Awesome Neural Radiance Fields
    • A curated list of awesome neural radiance fields papers.
  • [List] Awesome Neural Rendering
    • A collection of resources on neural rendering.
  • [List] Awesome Inpainting Tech
    • A curated list of inpainting papers and resources.
  • [List] Awesome Image-to-Image Translation
    • A collection of resources on image-to-image translation.
  • [List] Deep-Learning-for-Tracking-and-Detection
    • Collection of papers, datasets, code and other resources for object detection and tracking using deep learning.
  • [List] Awesome Deep Learning for Video Analysis
    • Video analysis, especiall multimodal learning for video analysis research.
  • [List] Image and Video Deblurring
    • A curated list of resources for Image and Video Deblurring.
  • [List] Few Shot Semantic Segmentation Papers
    • Papers pertaining to few-shot semantic segmentation.
  • [List] Awesome Few-Shot Image Generation
    • Papers, datasets, and relevant links pertaining to few-shot image generation.
  • [List] Awesome Video Anomaly Detection
    • Papers for Video Anomaly Detection, released codes collections.
  • [List] 3D Machine Learning
    • Learn from 3D representations.
  • [List] awesome-3D-vision (Chinese)
    • 3D视觉算法、SLAM、vSLAM、计算机视觉
  • [List] 3D-Reconstruction-with-Deep-Learning-Methods
    • The focus of this list is on open-source projects hosted on Github.
  • [List] Awsome_Deep_Geometry_Learning
    • A list of resources about deep learning solutions on 3D shape processing.
  • [List] Awesome Image Classification [⚠️Inactive]
    • A curated list of deep learning image classification papers and codes since 2014.
  • [List] Awesome Object Detection [⚠️Inactive]
  • [List] Awesome Face [⚠️Inactive]
    • Face releated algorithm, datasets and papers.
  • [List] Awesome Human Pose Estimation [⚠️Inactive]
    • A collection of resources on human pose related problem.
  • [List] Awesome Video Generation [⚠️Inactive]
    • A curated list of awesome work (currently 257 papers) a on video generation and video representation learning.

• General

  • [List] Awesome NLP
    • A curated list of resources dedicated to Natural Language Processing.
  • [List] Tracking Progress in Natural Language Processing
    • Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.
  • [List] Awesome BERT & Transfer Learning in NLP
    • Transformers (BERT), attention mechanism, Transformer architectures/networks, and transfer learning in NLP.
  • [List] funNLP: The Most Powerful NLP-Weapon Arsenal (Chinese)
    • NLP民工的乐园: 几乎最全的中文NLP资源库
  • [List, Tutorial] ML-NLP (Chinese)
    • 此项目是机器学习、NLP面试中常考到的知识点和代码实现，也是作为一个算法工程师必会的理论基础知识
  • [List] Awesome Chinese NLP (Chinese) [⚠️Inactive]
    • 中文自然语言处理相关资料
  • [List] Awesome BERT [⚠️Inactive]
    • This repository is to collect BERT related resources.

• Sub-topics

  • [List] Machine Translation Reading List
    • A machine translation reading list maintained by the Tsinghua Natural Language Processing Group.
  • [List] Must-Read Papers on Pre-trained Language Models (PLMs)
    • List some representative work on PLMs and show their relationship with a diagram.
  • [List] PromptPapers
    • Must-read papers on prompt-based tuning for pre-trained language models.
  • [List] Must-read papers on NRE
    • NRE: Neural Relation Extraction.
  • [List] Awesome Question Answering
    • A curated list of the Question Answering (QA) subject.
  • [List] Textual Adversarial Attack and Defense (TAAD)
    • Must-read Papers on Textual Adversarial Attack and Defense.
  • [List] Machine Reading Comprehension.
    • Must-read papers on Machine Reading Comprehension.
  • [List] Legal Intelligence (NLP)
    • Must-read Papers on Legal Intelligence.
  • [List] Awesome NLP Fairness Papers
    • Papers about fairness in NLP.
  • [List] Awesome Financial NLP
    • Researches for Natural Language Processing for Financial Domain.
  • [List] Graph4NLP Literature
    • A list of literature regarding Deep Learning on Graphs for NLP.
  • [List] Awesome Chinese Medical NLP (Chinese)
    • 中文医学NLP公开资源整理
  • [List] NLP4Rec-Papers
    • Paper Collection of NLP for Recommender System.
  • [List] DataAug4NLP
    • Collection of papers and resources for data augmentation for NLP.
  • [List] Must-read papers on KRL/KE. [⚠️Inactive]
    • KRL: knowledge representation learning. KE: knowledge embedding.

• Practice

  • [Tutorial] NLP Tutorial
    • nlp-tutorial is a tutorial for who is studying NLP using Pytorch.
  • [Datasets] NLP Datasets
    • Alphabetical list of free/public domain datasets with text data for use in NLP.

• Multi-modal

  • [List] Awesome Multimodal ML
    • Reading List for Topics in Multimodal Machine Learning.
  • [List] Awesome Multimodal Research
    • Multimodal Machine Learning research papers.

• Cross-modal

  • [List] Cross-modal Retrieval Tutorial
    • Papers of Cross-Modal Matching and Retrieval.
  • [List] Awesome Video-Text Retrieval by Deep Learning
    • A curated list of deep learning resources for video-text retrieval.
  • [List] Awesome Document Understanding
    • A curated list of resources for Document Understanding (DU) topic related to Intelligent Document Processing (IDP).
  • [List] Awesome-Cross-Modal-Video-Moment-Retrieval (Chinese)

See also: Machine Learning Model -> Graph Neural Network (GNN, GCN, GAT, etc.)

• General

  • [List] Graph-based Deep Learning Literature
    • Conference publications in graph-based deep learning.
  • [List] Literature of Deep Learning for Graphs
    • This is a paper list about deep learning for graphs.
  • [List] GNNPapers
    • Must-read papers on GNN.

• Sub-topics

  • [List] Awesome Graph Classification
    • A collection of graph classification methods, covering embedding, deep learning, graph kernel and factorization papers with reference implementations.
  • [List] Awesome Explainable Graph Reasoning
    • A collection of research papers and software related to explainability in graph machine learning.
  • [List] Awesome Graph Self-Supervised Learning
    • A curated list for awesome self-supervised graph representation learning resources.
  • [List] Graph Adversarial Learning Literature
    • A curated list of adversarial attacks and defenses papers on graph-structured data.
  • [List] Deep Learning for Graphs in Chemistry and Biology
    • A paper list of deep learning on graphs in chemistry and biology.
  • [List] Awesome Federated Learning on Graph and GNN Papers
    • Federated learning on graph, especially on GNNs, knowledge graph, and private GNN.
  • [List] Awesome Deep Graph Representation Learning
    • A curated list for awesome deep graph representation learning resources.
  • [List] Graph4NLP Literature
    • A list of literature regarding Deep Learning on Graphs for NLP.
  • [List] GNN4Traffic
    • This is the repository for the collection of Graph Neural Network for Traffic Forecasting.
  • [List] GNN based Recommender Systems
    • An index of recommendation algorithms that are based on Graph Neural Networks.
  • [List] Awesome-GNN-Recommendation
    • GNN in Recommendation.
  • [List] Must-read papers on NRL/NE. [⚠️Inactive]
    • NRL: network representation learning. NE: network embedding.
  • [List] Representation Learning on Heterogeneous Graph [⚠️Inactive]
    • Heterogeneous Graph Embedding, Heterogeneous GNNs and Applications.

• Practice

  • [List] awesome-graph
    • A curated list of resources for graph databases and graph computing tools.

• General

  • [List] Knowledge Graphs
    • A collection of knowledge graph papers, codes, and reading notes
  • [Tutorial] Awesome Knowledge Graph (Chinese)
    • 整理知识图谱相关学习资料，提供系统化的知识图谱学习路径
  • [List] Awesome Knowledge Graph
    • Knowledge Graph related learning materials, databases, tools and other resources.
  • [List] Knowledge Graph Learning
    • A curated list of awesome knowledge graph tutorials, projects and communities.

• Sub-topics

  • [List] Knowledge Graph Reasoning Papers
    • Knowledge Graph Reasoning Papers.
  • [List] NLP-Knowledge-Graph (Chinese)
    • 自然语言处理、知识图谱、对话系统

• Practice

  • [List] awesome-graph
    • A curated list of resources for graph databases and graph computing tools.

• General

  • [List] awesome-time-series
    • List of state of the art papers, code, and other resources focus on time series forecasting.
  • [List] Awesome Time Series Papers (English&Chinese) [⚠️Inactive]
    • List of awesome papers from various research fields in time series analysis.

• Sub-topics

  • [List] Awesome Time-series Anomaly Detection
    • List of tools & datasets for anomaly detection on time-series data.
  • [List] Deep Learning Time Series Forecasting
    • Resources, code and experiments using deep learning for time series forecasting.
  • [List] Awesome-Deep-Learning-Based-Time-Series-Forecasting
    • Awesome-Deep-Learning-Based-Time-Series-Forecasting.
  • [List] Awesome Time Series Analysis and Data Mining
    • A collection list of learning resource, tools and dataset for time series analysis or time series data mining.

• Practice

  • [List, Practice] awesome_time_series_in_python
    • Python libraries, datasets, frameworks for time series processing.
  • [Datasets] Awesome time series database
    • A curated list of time series databases.
  • [Library] FOST
    • An easy-use tool for temporal, spatial-temporal and hierarchical forecasting.

• General

  • [List] Awesome-RSPapers
    • Recommender System papers in top-conferences.
  • [List] awesome-RecSys [⚠️Inactive]
    • A curated list of awesome Recommender System (research).
  • [List] awesome-recommender-systems (Chinese) [⚠️Inactive]
    • A curated list of awesome resources about Recommender Systems.

• Sub-topics

  • [List] Awesome Deep Learning papers for industrial Search, Recommendation and Advertisement
    • Focus on Embedding, Matching, Ranking (CTR prediction, CVR prediction), Post Ranking, Transfer and Reinforcement Learning.
  • [List] GNN based Recommender Systems
    • An index of recommendation algorithms that are based on Graph Neural Networks.
  • [List] NLP4Rec-Papers
    • Paper Collection of NLP for Recommender System.
  • [List] Awesome-GNN-Recommendation
    • GNN in Recommendation.

• [List] Awesome Information Retrieval
  • Curated list of information retrieval and web search resources from all around the web.

• [List] Awesome Monte Carlo Tree Search Papers
  • A curated list of Monte Carlo tree search papers with implementations.

• Foundation Models

  • [List] Must-Read Papers on Pre-trained Language Models (PLMs)
    • List some representative work on PLMs and show their relationship with a diagram.
  • [List] BERT-related Papers
    • This is a list of BERT-related papers.
  • [List] Awesome BERT & Transfer Learning in NLP
    • Transformers (BERT), attention mechanism, Transformer architectures/networks, and transfer learning in NLP.
  • [List] PTMs: Pre-trained-Models in NLP (Chinese)
    • NLP预训练模型的全面总结
  • [List, Model] Awesome Pretrained Chinese NLP Models (Chinese)
    • 高质量中文预训练模型集合
  • [List] Vision and Language PreTrained Models
    • Recent Advances in Vision and Language PreTrained Models (VL-PTMs).
  • [List] Awesome BERT [⚠️Inactive]
    • This repository is to collect BERT related resources.

• Pretrained (NOT Foundation) Models

  • [List, Model] Awesome Sentence Embedding
    • A curated list of pretrained sentence and word embedding models.

• Foundation Models

  • [List] Awesome Visual-Transformer
    • Collect some Transformer with Computer-Vision (CV) papers.
  • [List] Vision and Language PreTrained Models
    • Recent Advances in Vision and Language PreTrained Models (VL-PTMs).
  • [List] Transformer-in-Vision
    • Recent Transformer-based CV and related works.
  • [List] Awesome Visual Representation Learning with Transformers
    • Awesome Transformers (self-attention) in Computer Vision.
  • [List] Transformer-in-Computer-Vision
    • A paper list of some recent Transformer-based CV works.

• Pretrained (NOT Foundation) Models

  • [List, Practice] PyTorch Image Models
    • A collection of image models, layers, utilities, optimizers, schedulers, data-loaders / augmentations, and reference training / validation scripts that aim to pull together a wide variety of SOTA models with ability to reproduce ImageNet training results.
  • [List, Model] CV-pretrained-model
    • Computer Vision Pretrained Models (not papers).
  • [List, Model] pretrained-models.pytorch [⚠️Inactive]
    • Pretrained vision models for Pytorch.
  • [Library] segmentation_models [⚠️Inactive]
    • Python library with Neural Networks for Image Segmentation based on Keras and TensorFlow.

• [List] awesome-pretrained-models-for-information-retrieval
  • Awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).

Note: This is a big topic and almost all existing lists are outdated. Please refer to Computer Vision (CV) in Machine Learning Task & Application for more recent information.

• [Benchmark] convnet-benchmarks [⚠️Inactive]
  • Easy benchmarking of public open-source implementations of convnets.
• [Benchmark] cnn-benchmarks [⚠️Inactive]
  • Benchmarks for popular convolutional neural network models on CPU and different GPUs, with and without cuDNN.

Note: This is a big topic and almost all existing lists are outdated. Please refer to Time-series/Stream Learning in Machine Learning Task & Application for more recent information.

• [List] Awesome Recurrent Neural Networks [⚠️Inactive]
  • A curated list of resources dedicated to recurrent neural networks (closely related to deep learning).

See also: Machine Learning Task & Application -> Graph Learning

• General

  • [List] GNNPapers
    • Must-read papers on graph neural network.
  • [List] Graph-based Neural Networks
    • Important materials about graph-based neural networks and relational networks.
  • [List] Awesome GCN
    • This repository is to collect GCN, GAT (graph attention) related resources.
  • [List] Graph Neural Network (GNN) progress
    • Must-read papers and continuous track on Graph Neural Network (GNN) progress
  • [List] GNN_Review (Chinese)
    • GNN综述阅读报告

• Sub-topics

  • [List] awesome-self-supervised-gnn
    • Papers about self-supervised learning on Graph Neural Networks (GNNs).
  • [List] GNN4Traffic
    • This is the repository for the collection of Graph Neural Network for Traffic Forecasting.
  • [List] GNN based Recommender Systems
    • An index of recommendation algorithms that are based on Graph Neural Networks.

• Practice

  • [Tutorial] GNN-algorithms (Chinese) [⚠️Inactive]
    • 图神经网络相关算法详述及实现教程

See also: Machine Learning Paradigm -> Adversarial Learning

• General

  • [List] really-awesome-gan
    • A list of papers and other resources on Generative Adversarial (Neural) Networks.
  • [List] Awesome Generative Modeling Papers
    • Papers on generative modeling.
  • [List] The GAN Zoo [⚠️Inactive]
    • A list of all named GANs.
  • [List] AdversarialNetsPapers [⚠️Inactive]
    • Awesome papers about Generative Adversarial Networks. Majority of papers are related to Image Translation.
  • Awesome GAN Applications [⚠️Inactive]
    • Curated list of awesome GAN applications and demonstrations.

• Sub-topics & Applications

  • [List] awesome-gan-for-medical-imaging
    • A curated list of awesome GAN resources in medical imaging.
  • [List] awesome gan-inversion
    • This repo is a collection of resources on GAN inversion.

• Practice

  • [List] Awesome-GANs with Tensorflow
    • Tensorflow implementation of GANs (Generative Adversarial Networks).
  • [Tutorial] ganhacks [⚠️Inactive]
    • How to Train a GAN? Tips and tricks to make GANs work.
  • [Tutorial] GAN [⚠️Inactive]
    • Resources and Implementations of Generative Adversarial Nets.
  • [Tutorial] GAN_Theories [⚠️Inactive]
    • How to stabilize training process and generate high quality images.

See also: Machine Learning Paradigm -> Representation Learning

• [List] Awesome-VAEs
  • Awesome work on the VAE, disentanglement, representation learning, and generative models.
• [Code Collection] PyTorch-VAE
  • A collection of Variational AutoEncoders (VAEs) implemented in pytorch with focus on reproducibility.

See also: Machine Learning Paradigm -> Ensemble Learning

• General

  • [List] Awesome Decision Tree Research Papers
    • A curated list of classification and regression tree research papers with implementations.
  • [List] Awesome Gradient Boosting Research Papers
    • A curated list of gradient and adaptive boosting papers with implementations.
  • [List] Awesome Random Forest [⚠️Inactive]
    • A curated list of resources regarding tree-based methods and more, including but not limited to random forest, bagging and boosting.
  • [List] Awesome Ensemble Learning [⚠️Inactive]
    • Books, papers, courses, tutorials, libraries, datasets.

• Practice

  • [Library] xgboost
    • Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
  • [Library] LightGBM
    • A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework.
  • [Library] catboost
    • A fast, scalable, high performance Gradient Boosting on Decision Trees library.
  • [Library] mlens
    • A Python library for high performance ensemble learning.
  • [Library] combo
    • A Python Toolbox for Machine Learning Model Combination,
  • [Library] imbalanced-ensemble (English&Chinese)
    • 类别不平衡/长尾机器学习 | Class-imbalanced/Long-tailed ensemble learning in Python

• General

  • [List] Awesome Machine Learning Interpretability
    • A curated list of awesome machine learning interpretability resources.
  • [List] Awesome Explainable AI
    • This repository contains the frontier research on explainable AI (XAI) which is a hot topic recently.
  • [List] Machine Learning Interpretability
    • H2O.ai Machine Learning Interpretability Resources.
  • [List] awesome_deep_learning_interpretability (Chinese) [⚠️Inactive]
    • 深度学习近年来关于模型解释性的相关论文。

• Sub-topics

  • [List] Awesome Explainable Graph Reasoning
    • A collection of research papers and software related to explainability in graph machine learning.
  • [List] Adversarial Explainable AI
    • Adversarial attacks on model explanations, and evaluation approaches.

• Practice

  • [Tutorial] interpretable-ml-book
    • Book about interpretable machine learning.
  • [Tutorial] interpretable_machine_learning_with_python
    • Examples of techniques for training interpretable ML models, explaining ML models, and debugging ML models for accuracy, discrimination, and security.

• General

  • [List] FairAI
    • This is a collection of papers and other resources related to fairness.
  • [List] Awesome Fairness in AI [⚠️Inactive]
    • A curated, but probably biased and incomplete, list of awesome Fairness in AI resources.

• Sub-topics

  • [List] Awesome NLP Fairness Papers
    • Papers about fairness in NLP.

• Practice

  • [Tutorial]fairness_tutorial
    • Dealing with Bias and Fairness in Data Science Systems: A Practical Hands-on Tutorial.
  • [Library] ml-fairness-gym [⚠️Inactive]
    • A set of components for building simple simulations that explore the potential long-run impacts of deploying machine learning-based decision systems in social environments.

• General

  • [List] criticalML [⚠️Inactive]
    • Toward ethical, transparent and fair AI/ML: a critical reading list for engineers, designers, and policy makers.
  • [List] Machine Learning Ethics References [⚠️Inactive]
    • References about Machine Learning and Data Science discrimination, bias, ethics.

• Sub-topics

  • [List] Awesome-Privacy **
    • Toward ethical, transparent and fair AI/ML: a critical reading list for engineers, designers, and policy makers.

• [List] Awesome System for Machine Learning
  • A curated list of research in machine learning system.
• [Tutorial] Machine learning system design pattern
  • System design patterns for training, serving and operation of machine learning systems in production.
• [Note] CS-Notes (Chinese)
  • MLSys和C++自学笔记，以及算法、操作系统，后续学习分布式系统，终身更新。
• [Note] hack-SysML (Chinese)
  • Notes on learning and practicing SysML.
• [List] SysML-reading-list [⚠️Inactive]
  • A curated reading list of computer science research for work at the intersection of machine learning and systems.
• [Tutorial] dive-into-ml-system (Chinese) [⚠️Inactive]
  • Dive into machine learning system, start from reinventing the wheel.
• [List] Fast and Scalable Machine Learning: Algorithms and Systems [⚠️Inactive]
  • This is a collection of papers about recent progress in machine learning and systems, including distributed machine learning, deep learning and etc.

• [List] ML4DB-paper-list (English&Chinese)
  • [Paper List] AIDB / ML4DB / Autonomous Database / 智能数据库 / Self-driving Database

• [List] Machine Learning on Source Code (Website)
  • Research on machine learning for source code.
• [List] awesome-machine-learning-on-source-code [⚠️Inactive]
  • Cool links & research papers related to Machine Learning applied to source code (MLonCode).

• [List] Awesome Machine Learning for Cyber Security
  • A curated list of amazingly awesome tools and resources related to the use of machine learning for cyber security.
• [List] Awesome-Cybersecurity-Datasets
  • A curated list of amazingly awesome Cybersecurity datasets.
• [List] Machine Learning for Cyber Security [⚠️Inactive]
  • A curated list of amazingly awesome tools and resources related to the use of machine learning for cyber security.
• [List] AI for Security [⚠️Inactive]
  • A paper list about Machine Learning for IDSes.

• [List] Awesome Machine Learning for Cyber Security
  • A list of awesome papers and cool resources in the field of quantum machine learning (machine learning algorithms running on quantum devices). It does not include the use of classical ML algorithms for quantum purpose.

• [List] healthcare_ml
  • Relevant resources on applying machine learning to healthcare.
• [List, Practice] Awesome Chinese Medical NLP (Chinese)
  • 中文医学NLP公开资源整理
• [List] Awesome Medical Imaging [⚠️Inactive]
  • This is an awesome list of software that I use to do research in medical imaging.

• [List] Awesome Bioinformatics
  • A curated list of awesome Bioinformatics software, resources, and libraries.
• [List] Awesome Bioinformatics Benchmarks
  • A curated list of bioinformatics benchmarking papers and resources.
• [Tutorial] bioinformatics
  • Path to a free self-taught education in Bioinformatics (mainly curriculums).
• [Code Collection] biocode
  • This is a collection of bioinformatics scripts many have found useful and code modules which make writing new ones a lot faster.

• [List] deeplearning-biology
  • This is a list of implementations of deep learning methods to biology.
• [List] Awesome Python Chemistry
  • A curated list of awesome Python frameworks, libraries, software and resources related to Chemistry.
• [List] Deep Learning for Graphs in Chemistry and Biology
  • A paper list of deep learning on graphs in chemistry and biology.
• [List] Awesome DeepBio [⚠️Inactive]
  • A curated list of awesome deep learning applications in the field of computational biology

• [Library] Qlib
  • Qlib is an AI-oriented quantitative investment platform, which aims to realize the potential, empower the research, and create the value of AI technologies in quantitative investment.
• [List, Practice] financial-machine-learning
  • A curated list of practical financial machine learning (FinML) tools and applications.
• [List] Awesome AI in Finance
  • Research, tools and code that people use to beat the market.
• [List] Awesome Financial NLP
  • Researches for Natural Language Processing for Financial Domain.

• [List, Practice] business-machine-learning
  • A curated list of applied business machine learning (BML) and business data science (BDS) examples and libraries.

• [List] Must-read Papers on Legal Intelligence
  • Papers and datasets of Legal Artificial Intelligence.
• [List, Practice] Legal Text Analytics
  • Resources, methods, and tools dedicated to Legal Text Analytics.

• [Datasets] Awesome Public Datasets
  • This list of a topic-centric public data sources in high quality.
• [Datasets] NLP Datasets
  • Alphabetical list of free/public domain datasets with text data for use in NLP.
• [Datasets] Awesome Dataset Tools
  • A curated list of awesome dataset tools.
• [Datasets] Awesome time series database
  • A curated list of time series databases.
• [Datasets] Awesome-Cybersecurity-Datasets
  • A curated list of amazingly awesome Cybersecurity datasets.
• [Datasets] Awesome Robotics Datasets
  • Robotics Dataset Collections.

• [List, Library] Awesome Machine Learning
  • A curated list of awesome machine learning frameworks, libraries and software (by language).
• [List, Library] Awesome production machine learning
  • This repository contains a curated list of awesome open source libraries that will help you deploy, monitor, version, scale, and secure your production machine learning 🚀

• [List, Practice] Awesome Big Data
  • A curated list of awesome big data frameworks, resources and other awesomeness.

• 🌟 Thank you for taking the time to read this far, please leave a STAR if you like this project! 🌟
• 💬 If you find any incorrect/inappropriate/outdated content, please kindly consider opening an issue/PR. 💬
• 💖 We would greatly appreciate your contribution to this list! 💖

Thanks goes to these wonderful people (emoji key):

Zhining Liu 💻 🤔 🚧

yueliu1999 🖋

This project follows the all-contributors specification. Contributions of any kind welcome!