Giter Club home page Giter Club logo

awesome-model-transferability-estimation's Introduction

awesome-model-transferability-estimation

A collection of model transferability estimation methods.

This repo is still in progress.

Source-independent

2016

  • Learning to Select Pre-trained Deep Representations with Bayesian Evidence Framework [CVPR]

2019

  • Transferability and Hardness of Supervised Classification Tasks [ICCV]
  • An information theoretic approach to transferability in task transfer learning [ICIP] [Codes]
  • TASK2VEC: Task Embedding for Meta-Learning [ICCV]

2020

  • LEEP: A New Measure to Evaluate Transferability of Learned Representations [ICML] [Slides] [PyTorch]
  • Source Model Selection for Deep Learning in the Time Series Domain [IEEE Access]
  • Ranking and rejecting of pre-trained deep neural networks in transfer learning based on separation index [ArXiv]

2021

  • Ranking Neural Checkpoints [CVPR]
  • LogME: Practical Assessment of Pre-trained Models for Transfer Learning [ICML] [PyTorch]
  • Scalable Diverse Model Selection for Accessible Transfer Learning [NeurIPS] [PyTorch]
  • A linearized framework and a new benchmark for model selection for fine-tuning [ArXiv]

2022

  • Newer is not always better: Rethinking transferability metrics, their peculiarities, stability and performance [ECML PKDD]
  • Frustratingly Easy Transferability Estimation [ICML] [Slides]
  • Transferability Estimation Using Bhattacharyya Class Separability [CVPR]
  • Transferability Metrics for Selecting Source Model Ensembles [CVPR]
  • How stable are Transferability Metrics evaluations? [ECCV] [TensorFlow]
  • Pre-Trained Model Reusability Evaluation for Small-Data Transfer Learning [NeurIPS] [Codes]
  • Pitfalls in Measuring Neural Transferability [NeurIPSW]
  • Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs [JMLR]
  • PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks [ECCV] [Codes]
  • Evidence > Intuition: Transferability Estimation for Encoder Selection [EMNLP]
  • Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space [ECCV]
  • Efficient Semantic Segmentation Backbone Evaluation for Unmanned Surface Vehicles based on Likelihood Distribution Estimation [MSN]
  • Pre-Trained Model Reusability Evaluation for Small-Data Transfer Learning [NeurIPS]

2023

  • Model Spider: Learning to Rank Pre-Trained Models Efficiently [Arxiv]
  • Towards Estimating Transferability using Hard Subsets [ArXiv]
  • Pick the Best Pre-trained Model: Towards Transferability Estimation for Medical Image Segmentation [MICCAI]
  • Transferability Metrics for Object Detection [ArXiv]
  • Fast and Accurate Transferability Measurement by Evaluating Intra-class Feature Variance[ArXiv]
  • ETran: Energy-Based Transferability Estimation [ICCV]
  • How Far Pre-trained Models Are from Neural Collapse on the Target Dataset Informs their Transferability [ICCV]
  • Exploring Model Transferability through the Lens of Potential Energy[ICCV]
  • Unleashing the power of Neural Collapse for Transferability Estimation [ArXiv]
  • Foundation Model is Efficient Multimodal Multitask Model Selector [ArXiv]
  • Towards Robust Multi-Modal Reasoning via Model Selection [ArXiv]
  • Graph-based fine-grained model selection for multi-source domain [PAA]
  • Guided Recommendation for Model Fine-Tuning [CVPR]
  • Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How [ArXiv]
  • Estimating the Transfer Learning Ability of a Deep Neural Networks by Means of Representations [NCMLCR]
  • Efficient Prediction of Model Transferability in Semantic Segmentation Tasks [ICIP]
  • The Performance of Transferability Metrics Does Not Translate to Medical Tasks [MICCAI workshop]
  • How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey [ArXiv]
  • Guided recommendation for model fine-tuning [CVPR]

Source-dependent

2019

  • Representation Similarity Analysis for Efficient Task taxonomy & Transfer Learning [CVPR]
  • Model reuse with reduced kernel mean embedding specification [ArXiv]

2020

  • Duality diagram similarity: a generic framework for initialization selection in task transfer learning [ECCV]

2021

  • A Mathematical Framework for Quantifying Transferability in Multi-source Transfer Learning NeurIPS
  • Transferability Estimation for Semantic Segmentation Task [ArXiv]
  • OTCE: A Transferability Metric for Cross-Domain Cross-Task Representations [CVPR] [Poster]
  • Practical Transferability Estimation for Image Classification Tasks [ArXiv]

2022

  • Transferability-Guided Cross-Domain Cross-Task Transfer Learning [ArXiv]
  • Transferability Estimation Based On Principal Gradient Expectation [ArXiv]

2023

awesome-model-transferability-estimation's People

Contributors

yuhed avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

awesome-model-transferability-estimation's Issues

Inquiry Regarding the Inclusion of Transferability Recovery Articles in Your Survey

Hello,

I would like to inquire about your perspective on a few articles related to transferability in recovery:

DEPARA: Deep Attribution Graph for Deep Knowledge Transferability
DataMap: Dataset Transferability Map for Medical Image Classification
ModelGiF: Gradient Fields for Model Functional Distance
It seems that I haven't seen these articles included in the survey. I'm curious if you've come across these works and what your considerations might be for not incorporating them into the repository.

Thank you for your time and insight.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.