Giter Club home page Giter Club logo

awesome-deepfakes-1's Introduction

All about Deepfakes

Catalogue

1 Deepfakes survey

2 Deepfakes Datasets

Datasets Year Ratio
tampered:original
Total videos Source Participants Consent Tools
UADFV 2018 1 : 1.00 98 YouTube N FakeAPP
FaceForensics 2018 1 : 1.00 2008 YouTube N Face2Face
Deepfake-TIMIT 2019 1 : 1.00 620 Vid-TIMIT N faceswap-GAN
FaceForensics++ 2019 1 : 0.25 5000 YouTube N faceswap
DeepFake
Face2Face
NeuralTextures
DeepFakeDetection
(part of FaceForensics++)
2019 1 : 0.12 3363 Actors Y
Celeb-DF 2019 1 : 0.51 1203 YouTube N a refined version of the DeepFake
DFDC Preview Dataset 2019 1 : 0.28 5214 Actors Y Unkonwn

3 Deepfake Creation

3.1 Face-swapping methods

Year Publications
2017 ICCV Fast Face-Swap Using Convolutional Neural Networks
2018 FG On Face Segmentation, Face Swapping, and Face Perception
2019 ICCV FSGAN: Subject Agnostic Face Swapping and Reenactment
2020 CVPR(Oral) FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping

3.2 Face reenactment methods

Year Publications
2014 ICPR Face Anti-spoofing Based on General Image Quality Assessment
2015 TIFS Face spoof detection with image distortion analysis.
2016 CVPR Face2Face: Real-Time Face Capture and Reenactment of RGB Videos
2018 TOG HeadOn: Real-time Reenactment of Human Portrait Videos
2017 CVPR Lip reading sentences in the wild
2017 TOG Synthesizing Obama: learning lip sync from audio
2017 TOG Bringing portraits to life
2018 EUSIPCO Speaker inconsistency detection in tampered video
2018 TOG Deep video portraits
2018 arxiv Generative adversarial talking head: Bringing portraits to life with a weakly supervised neural network
2019 ICCV Few-Shot Adversarial Learning of Realistic Neural Talking Head Models
2019 TOG Deferred Neural Rendering: Image Synthesis using Neural Textures
2019 AAAI Oral MMLAB-CUHK Talking Face Generation by Adversarially Disentangled Audio-Visual Representation

4 Deepfake Detection

4.1 Fake image detection

Year Publications
2017 ICSIP Automated face swapping and its detection
2018 IHMS Workshop Fake Faces Identification via Convolutional Neural Network
2018 MIPR Detection of GAN-Generated Fake Images over Social Networks
2018 ISCCC Learning to Detect Fake Face Images in the Wild
2019 CCBR On the Generalization of GAN Image Forensics
2019 aXiv Limits of Deepfake Detection: A Robust Estimation Viewpoint
2019 MDPI AG Deep Fake Image Detection based on Pairwise Learning
2019 IEEE BTAS Multi-task learning for detecting and segmenting manipulated facial images and videos
2021 CVPR Multi-attentional Deepfake Detection

4.2 Fake video detection

4.2.1 Temporal features across frames based ones
Year Publications Classifiers/
Techniques
2018 AVSS Intra-frame and temporal inconsistencies CNN and LSTM
2018 WIFS In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking LRCN
2019 CVPR Workshop Recurrent Convolutional Strategies for Face Manipulation Detection in Videos RCN
4.2.2 Visual artifacts within video frame based methods
Year Publications Classifiers/
Techniques
2017 CVPR Workshop Two-Stream Neural Networks for Tampered Face Detection Two-Stream
2018 WIFS MesoNet: a Compact Facial Video Forgery Detection Network CNN
2018 IMVIP Detection of Deepfake Video Manipulation PRNU
2019 CVPR Workshop Exposing DeepFake Videos By Detecting Face Warping Artifacts VGG16 ResNet50, 101 or 152
2019 ICASSP Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos Capsule networks
2019 ICASSP Exposing Deep Fakes Using Inconsistent Head Poses SVM
2019 WACVW Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations Logistic regression and neural network
2019 IEEE Access Combating Deepfake Videos Using Blockchain and Smart Contracts Blockchain
2019 CVPR Workshops Protecting World Leaders Against Deep Fakes svm, OpenFace2

awesome-deepfakes-1's People

Contributors

qingcsai avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.