Comments (2)
I think everyday objects need a bit different approach than humans. Here are some of my suggestions.
- Let us try to make the test case as easy as possible. Try to capture images with minimal shadows w.r.t background and make sure to use AE/AF lock. For the cup, the background is the wall and the table. Try to make sure that the backgrounds have a different color from the object, not a white cup in front of a white wall.
- The idea is, for humans we have good priors for how they might look. So we rely on priors + the color difference with the background to matte it out. But note that color difference is not always trustworthy. For objects, segmentation will not be so accurate and for many objects it will not be available at all. So we need to focus more on color difference cues.
- With that in mind, I will try to use the whole of Adobe test dataset and compose it into a background. But the whole data augmentation trick needs to vary. As you want to rely more on color differences apply less perturbation to the background, so the captured background is quite as close to the original background. Since the segmentation mask is gonna be quite inaccurate, apply more erosion-dilation-diffusion. Try to tune these and hyper-parameters to make sure the synthetic data training on Adobe dataset is producing decent enough matting.
- Only then continue finetuning on real data.
I hope this helps. Feel free to discuss your progress and I am happy to assist you.
from background-matting.
Thanks for your suggestions. I'll keep updating the progress here, as and when I get new results.
I'm also trying to train on a dataset of everyday objects that I am manually annotating. Once I'm done with that I will share the dataset.
from background-matting.
Related Issues (20)
- MSCOCO HOT 2
- Can I skip the Alignment step? and How? HOT 1
- issue in JPG inputs HOT 1
- loss log HOT 1
- About the training time HOT 1
- matting performance problem HOT 1
- Real time results with constant background HOT 1
- SAD in the paper
- Evaluation on Synthetic-Composite Adobe Dataset
- [error] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR HOT 1
- Background Image HOT 3
- How to test after training on unlabeled real videos
- Camera Model For Fix-Camera dataset
- 这个对抗损失的意义是什么?怎么理解? HOT 1
- The download link for pre-trained model is failed! HOT 1
- Possible Memory Leak with AdobeDataAffineHR
- 是否可以训练他来分割别的东西,比如说超市商品?
- Could he be trained to split other things, such as supermarket goods?
- Using sample data does not achieve the effect in the paper
- Colab notebook is no longer works HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from background-matting.