Comments (7)
I've encountered a similar issue, although my training was conducted on the Mosei database. In my case, the test set loss reached its minimum around the second epoch, but the training set loss stopped decreasing around the tenth epoch. However, ACC-2 and ACC-7 both seem to be two points smaller than the results in the paper. And MAE is also two points higher than the results in the paper.I was wondering if you managed to resolve this issue and would greatly appreciate your insights.Thank you very much for your assistance.
from multimodal-infomax.
@sprog1, I have not been able to resolve it and am still waiting to hear from the authors.
from multimodal-infomax.
Hi, @utility-aagrawal and @sprog1 . Could you please try the following value settings and see how it works? Since from my experiment record they show similar good performance as the default settings.
lr_main=2e-4, lr_mmllb=5e-3, alpha=0.1, beta=0.3
lr_main=1e-3, lr_mmllb=5e-3, alpha=0.3, beta=0.1,
lr_main=1e-3, lr_mmllb=5e-3, alpha=0.3, beta=0.1 (default)
lr_main=2e-4, lr_mmllb=1e-3, alpha=0.3, beta=0.3
BTW, which type of GPU do you use? My implementation was on RTXA8000, using different types of GPUs may produce some slight variance.
from multimodal-infomax.
对于MOSI数据集
使用作者提供代码python main.py --dataset mosi --contrast运行
运行结果为
去掉对比学习 运行代码python main.py --dataset mosi
为什么后面这面运行效果要更好一些
from multimodal-infomax.
对于MOSI数据集 使用作者提供代码python main.py --dataset mosi --contrast运行 运行结果为
去掉对比学习 运行代码python main.py --dataset mosi
为什么后面这面运行效果要更好一些
Hi, you need to parse the settings of hyper-paramters as the paper provides. The default setting is different from optimal setting for MOSI. For example, the default lr_main is 1e-3 but best setting for MOSI is 5e-3.
from multimodal-infomax.
from multimodal-infomax.
Could you please try the hps I provided in
#16 (comment)
from multimodal-infomax.
Related Issues (20)
- Question for Forward lld (gaussian prior) and entropy estimation in MMILB Module. HOT 4
- Question about the feature extractor HOT 2
- Why does this issue occur when the GPU is available and the environment is configured properly? HOT 1
- I made the following error when replacing the data set mosi with mosei
- Any details of processing the raw dataset HOT 1
- Can I use this work for just audio and text modalities? HOT 2
- Minimum system requirements to run the MOSEI experiment? HOT 1
- Dataset loading problem HOT 3
- how to use it? HOT 1
- Data download dead link HOT 2
- Gradient disappearance occurs during training HOT 4
- environment HOT 3
- acc/f1 calculation HOT 1
- Using test loss to choose the best model? HOT 4
- about the baseline results HOT 1
- Question about the paper HOT 1
- The sota of MOSET dataset HOT 2
- ValueError: expected sequence of length 50 at dim 1 (got 39)
- About the code of MMILB HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from multimodal-infomax.