Comments (6)
random_uniform
initializer is commonly used in the NMT literatures. Two very influential works have used the uniform initialization, which we list as follows:
- Sequence to Sequence Learning with Neural Networks
- Google’s Neural Machine Translation System
Unfortunately, there is no theoretical explanations on how to initialize a neural network. Maybe you can read some papers related to VNMT and see how they initialized their networks.
from xmunmt.
Thanks for your quick reply. My question may be misleading.
What I want to know is why 0.08
(how did you get this range), not why uniform
. Could you please explain this?
from xmunmt.
We found it work well and no other reasons. If you have any other questions, I suggest you to send emails to me directly.
from xmunmt.
Fair enough.
I apologize if these too many questions bothered you.
from xmunmt.
You're welcome. I just think that using emails are more appropriate for some questions because it is not an issue of the codes. Some questions are really hard to answer.
from xmunmt.
Yep, I see. When you suggest me to send emails, I realized some of my questions are just too trifling and not critical for the whole project, thus are more suitable to be discussed privately.
For example, "Any benchmark result?" is a good issue, because it's more general and constructive and everyone who wants to use this library may have the same question.
But this issue itself is more specific and is about the very last detail, so it is not a good issue. Too many issues like this will overwhelm the more essential and common ones.
from xmunmt.
Related Issues (15)
- Where can I download the dataset and how to prepare training corpus exactly? HOT 1
- pre-trained models? HOT 1
- [Question] Does dropout layer after word embedding improve neural machine translation? HOT 1
- 我配置好环境了,
- What is the belu value of Chinese English translation?
- Does this model support experiments related to GAN neural machine translation?
- which version of tensorflow used in this system HOT 2
- Any benchmark result? HOT 4
- Questions about source code HOT 2
- What's the minimum memory requirement for the default configuration? HOT 3
- What's the exact command/dataset to reproduce a BLEU of 30.42 on test set? HOT 4
- "casual" or "causal"? HOT 3
- Loss with multiple GPUs HOT 4
- feat: return value of parallel_model is unnatural HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from xmunmt.