Routing by agreement with Transformer-based for NMT about matrix-capsules-with-em-routing HOT 2 CLOSED

I just came here by random walk on Google.

The idea you proposed seems highly similar to this NAACL paper:
Li, J., Yang, B., Dou, Z.Y., Wang, X., Lyu, M.R. and Tu, Z., 2019, June. Information Aggregation for Multi-Head Attention with Routing-by-Agreement. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 3566-3575).

If you're interested, I also have an NMT paper using capsules and a novel variant of dynamic routing to model better translation context.

Zheng, Z., Huang, S., Tu, Z., DAI, X.Y. and Jiajun, C.H.E.N., 2019, November. Dynamic Past and Future for Neural Machine Translation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 930-940).

from matrix-capsules-with-em-routing.

Yes sir, I have read both papers.

I have difficulty with the implementation and I'm looking for an example.

from matrix-capsules-with-em-routing.