Comments (4)
yangheng95
commented on June 12, 2024
MHSA在
Lines 188 to 189 in 1aecbc5
里实现，MHSA编码前会用linear层改变拼接向量的维度。
from lcf-atepc.
BaoChunxiao
commented on June 12, 2024
188行的sa_out = self.bert_SA(cat_out) 我看到了，因为在paper的 3.5. Feature Interactive Learning 里也出现了一个MHSA层(如下图)，我理解188行的MHSA是3.5节的实现。
难道 3.4.2. Context-features Dynamic Mask 里的MHSA 和3.5节里的MHSA是一个意思吗？
from lcf-atepc.
yangheng95
commented on June 12, 2024
你好，这两个MHSA是相同的编码器结构，但是不是同一个。这部分代码我会尽快修复，如果方便的话您也可以帮助发起PR为拼接后的向量添加MHSA编码操作，非常感谢
from lcf-atepc.
Astudnew
commented on June 12, 2024
Why use MHSA two times in section 3.5. Feature Interactive Learning and (section 3.4.2 or 3.4.2) what is the role of MHSA in each layer?
from lcf-atepc.
Related Issues (20)
- 关于数据转换。 HOT 12
- cross validation HOT 1
- Evaluation HOT 1
- The problem of the training on new dataset HOT 8
- pip install -U pyabsa问题 HOT 2
- 掩码长度问题 HOT 20
- 只有cpu可以训练吗？ HOT 6
- 训练模型数据转换错误 HOT 3
- 你好，我试验了你们的这个多任务学习模型，有一些问题想请教。 HOT 3
- evaluation HOT 2
- Regard Dataset HOT 1
- Regrad loss function
- 预测的问题 HOT 1
- Hello, how can I solve this problem? thank you very much HOT 7
- 数据集标签问题 HOT 2
- 用我的数据集做预测时，遇到了一个问题 HOT 17
- LCF
- predicited lable
- pool function
- ATE_test_F1值低 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lcf-atepc.