wuch15 / fedkd Goto Github PK
View Code? Open in Web Editor NEWCodes for FedKD
License: MIT License
Codes for FedKD
License: MIT License
1、运行run.py时,报错出现在 tuple index out of range:File "/data/liuqian/FedKD-main/model_bert.py", line 195, in forward word_emb = temp[3][self.nlayer] ;
2、使用的模型为bert-base-uncased,数据为MINDsmall_train;
3、因为temp的长度为3,最大索引为2,在计算 word_emb, word_emb2,word_att会报错tuple index out of range,是不是跟使用的模型有关,如果我使用的bert-base-uncased模型的话,这一块怎么取值?
print(len(temp))#len=3
word_emb = temp[3][self.nlayer]
word_emb2 = temp[3]
word_att=temp[4]
Thanks to the author for making the code open source. But there are some details about the code that I don't quite understand.
latest_local_student_para
, which is not the latest parameter, seems to have been assigned at the beginning and not updated.Line 131 in 6166696
student_update
. The gradient is the difference between the latest weight parameter and the previous weight parameter. But when update a local model parameter, this code replace it directly, right? (Could the gradient be replaced directly with a weight value?)Line 188 in 6166696
Line 246 in 6166696
I'm looking forward to your reply.
Thanks for such a wonderful code.
I have a probem about tnlrv3.
In code:
from tnlrv3.modeling import TuringNLRv3ForSequenceClassification
from tnlrv3.configuration_tnlrv3 import TuringNLRv3Config
from tnlrv3.tokenization_tnlrv3 import TuringNLRv3Tokenizer
In readme, I follow the descripion to find UniLM v2 in Microsoft, but I cannot find any codes includes the imported module above.
Could you please explain what exactly these three modules are imported or where should I go to find them?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.