Comments (7)
预训练数据相关问题见#27
from eva.
@t1101675 你好,针对小说数据部分,请教几个问题,期待你们的解答:
1.paper中提到对话数据部分来源通用题材的小说,请问主要具体用了哪些题材的?以及小说的对话数据提取出后怎样构造语料的?2.如果进一步采用其他题材小说数据,比如言情/玄幻等,那么闲聊效果会有风格化特点吗?还是需要用GAN系列做风格变换?
from eva.
在EVA2.0上使用kdconv数据进行多卡finetune,参数都是默认,在测试集上loss=4.1119,和你们结果loss=2.09差别有点大
我看默认finetune进行3轮epoch会不会太少了? @t1101675
from eva.
请问训练集和验证集上的结果分别是多少呢?可以检查一下训练出的模型能否正常生成回复。另外,我们使用了8张V100进行 fine-tune,如果您用的卡比我们少,可能会导致 batch size 偏小,因此可能要增加 batch size 或者增加训练 epoch
from eva.
我是在4*V100上finetune,我正在提高batch size和epochs重新finetune
from eva.
请问EVA2.0支持prompt范式吗?设定background和给定sample,让模型prompt learning? @xwwwwww @t1101675
from eva.
不支持
from eva.
Related Issues (20)
- torch multiprocessing api failed HOT 6
- 关于huggingface的finetune前的结果出入 HOT 15
- 请问这些输出是哪里代码打印的? HOT 1
- 请问,我在运行eva_finetune的时候出现了ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 58058) of binary: HOT 6
- finetune的输入长度 HOT 1
- 这个效果是认真的吗?is this result true? HOT 1
- example.py 那里的文件路径放的都是bin的模型吗? HOT 2
- 请问role embeds参数的初始化问题 HOT 6
- error occurred when i run eva_finetune.py HOT 4
- 我停止了思考 HOT 7
- huggingface的 tokenizer报错 HOT 11
- 微调错误RuntimeError: apex.optimizers.FusedAdam requires cuda extensions HOT 4
- huggingface分支代码运行报错问题及解决方法
- 运行交互式评测报错 HOT 1
- 微调报CUDA out of memory错误 HOT 6
- RuntimeError: a leaf Variable... HOT 2
- EVA2.0-xLarge 模型? HOT 2
- 确定现在给出的这个xlarge模型没有问题吗?为什么效果这么差呀,回答都混乱了 HOT 8
- EVA3 HOT 1
- 关于数据过滤 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from eva.