Comments (8)
还有个就是pylucene
的api.py
里有一系列org.apache.lucene
,请问这个是咋安装的,因为我的singularity
安装后没法运行,得自己安装包
from fuzi.mingcha.
您好按照你的方式加载模型出错,@Furyton @zwh-sdu 错误如下:
>>> model = AutoModelForCausalLM.from_pretrained(p, trust_remote_code=True) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/data/zhaoyuhang/anaconda3/envs/fuzimingcha/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 487, in from_pretrained raise ValueError( ValueError: Unrecognized configuration class <class 'transformers_modules.fuzi-mingcha-v1_0.configuration_chatglm.ChatGLMConfig'> for this kind of AutoModel: AutoModelForCausalLM. Model type should be one of BartConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BlenderbotConfig, BlenderbotSmallConfig, BloomConfig, CamembertConfig, CodeGenConfig, CpmAntConfig, CTRLConfig, Data2VecTextConfig, ElectraConfig, ErnieConfig, GitConfig, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GPTJConfig, LlamaConfig, MarianConfig, MBartConfig, MegaConfig, MegatronBertConfig, MvpConfig, OpenLlamaConfig, OpenAIGPTConfig, OPTConfig, PegasusConfig, PLBartConfig, ProphetNetConfig, QDQBertConfig, ReformerConfig, RemBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RwkvConfig, Speech2Text2Config, TransfoXLConfig, TrOCRConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, XmodConfig.
您好,感谢您的关注。
这里需要使用 AutoModel
来加载模型,即
from transformers import AutoModel
model = AutoModel.from_pretrained("/path/to/fuzi-mingcha-v1_0", trust_remote_code=True)
from fuzi.mingcha.
您好按照你的方式加载模型出错,@Furyton @zwh-sdu 错误如下:
>>> model = AutoModelForCausalLM.from_pretrained(p, trust_remote_code=True) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/data/zhaoyuhang/anaconda3/envs/fuzimingcha/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 487, in from_pretrained raise ValueError( ValueError: Unrecognized configuration class <class 'transformers_modules.fuzi-mingcha-v1_0.configuration_chatglm.ChatGLMConfig'> for this kind of AutoModel: AutoModelForCausalLM. Model type should be one of BartConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BlenderbotConfig, BlenderbotSmallConfig, BloomConfig, CamembertConfig, CodeGenConfig, CpmAntConfig, CTRLConfig, Data2VecTextConfig, ElectraConfig, ErnieConfig, GitConfig, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GPTJConfig, LlamaConfig, MarianConfig, MBartConfig, MegaConfig, MegatronBertConfig, MvpConfig, OpenLlamaConfig, OpenAIGPTConfig, OPTConfig, PegasusConfig, PLBartConfig, ProphetNetConfig, QDQBertConfig, ReformerConfig, RemBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RwkvConfig, Speech2Text2Config, TransfoXLConfig, TrOCRConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, XmodConfig.您好,感谢您的关注。 这里需要使用
AutoModel
来加载模型,即from transformers import AutoModel model = AutoModel.from_pretrained("/path/to/fuzi-mingcha-v1_0", trust_remote_code=True)
谢谢回复,没注意,习惯用AutoModelForCausalLM
了
还有就是pylucene_task*
的api.py里有一系列org.apache.lucene,请问这个是咋安装的呢
from fuzi.mingcha.
您好,目前我们使用的 lucene
的安装方式确实有些繁琐,我们会在近期采用一版新的检索方案,简化安装过程,更新后会告知您
感谢您的关注和理解。
from fuzi.mingcha.
我整体把项目搭建起来了,通过镜像跑起来之后,用浏览器访问地址报这个错,不知道是访问地址不对还是部署哪里有问题,能帮忙解答下么,或者有没有社群能够讨论?
from fuzi.mingcha.
![]()
我整体把项目搭建起来了,通过镜像跑起来之后,用浏览器访问地址报这个错,不知道是访问地址不对还是部署哪里有问题,能帮忙解答下么,或者有没有社群能够讨论?
您好,这一步部署的只是检索模块,您部署出来的这个地址是在 cli_demo.py 中检索部分请求的地址
即下面这行命令中的 "法条检索对应部署的 pylucene 地址" 和 "类案检索对应部署的 pylucene 地址"
python cli_demo.py --url_lucene_task1 "法条检索对应部署的 pylucene 地址" --url_lucene_task2 "类案检索对应部署的 pylucene 地址"
from fuzi.mingcha.
您好按照你的方式加载模型出错,@Furyton @zwh-sdu 错误如下:
>>> model = AutoModelForCausalLM.from_pretrained(p, trust_remote_code=True) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/data/zhaoyuhang/anaconda3/envs/fuzimingcha/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 487, in from_pretrained raise ValueError( ValueError: Unrecognized configuration class <class 'transformers_modules.fuzi-mingcha-v1_0.configuration_chatglm.ChatGLMConfig'> for this kind of AutoModel: AutoModelForCausalLM. Model type should be one of BartConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BlenderbotConfig, BlenderbotSmallConfig, BloomConfig, CamembertConfig, CodeGenConfig, CpmAntConfig, CTRLConfig, Data2VecTextConfig, ElectraConfig, ErnieConfig, GitConfig, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GPTJConfig, LlamaConfig, MarianConfig, MBartConfig, MegaConfig, MegatronBertConfig, MvpConfig, OpenLlamaConfig, OpenAIGPTConfig, OPTConfig, PegasusConfig, PLBartConfig, ProphetNetConfig, QDQBertConfig, ReformerConfig, RemBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RwkvConfig, Speech2Text2Config, TransfoXLConfig, TrOCRConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, XmodConfig.您好,感谢您的关注。 这里需要使用
AutoModel
来加载模型,即from transformers import AutoModel model = AutoModel.from_pretrained("/path/to/fuzi-mingcha-v1_0", trust_remote_code=True)谢谢回复,没注意,习惯用
AutoModelForCausalLM
了 还有就是pylucene_task*
的api.py里有一系列org.apache.lucene,请问这个是咋安装的呢
您好,我们更新了 ES 检索的部署代码,您可以尝试用 ES 替代 pylucene 进行部署
from fuzi.mingcha.
Related Issues (18)
- how to use HOT 1
- TypeError: slice indices must be integers or None or have an __index__ method HOT 1
- AttributeError: 'ChatGLMTokenizer' object has no attribute 'sp_tokenizer' HOT 3
- 请问你们论文发出来了吗 HOT 2
- 什么时候打算开源? HOT 1
- 请问这个模型是否具备合同审查方面的能力 HOT 1
- 多GPU运行 HOT 7
- 镜像文件格式不对 HOT 1
- position_ids报错:'NoneType' object has no attribute 'max' HOT 4
- 政法大学的伙伴介绍夫子项目,期待一起交流
- ModuleNotFoundError: No module named 'transformers_modules.fuzi' HOT 1
- 法条检索有误 HOT 1
- 想请教下楼主如何基于ChatGLM进行无监督预训练的 HOT 1
- 运行环境的 python 版本是多少呢 HOT 2
- 问下huggingface的模型文件能上传到网盘吗,国内上huggingface拉取不到数据,很难受的。 HOT 4
- 建议修改requirement.txt的transformers版本,transformer按照最新版本4.35.2会出现异常 HOT 1
- UnicodeDecodeError: 'gbk' codec can't decode byte 0xad in position 7: illegal multibyte sequence HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fuzi.mingcha.