kmno4-zx / huanhuan-chat Goto Github PK

from peft import PeftModel
from transformers import AutoTokenizer, AutoModel

model_path = "THUDM/chatglm2-6b"
model = AutoModel.from_pretrained(model_path, trust_remote_code=True).half().cuda()
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
# 到这里都没有问题


#   给你的模型加上嬛嬛LoRA! 
model = PeftModel.from_pretrained(model, "output/sft").half()
model.eval()

HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/output/sft/resolve/main/adapter_config.json

The above exception was the direct cause of the following exception:

RepositoryNotFoundError                   Traceback (most recent call last)
    176 try:
--> 177     config_file = hf_hub_download(
    178         model_id,
    179         CONFIG_NAME,
    180         **hf_hub_download_kwargs,
    181     )
    182 except Exception:

File [~/anaconda3/envs/deeplearning/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py:120](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225461726765744d616368696e65227d.vscode-resource.vscode-cdn.net/home/mguo/dl/llm/~/anaconda3/envs/deeplearning/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py:120), in validate_hf_hub_args.._inner_fn(*args, **kwargs)
    118     kwargs = smoothly_deprecate_use_auth_token(fn_name=fn.__name__, has_token=has_token, kwargs=kwargs)
--> 120 return fn(*args, **kwargs)

File [~/anaconda3/envs/deeplearning/lib/python3.8/site-packages/huggingface_hub/file_download.py:1195](https://vscode-remote+ssh-002dremote-002b7b22686f73744e616d65223a225461726765744d616368696e65227d.vscode-resource.vscode-cdn.net/home/mguo/dl/llm/~/anaconda3/envs/deeplearning/lib/python3.8/site-packages/huggingface_hub/file_download.py:1195), in hf_hub_download(repo_id, filename, subfolder, repo_type, revision, library_name, library_version, cache_dir, local_dir, local_dir_use_symlinks, user_agent, force_download, force_filename, proxies, etag_timeout, resume_download, token, local_files_only, legacy_cache_layout)
...
--> 183         raise ValueError(f"Can't find '{CONFIG_NAME}' at '{model_id}'")
    185 loaded_attributes = cls.from_json_file(config_file)
    186 return loaded_attributes["peft_type"]

ValueError: Can't find 'adapter_config.json' at 'output/sft'

{
    "instruction": data[i-1]['dialogure'],
    "input": ,
    "output": data[i]['dialogure']
}