birdid / birdidq Goto Github PK

On first run on windows 16Go, the model is succesfully downloded but running a query does not return the expected output. The model asks to rephrase the question. When trying to rerun the model, the following error appears

ValueError: The current 'device_map'  had weights offloaded to the disk. Please provide an 'offload_folder' for them. Alternatively, make sure you have 'safe tensors' installed if the model you are using offers weights in this format

The error seems to indicate that the weights of the model are stored in a file on the computer, rather than in memory. Providing an offload_folder to the from_pretrained function seems to be the fix suggested in the error. But this throws a new error

ValueError: We need an offload_dir to dispatch this model according to this 'device_map', the following submodules need to be offloaded: base_model.model.transformer.h.24, ........

Right now, when getting the expectations from natural language using the Falcon model, enconding call makes tokenizer bind to cuda:0 device. If no CUDA support is avaiable, this call will silently fail, providing no output.

Source code:

https://github.com/elsatch/BirdiDQ/blob/66940942e7405f373264c4f98a9ae3cafa7d321c/great_expectations/models/falcon_model.py#L41

Describe the bug

Trying to run the code locally in a Windows system returns a UnicodeDecodeError when loading the sidebar.

Traceback (most recent call last):
  File "C:\Users\Mi PC\dev\BirdiDQ\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 552, in _run_script
    exec(code, module.__dict__)
  File "C:\Users\Mi PC\dev\BirdiDQ\main_birdi\app.py", line 21, in <module>
    sidebar_content = sidebar_file.read()
  File "C:\Program Files\Python310\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 11: character maps to <undefined>

This problem might be related to the emojis that appear on the sidebar titles.

To Reproduce

Run the command locally in Windows:

streamlit run main_birdi/app.py

Expected behaviour

Running the command would run the application locally without any problem.

Environment (please complete the following information):
Operating system: Windows 10
Great Expectations Version: 0.17.3
Datasource: None
Cloud environment: None