ml6team / fondant-usecase-controlnet Goto Github PK

View Code? Open in Web Editor NEW

13.0 3.0 2.0 3.6 MB

Example Fondant pipeline preparing data to train a Controlnet model

Python 23.11% Jupyter Notebook 76.89%

controlnet data-engineering fine-tuning fondant

fondant-usecase-controlnet's People

Contributors

Stargazers

Watchers

Forkers

gitrjaa naykafication

fondant-usecase-controlnet's Issues

`retrieve_from_faiss_by_prompt` fails with pyarrow error

          Now getting this error:

retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:34,502 | root | INFO] Columns of dataframe: ['prompt']
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,037 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,037 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,037 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,037 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,037 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,037 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Scheduler for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:46,038 | distributed.core | INFO] Event loop was unresponsive in Nanny for 8.67s.  This is often caused by long-running GIL-holding functions or moving large chunks of data. This can cause timeouts and instability.
retrieve_from_faiss_by_prompt-1  | Traceback (most recent call last):
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/bin/fondant", line 8, in <module>
retrieve_from_faiss_by_prompt-1  |     sys.exit(entrypoint())
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/cli.py", line 89, in entrypoint
retrieve_from_faiss_by_prompt-1  |     args.func(args)
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/cli.py", line 711, in execute
retrieve_from_faiss_by_prompt-1  |     executor.execute(component)
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/component/executor.py", line 335, in execute
retrieve_from_faiss_by_prompt-1  |     output_manifest = self._run_execution(component_cls, input_manifest)
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/component/executor.py", line 301, in _run_execution
retrieve_from_faiss_by_prompt-1  |     self._write_data(dataframe=output_df, manifest=output_manifest)
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/component/executor.py", line 219, in _write_data
retrieve_from_faiss_by_prompt-1  |     data_writer.write_dataframe(dataframe)
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/component/data_io.py", line 178, in write_dataframe
retrieve_from_faiss_by_prompt-1  |     self._write_dataframe(dataframe)
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/fondant/component/data_io.py", line 219, in _write_dataframe
retrieve_from_faiss_by_prompt-1  |     "id": pa.from_numpy_dtype(dataframe.index.dtype),
retrieve_from_faiss_by_prompt-1  |   File "pyarrow/types.pxi", line 5146, in pyarrow.lib.from_numpy_dtype
retrieve_from_faiss_by_prompt-1  |   File "pyarrow/error.pxi", line 91, in pyarrow.lib.check_status
retrieve_from_faiss_by_prompt-1  | pyarrow.lib.ArrowNotImplementedError: Unsupported numpy type 17
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,706 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:44541'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,706 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,707 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:45303'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,707 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,707 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:46687'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,707 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:37349. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,707 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:32877. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:35397'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:41095'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:34981. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,708 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:39813'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:42657. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:35035'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:45255. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:45171'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,709 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:46381. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:34335'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:41263. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,710 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:46727'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,711 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:38341. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,711 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,711 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,711 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:41217. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,711 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,711 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:45647'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,712 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,712 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:41891'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,712 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:37353. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,712 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,712 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,712 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:37605'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,713 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,713 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,713 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,713 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:33527. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,713 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:34647'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,713 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:33845. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:41997'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:41623. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.nanny | INFO] Closing Nanny at 'tcp://127.0.0.1:42585'. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,714 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:34121. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,715 | distributed.nanny | INFO] Nanny asking worker to close. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,715 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:37079. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,715 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,716 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,716 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,717 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,717 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,718 | distributed.worker | INFO] Stopping worker at tcp://127.0.0.1:46689. Reason: nanny-close
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,720 | distributed.core | INFO] Connection to tcp://127.0.0.1:44241 has been closed.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,724 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56786; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,724 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56860; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,727 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56828; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,728 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56798; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,729 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56832; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,729 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56812; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,730 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56844; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,731 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56804; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,731 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56922; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,732 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56870; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,733 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56914; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,733 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56864; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,734 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56892; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,735 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56898; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,735 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56882; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,737 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:37349', name: 0, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.737107')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,738 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:32877', name: 1, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.73831')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,739 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:34981', name: 2, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7393324')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,740 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:42657', name: 3, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7402878')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,741 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:45255', name: 5, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7412045')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,742 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:46381', name: 4, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7420986')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,742 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:41263', name: 6, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7429159')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,743 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:38341', name: 7, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.743836')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,744 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:41217', name: 8, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.744653')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,745 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:37353', name: 9, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7455142')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,746 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:33527', name: 10, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7463343')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,747 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:33845', name: 11, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7471972')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,748 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:41623', name: 13, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7480104')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,748 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:37079', name: 14, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7488174')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,749 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:34121', name: 12, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.749647')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,750 | distributed.core | INFO] Received 'close-stream' from tcp://127.0.0.1:56904; closing.
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,752 | distributed.scheduler | INFO] Remove worker <WorkerState 'tcp://127.0.0.1:46689', name: 15, status: closing, memory: 0, processing: 0> (stimulus_id='handle-worker-cleanup-1710162827.7522848')
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,752 | distributed.scheduler | INFO] Lost all workers
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:47,754 | distributed.batched | INFO] Batched Comm Closed <TCP (closed) Scheduler connection to worker local=tcp://127.0.0.1:44241 remote=tcp://127.0.0.1:56904>
retrieve_from_faiss_by_prompt-1  | Traceback (most recent call last):
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/distributed/batched.py", line 115, in _background_send
retrieve_from_faiss_by_prompt-1  |     nbytes = yield coro
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/tornado/gen.py", line 767, in run
retrieve_from_faiss_by_prompt-1  |     value = future.result()
retrieve_from_faiss_by_prompt-1  |   File "/opt/conda/lib/python3.10/site-packages/distributed/comm/tcp.py", line 262, in write
retrieve_from_faiss_by_prompt-1  |     raise CommClosedError()
retrieve_from_faiss_by_prompt-1  | distributed.comm.core.CommClosedError
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:48,056 | distributed.scheduler | INFO] Scheduler closing due to unknown reason...
retrieve_from_faiss_by_prompt-1  | [2024-03-11 13:13:48,057 | distributed.scheduler | INFO] Scheduler closing all comms
retrieve_from_faiss_by_prompt-1 exited with code 1
Gracefully stopping... (press Ctrl+C again to force)
service "retrieve_from_faiss_by_prompt" didn't complete successfully: exit 1
Finished pipeline run.

Originally posted by @vpvsankar in #10 (comment)

Fails at Downloading faiss index from hf://datasets/fondant-ai/datacomp-small-clip/faiss

Currently experiencing issues. I run the default code without making any changes. I have attempted on different systems, both local and cloud, I have also tried with GPU and CPU. I get the same error -

Starting pipeline run...
segment_images Pulling
download_images Pulling
caption_images Pulling
retrieve_from_faiss_by_prompt Pulling
generatepromptscomponent Pulling
segment_images Pulled
retrieve_from_faiss_by_prompt Pulled
download_images Pulled
caption_images Pulled
generatepromptscomponent Pulled
Container controlnet-pipeline-generatepromptscomponent-1 Recreate
Container controlnet-pipeline-generatepromptscomponent-1 Recreated
Container controlnet-pipeline-retrieve_from_faiss_by_prompt-1 Recreate
Container controlnet-pipeline-retrieve_from_faiss_by_prompt-1 Recreated
Container controlnet-pipeline-download_images-1 Recreate
Container controlnet-pipeline-download_images-1 Recreated
Container controlnet-pipeline-caption_images-1 Recreate
Container controlnet-pipeline-caption_images-1 Recreated
Container controlnet-pipeline-segment_images-1 Recreate
Container controlnet-pipeline-segment_images-1 Recreated
Attaching to caption_images-1, download_images-1, generatepromptscomponent-1, retrieve_from_faiss_by_prompt-1, segment_images-1
generatepromptscomponent-1 | [2024-03-28 07:37:04,289 | fondant.cli | INFO] Component GeneratePromptsComponent found in module main
generatepromptscomponent-1 | [2024-03-28 07:37:04,292 | fondant.component.executor | INFO] Skipping component execution
generatepromptscomponent-1 | [2024-03-28 07:37:04,293 | fondant.component.executor | INFO] Matching execution detected for component. The last execution of the component originated from controlnet-pipeline-20240328073537.
generatepromptscomponent-1 | [2024-03-28 07:37:04,294 | fondant.component.executor | INFO] Saving output manifest to /artifacts/controlnet-pipeline/controlnet-pipeline-20240328073700/generatepromptscomponent/manifest.json
generatepromptscomponent-1 | [2024-03-28 07:37:04,294 | fondant.component.executor | INFO] Writing cache key with manifest reference to /artifacts/controlnet-pipeline/cache/70ed9242b116d6a0a0af9e074cf8308f.txt
generatepromptscomponent-1 exited with code 0
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:06,311 | faiss.loader | INFO] Loading faiss with AVX2 support.
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:06,327 | faiss.loader | INFO] Successfully loaded faiss with AVX2 support.
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:07,972 | fondant.cli | INFO] Component RetrieveFromFaissByPrompt found in module main
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:07,976 | fondant.component.executor | INFO] Previous component generatepromptscomponent run was cached. Cached pipeline id: controlnet-pipeline-20240328073537
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:07,977 | fondant.component.executor | INFO] No matching execution for component detected
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:07,977 | root | INFO] Executing component
retrieve_from_faiss_by_prompt-1 | [2024-03-28 07:37:07,977 | main | INFO] Downloading faiss index from hf://datasets/fondant-ai/datacomp-small-clip/faiss
retrieve_from_faiss_by_prompt-1 | Traceback (most recent call last):
retrieve_from_faiss_by_prompt-1 | File "/opt/conda/bin/fondant", line 8, in
retrieve_from_faiss_by_prompt-1 | sys.exit(entrypoint())
retrieve_from_faiss_by_prompt-1 | File "/opt/conda/lib/python3.10/site-packages/fondant/cli.py", line 89, in entrypoint
retrieve_from_faiss_by_prompt-1 | args.func(args)
retrieve_from_faiss_by_prompt-1 | File "/opt/conda/lib/python3.10/site-packages/fondant/cli.py", line 711, in execute
retrieve_from_faiss_by_prompt-1 | executor.execute(component)
retrieve_from_faiss_by_prompt-1 | File "/opt/conda/lib/python3.10/site-packages/fondant/component/executor.py", line 335, in execute
retrieve_from_faiss_by_prompt-1 | output_manifest = self._run_execution(component_cls, input_manifest)
retrieve_from_faiss_by_prompt-1 | File "/opt/conda/lib/python3.10/site-packages/fondant/component/executor.py", line 290, in _run_execution
retrieve_from_faiss_by_prompt-1 | state = component.setup()
retrieve_from_faiss_by_prompt-1 | File "/component/src/./main.py", line 65, in setup
retrieve_from_faiss_by_prompt-1 | cluster = LocalCluster(
retrieve_from_faiss_by_prompt-1 | File "/opt/conda/lib/python3.10/site-packages/distributed/deploy/local.py", line 251, in init
retrieve_from_faiss_by_prompt-1 | workers = {i: worker for i in range(n_workers)}
retrieve_from_faiss_by_prompt-1 | TypeError: 'float' object cannot be interpreted as an integer
retrieve_from_faiss_by_prompt-1 exited with code 1
Finished pipeline run.
service "retrieve_from_faiss_by_prompt" didn't complete successfully: exit 1

How do I read data from the dataset I created?

Update Controlnet example with new dataset and pipeline interface

We have to change the example pipeline and the notebook tutorial after the implementation of the redesigned dataset and interface.

Getting error in 'retrieve_laion_by_prompt'

I am getting below error while running the pipeline. How to fix this issue?

retrieve_laion_by_prompt-1 | [2024-02-11 14:30:07,636 | root | INFO] Writing data...
[########################## ] | 65% Completed | 801.64 ms
retrieve_laion_by_prompt-1 | Traceback (most recent call last):
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/requests/models.py", line 971, in json
retrieve_laion_by_prompt-1 | return complexjson.loads(self.text, **kwargs)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/json/init.py", line 357, in loads
retrieve_laion_by_prompt-1 | return _default_decoder.decode(s)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/json/decoder.py", line 337, in decode
retrieve_laion_by_prompt-1 | obj, end = self.raw_decode(s, idx=_w(s, 0).end())
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/json/decoder.py", line 355, in raw_decode
retrieve_laion_by_prompt-1 | raise JSONDecodeError("Expecting value", s, err.value) from None
retrieve_laion_by_prompt-1 | json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
retrieve_laion_by_prompt-1 |
retrieve_laion_by_prompt-1 | During handling of the above exception, another exception occurred:
retrieve_laion_by_prompt-1 |
retrieve_laion_by_prompt-1 | Traceback (most recent call last):
retrieve_laion_by_prompt-1 | File "/usr/local/bin/fondant", line 8, in
retrieve_laion_by_prompt-1 | sys.exit(entrypoint())
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/cli.py", line 89, in entrypoint
retrieve_laion_by_prompt-1 | args.func(args)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/cli.py", line 711, in execute
retrieve_laion_by_prompt-1 | executor.execute(component)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/component/executor.py", line 379, in execute
retrieve_laion_by_prompt-1 | output_manifest = self._run_execution(component_cls, input_manifest)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/component/executor.py", line 345, in _run_execution
retrieve_laion_by_prompt-1 | self._write_data(dataframe=output_df, manifest=output_manifest)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/component/executor.py", line 265, in _write_data
retrieve_laion_by_prompt-1 | data_writer.write_dataframe(dataframe, self.client)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/component/data_io.py", line 179, in write_dataframe
retrieve_laion_by_prompt-1 | dd.compute(write_task, scheduler=dask_client)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/base.py", line 599, in compute
retrieve_laion_by_prompt-1 | results = schedule(dsk, keys, **kwargs)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/threaded.py", line 89, in get
retrieve_laion_by_prompt-1 | results = get_async(
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/local.py", line 511, in get_async
retrieve_laion_by_prompt-1 | raise_exception(exc, tb)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/local.py", line 319, in reraise
retrieve_laion_by_prompt-1 | raise exc
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/local.py", line 224, in execute_task
retrieve_laion_by_prompt-1 | result = _execute_task(task, data)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/core.py", line 119, in _execute_task
retrieve_laion_by_prompt-1 | return func((_execute_task(a, cache) for a in args))
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/optimization.py", line 990, in call
retrieve_laion_by_prompt-1 | return core.get(self.dsk, self.outkey, dict(zip(self.inkeys, args)))
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/core.py", line 149, in get
retrieve_laion_by_prompt-1 | result = _execute_task(task, cache)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/core.py", line 119, in _execute_task
retrieve_laion_by_prompt-1 | return func((_execute_task(a, cache) for a in args))
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/utils.py", line 73, in apply
retrieve_laion_by_prompt-1 | return func(*args, **kwargs)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/dask/dataframe/core.py", line 7023, in apply_and_enforce
retrieve_laion_by_prompt-1 | df = func(*args, **kwargs)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/fondant/component/executor.py", line 539, in wrapped_transform
retrieve_laion_by_prompt-1 | dataframe = transform(dataframe)
retrieve_laion_by_prompt-1 | File "/component/src/./main.py", line 69, in transform
retrieve_laion_by_prompt-1 | loop.run_until_complete(async_query())
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
retrieve_laion_by_prompt-1 | return future.result()
retrieve_laion_by_prompt-1 | File "/component/src/./main.py", line 66, in async_query
retrieve_laion_by_prompt-1 | for response in await asyncio.gather(*futures):
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
retrieve_laion_by_prompt-1 | result = self.fn(*self.args, **self.kwargs)
retrieve_laion_by_prompt-1 | File "/component/src/./main.py", line 45, in query
retrieve_laion_by_prompt-1 | results = self.client.query(text=prompt)
retrieve_laion_by_prompt-1 | File "/component/src/./clip_client.py", line 94, in query
retrieve_laion_by_prompt-1 | return self.search_knn_api(text=text)
retrieve_laion_by_prompt-1 | File "/component/src/./clip_client.py", line 141, in search_knn_api
retrieve_laion_by_prompt-1 | return requests.post(
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/requests/models.py", line 975, in json
retrieve_laion_by_prompt-1 | raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
retrieve_laion_by_prompt-1 | requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
retrieve_laion_by_prompt-1 | [2024-02-11 14:30:09,934 | asyncio | ERROR] Future exception was never retrieved
retrieve_laion_by_prompt-1 | future: <Future finished exception=JSONDecodeError('Expecting value: line 1 column 1 (char 0)')>
retrieve_laion_by_prompt-1 | Traceback (most recent call last):
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/requests/models.py", line 971, in json
retrieve_laion_by_prompt-1 | return complexjson.loads(self.text, **kwargs)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/json/init.py", line 357, in loads
retrieve_laion_by_prompt-1 | return _default_decoder.decode(s)
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/json/decoder.py", line 337, in decode
retrieve_laion_by_prompt-1 | obj, end = self.raw_decode(s, idx=_w(s, 0).end())
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/json/decoder.py", line 355, in raw_decode
retrieve_laion_by_prompt-1 | raise JSONDecodeError("Expecting value", s, err.value) from None
retrieve_laion_by_prompt-1 | json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
retrieve_laion_by_prompt-1 |
retrieve_laion_by_prompt-1 | During handling of the above exception, another exception occurred:
retrieve_laion_by_prompt-1 |
retrieve_laion_by_prompt-1 | Traceback (most recent call last):
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
retrieve_laion_by_prompt-1 | result = self.fn(*self.args, **self.kwargs)
retrieve_laion_by_prompt-1 | File "/component/src/./main.py", line 45, in query
retrieve_laion_by_prompt-1 | results = self.client.query(text=prompt)
retrieve_laion_by_prompt-1 | File "/component/src/./clip_client.py", line 94, in query
retrieve_laion_by_prompt-1 | return self.search_knn_api(text=text)
retrieve_laion_by_prompt-1 | File "/component/src/./clip_client.py", line 141, in search_knn_api
retrieve_laion_by_prompt-1 | return requests.post(
retrieve_laion_by_prompt-1 | File "/usr/local/lib/python3.8/site-packages/requests/models.py", line 975, in json
retrieve_laion_by_prompt-1 | raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
retrieve_laion_by_prompt-1 | requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Gracefully stopping... (press Ctrl+C again to force)
service "retrieve_laion_by_prompt" didn't complete successfully: exit 1

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.