Hi,
I keep getting the following dataloader error when I run the DPO code:
Traceback (most recent call last): File "/home/ml/users/---/research/learning_from_preferences/rlhf_starter_code/rlhf/dpo_falcon.py", line 114, in <module> dpo_trainer.train() File "/home/ml/users/---/anaconda3/envs/trl/lib/python3.9/site-packages/transformers/trainer.py", line 1885, in train return inner_training_loop( File "/home/ml/users/---/anaconda3/envs/trl/lib/python3.9/site-packages/transformers/trainer.py", line 2178, in _inner_training_loop for step, inputs in enumerate(epoch_iterator): File "/home/ml/users/----/anaconda3/envs/trl/lib/python3.9/site-packages/accelerate/data_loader.py", line 454, in __iter__ current_batch = next(dataloader_iter) File "/home/ml/users/----/anaconda3/envs/trl/lib/python3.9/site-packages/torch/utils/data/dataloader.py", line 631, in __next__ data = self._next_data() File "/home/ml/users/----/anaconda3/envs/trl/lib/python3.9/site-packages/torch/utils/data/dataloader.py", line 675, in _next_data data = self._dataset_fetcher.fetch(index) # may raise StopIteration File "/home/ml/users/----/anaconda3/envs/trl/lib/python3.9/site-packages/torch/utils/data/_utils/fetch.py", line 54, in fetch return self.collate_fn(data) File "/home/ml/users/----/anaconda3/envs/trl/lib/python3.9/site-packages/trl/trainer/utils.py", line 338, in __call__ to_pad = [torch.LongTensor(ex[k]) for ex in features] File "/home/ml/users/----/anaconda3/envs/trl/lib/python3.9/site-packages/trl/trainer/utils.py", line 338, in <listcomp> to_pad = [torch.LongTensor(ex[k]) for ex in features] TypeError: an integer is required (got type NoneType) 0%| | 0/50 [00:00<?, ?it/s]