coastalcph / dialog-rl Goto Github PK

Make sure datasets are read correctly and see whether non-identical sets of vocab/embeddigns/etc aren't problematic

We talked about a setup that pretrains on domains D_1 ... D_{n-1} and then finetunes on domain D_n.

This requires loading the datasets separately for those domains. I've rewritten the header of load_dataset() to reflect this. The idea is that domains is a list of strings with domain names -- but if it's just a single string 'all', everything should pass. The function also devises a strict flag that only allows dialogs to pass that are one domain only.

I am trying to run the code like this :

! python run.py --epochs 10 --lr 0.005 --reinforce --gpu 0 --train_domains ['taxi'] --finetune_domains ['train'] --eval_domains ['train'] --path "/content/dialog-rl/Preprocessing/ann/" --outfile "/content/outfile"

And I get this error:

FileNotFoundError: [Errno 2] No such file or directory: '/content/dialog-rl/Preprocessing/ann/emb.json'

there is no data folder but I thought the files are in Preprocessing folder hence the path. Could someone tell me what I am doing wrong? I tried running the preprocess_data.py file but I run into a bunch of errors there too.

e.g. replace with dummy placeholder