krishnap25 / mauve-experiments Goto Github PK

View Code? Open in Web Editor NEW

34.0 34.0 10.0 95 KB

Python 74.18% Shell 6.29% Makefile 0.29% C++ 9.87% Jupyter Notebook 9.37%

mauve-experiments's People

Contributors

Stargazers

Watchers

Forkers

tpimentelms chenming-wu ivnle john-hewitt tommytyc hmthanh nostalgebraist redzgn chenchenygu satyam-cyc

mauve-experiments's Issues

Code for computing human correlation

Hey y'all, just wondering if you'd be willing to share the code you used to compute the correlation between various metrics and human judgment (section 4.3 of the MAUVE paper)?

local_scripts/make_output_dirs.sh

"local_scripts/make_output_dirs.sh" is missing an extra done

mauve_generation data is empty for folder gpt-medium and gpt-xl?

Hi I downloaded the folder using the google drive link, and the compressed size is 992.1M and uncompressed 2.16G. But the folders for gpt-medium and xl are empty. Could you please check this and rectify the issue if possible?

Many thanks,
Léo

Download data script

Current is:
bash local_scripts/download_data.py

But should be changed to:
python local_scripts/download_data.py

Access to samples

Hi all!
Would it be possible to have access to the generated text samples?
Making them public would remove the burden of running continuations generation and would make reproducibility only tied to computing MAUVE and other metrics.

Recommend Projects