Serious bugs in the ListOps task about long-range-arena HOT 3 CLOSED

Hi,

Yes, we're already aware of this issue and have fixed it in our internal version awhile back. I have yet to mirror this to the external version and will get down to it sometime this week or next.

Thanks for the find. :)

Best,
Yi

from long-range-arena.

Hi,

OK, it's great that you know about this, although it would have been helpful to put a warning somewhere (a "known issues" section in the readme?) so that people don't waste time and resources on it.

Also, I'm curious if the results in your paper are affected by this and whether you are planning to update it.

from long-range-arena.

Oh, I actually see other (closed) issues about this here on GitHub that I overlooked. Perhaps one of them should stay open until this is fixed here? People don't really check closed issues I think.

from long-range-arena.