Failed to run the training example about pick-benchmark HOT 4 CLOSED

Hi, thanks for figuring this out. I'll update the repository to reflect this but it will take a few days until I get around to this.

from pick-benchmark.

My current solution: replace GPUstatsMonitor with DeviceStatsMonitor.
Lightning-AI/pytorch-lightning#9032

from pick-benchmark.

Hi, @yetinam,
Thanks for developing this amazing project. However, after a few tests of changing package dependencies, I still can't successfully install this repo (it will raise the error at line from benchmark import models ). My question is: Instead of trying to fix the dependencies, is it possible to write some scripts to load these pre-trained model weights (e.g., cross-domain training results) to SeisBench (to test or train on a new dataset) and use the evaluation modules provided in this repo to evaluate the new results? In another word, if the dependencies problem cannot be fixed shortly, do you think it's possible to merge part of the codes to SeisBench? Any suggestions are welcome!

from pick-benchmark.

Hi @maihao14 ,

sorry for not following up on this before. The issue above should now be fixed. It was a problem with the version of torchmetrics. Please rerun pip install -r requirements.txt and check if this solves your issue too. Otherwise, please reopen the issue and provide the full error trace.

Regarding the suggestion to include this in SeisBench, all the model weights are already part of SeisBench. These are the ones that are loaded through from_pretrained. However, we only use the ones with the optimal learning rate, so you won't get access to the others. Regarding evaluation, I'm very hesitant to include it into SeisBench. SeisBench is more a library for the tools but not for the actual script for training an evaluation. So I'd rather fix this repository.

from pick-benchmark.