Finetuing the "finetuned" model on custom dataset about mediar HOT 2 CLOSED

Absolutely! It can be further fine-tuned on custom datasets for more specific customization.

However, I'd like to offer some notes for achieving better results:

Fine-tuning on custom datasets improves the model's performance on the new distribution but generally causes the model to partially forget its knowledge of the previous distribution. This extent of forgetting depends on how similar your custom data is to the data used in the pre-training or fine-tuning (challenge datasets in this context).

My first suggestion is to set a small learning rate and a small number of epochs, then observe the overall performance to assess how well the model fits your data.

from mediar.

Let me close this issue for now. Please feel free to reopen it if there are further things to discuss!

from mediar.