Issue about training the supported methods about libfewshot HOT 6 CLOSED

Hi, i didn't meet this error before, could you try run rm -rf /mnt/lustre/gengruoxin/LibFewShot-main/results/SKDModel-miniimagenet-Conv64F-5-1 via bash-compatible shells?

PS: It would be better if you could upload/paste your logs or shell outputs in text format.

from libfewshot.

Hi, i didn't meet this error before, could you try run rm -rf /mnt/lustre/gengruoxin/LibFewShot-main/results/SKDModel-miniimagenet-Conv64F-5-1 via bash-compatible shells?

PS: It would be better if you could upload/paste your logs or shell outputs in text format.

It didn't work. And I have checked that the file doesn't exist when I run the script.
The error message is pasted:

Traceback (most recent call last):
File "/mnt/lustre/gengruoxin/LibFewShot-main/core/utils/utils.py", line 154, in force_symlink
os.symlink(source, symlink)
FileExistsError: [Errno 17] File exists: 'SKDModel-miniimagenet-Conv64F-5-1-Oct-25-2021-17-54-12' -> '/mnt/lustre/gengruoxin/LibFewShot-main/results/SKDModel-miniimagenet-Conv64F-5-1'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "run_skd.py", line 14, in
trainer = Trainer(config)
File "/mnt/lustre/gengruoxin/LibFewShot-main/core/trainer.py", line 46, in init
) = self._init_files(config)
File "/mnt/lustre/gengruoxin/LibFewShot-main/core/trainer.py", line 276, in _init_files
force_symlink(result_dir, symlink_path)
File "/mnt/lustre/gengruoxin/LibFewShot-main/core/utils/utils.py", line 157, in force_symlink
os.remove(symlink)
FileNotFoundError: [Errno 2] No such file or directory: '/mnt/lustre/gengruoxin/LibFewShot-main/results/SKDModel-miniimagenet-Conv64F-5-1'

from libfewshot.

We can't reproduce this error till now, can you upload/paste your config file and the outputs of the shell command ls -alh /mnt/lustre/gengruoxin/LibFewShot-main/results | grep SKD?

from libfewshot.

Hi, you can just comment line 299 and line 307 in core/trainer.py for a temporary solution.

We will try our best to fix this asap.

from libfewshot.

We can't reproduce this error till now, can you upload/paste your config file and the outputs of the shell command ls -alh /mnt/lustre/gengruoxin/LibFewShot-main/results | grep SKD?

Sometimes the error didn't happen.
$ ls -alh /mnt/lustre/gengruoxin/LibFewShot-main/results | grep SKD

lrwxrwxrwx 1 gengruoxin gengruoxin   54 Oct 27 10:41 SKDModel-miniimagenet-Conv64F-5-1 -> SKDModel-miniimagenet-Conv64F-5-1-Oct-27-2021-10-41-14
drwxrwxr-x 4 gengruoxin gengruoxin 4.0K Oct 27 10:41 SKDModel-miniimagenet-Conv64F-5-1-Oct-27-2021-10-41-14
lrwxrwxrwx 1 gengruoxin gengruoxin   54 Oct 27 15:14 SKDModel-miniimagenet-Conv64F-5-5 -> SKDModel-miniimagenet-Conv64F-5-5-Oct-27-2021-15-14-45
drwxrwxr-x 4 gengruoxin gengruoxin 4.0K Oct 27 15:14 SKDModel-miniimagenet-Conv64F-5-5-Oct-27-2021-15-14-45
lrwxrwxrwx 1 gengruoxin gengruoxin   55 Oct 27 15:28 SKDModel-miniimagenet-resnet12-5-1 -> SKDModel-miniimagenet-resnet12-5-1-Oct-27-2021-15-28-43
drwxrwxr-x 4 gengruoxin gengruoxin 4.0K Oct 27 15:28 SKDModel-miniimagenet-resnet12-5-1-Oct-27-2021-15-28-43

And this is the config file for SKD:

includes:
  - headers/data.yaml
  - headers/device.yaml
  - headers/misc.yaml
  - headers/model.yaml
  - headers/optimizer.yaml
  - classifiers/SKD.yaml
  - backbones/Conv64F.yaml


device_ids: 0
way_num: 5
shot_num: 5
query_num: 15
episode_size: 1
train_episode: 100
test_episode: 100

batch_size: 32

save_part:
  - emb_func
  - cls_classifier

classifier:
  name: SKDModel
  kwargs:
    feat_dim: 1600
    num_class: 64
    gamma: 1.0
    alpha: 0.1
    is_distill: False


backbone:
  name: Conv64F
  kwargs:
    is_flatten: True
    is_feature: False
    leaky_relu: False
    negative_slope: 0.2
    last_pool: True
    maxpool_last2: True

from libfewshot.

Hi, we think it may be caused by uncertain behaviors of the OS or file system, we will never create the symlink file after
commit b050c06, you can pull the newest codes to avoid this error.

Feel free to reopen this issue if you meet this error again.

from libfewshot.