thmen / egvsr Goto Github PK

Is it possible to use this GAN for real-time video super resolution? Maybe for video conferencing?

You can get them at 百度网盘 (提取码:8tqc)

Ah oh, you are late, and the shared files have been deleted. Please be earlier next time.

Do you only get a good result if you have an HQ video?

I can upscale videos if I have the hq and lq version.
But how can I upscale a video without hq version?

So far I've done it with RealESRGAN, so it's always worked well.
Did I understand it correctly that TecoGan can do it only better, or did I get it vill. wrong?

似乎没有制作 lmdb 的脚本？

I tested your code with Vid4 using your Model EGVSR and the pretrained weight EGVSR_iter420000.pth but got extremely low score. And the generated images are really blurry.Why does it happen?

do you have a colab demo?

Hi :)

Can you please give me more information about how to download the testsets?
I'm not able to understand the language of the website you provided!

Thank you in advice!

Hello,

MSU Graphics & Media Lab Video Group has recently launched two new Super-Resolution Benchmarks.

• Video Upscalers Benchmark: Quality Enhancement determines the best upscaling methods for increasing video resolution and improving visual quality.
• Super-Resolution for Video Compression benchmark aims to test Super-Resolution methods on compressed videos and select the best model for each video codec standard.

Your method achieved 12th place in Super-Resolution for Video Compression Benchmark in 'x265 compression' category. We look forward to your future work!

We would be grateful for your feedback on our work.

I met this problem while I run the test.sh
root@Ic75ba579f00d014e0:/hy-tmp/EGVSR# bash test.sh
./experiments_BD/EGVSR/001/
2022-07-25 15:10:19,482 [INFO]: ========================================
2022-07-25 15:10:19,482 [INFO]: Testing model: EGVSR_iter420000
2022-07-25 15:10:19,482 [INFO]: ========================================
2022-07-25 15:10:23,526 [INFO]: Testing on test1: Vid4
2022-07-25 15:10:24,329 [INFO]: Average
/usr/local/lib/python3.8/dist-packages/numpy/core/fromnumeric.py:3474: RuntimeWarning: Mean of empty slice.
return _methods._mean(a, axis=axis, dtype=dtype,
/usr/local/lib/python3.8/dist-packages/numpy/core/_methods.py:189: RuntimeWarning: invalid value encountered in double_scalars
ret = ret.dtype.type(ret / rcount)
2022-07-25 15:10:24,331 [INFO]: PSNR: nan (x1.0)
2022-07-25 15:10:24,331 [INFO]: LPIPS: nan (x1.0)
2022-07-25 15:10:24,331 [INFO]: tOF: nan (x1.0)
2022-07-25 15:10:24,331 [INFO]: ----------------------------------------
2022-07-25 15:10:24,331 [INFO]: Testing on test2: ToS3
2022-07-25 15:10:25,094 [INFO]: Average
2022-07-25 15:10:25,095 [INFO]: PSNR: nan (x1.0)
2022-07-25 15:10:25,095 [INFO]: LPIPS: nan (x1.0)
2022-07-25 15:10:25,095 [INFO]: tOF: nan (x1.0)
2022-07-25 15:10:25,095 [INFO]: ----------------------------------------
2022-07-25 15:10:25,095 [INFO]: Finish testing
2022-07-25 15:10:25,095 [INFO]: ========================================

So I should do what and I am troubled

How to upscale to 4K video with 30fps as Fig.7 said?

I put some images into dir /data/Vid4/GT for test, but I don't know what's the mean of "data/Vid4/Gaussian4xLR",

python codes/main.py --exp_dir test --mode test --model EGVSR --opt /opt/EGVSR-master/experiments_BD/EGVSR/001/test.yml

2021-07-22 11:01:23,123 [INFO]: ========================================
2021-07-22 11:01:23,123 [INFO]: Testing model: EGVSR_iter420000
2021-07-22 11:01:23,123 [INFO]: ========================================
2021-07-22 11:01:24,793 [INFO]: Testing on test1: Vid4
Traceback (most recent call last):
File "codes/main.py", line 341, in
test(opt)
File "codes/main.py", line 182, in test
test_loader = create_dataloader(opt, dataset_idx=dataset_idx)
File "/opt/daizhsh/EGVSR-master/codes/data/init.py", line 58, in create_dataloader
dataset = PairedFolderDataset(data_opt, scale=opt['scale'])
File "/opt/daizhsh/EGVSR-master/codes/data/paired_folder_dataset.py", line 21, in init
lr_keys = sorted(os.listdir(self.lr_seq_dir))
FileNotFoundError: [Errno 2] No such file or directory: 'data/Vid4/Gaussian4xLR'

Thank you for you reply!

I used Vid4/BDx4/foliage to test egvsr. My cmd line is as below

python codes/main.py --exp_dir ./experiments_BD/EGVSR/001 --mode test --opt test.yml --gpu_id 0 --model TecoGAN

The issue is obvious artifact in the last frame of foliage (please check attachement, in the tree area

)

Due to network limitations in mainland China, we cannot connect to vimeo.com to download the training set, so please provide a link to the VimeoTecoGAN website.Thank you ！！

(open-mmlab) smartcity@smartcity-X780-G30:/media/smartcity/E6AA1145AA1113A1/CaiFeifan/TecoGAN$ python3 dataPrepare.py --start_id 2000 --duration 120 --REMOVE --disk_path /media/smartcity/E6AA1145AA1113A1/CaiFeifan/datasets/VimeoTecoGAN/
[Configurations]:
start_id: 2000
duration: 120
disk_path: /media/smartcity/E6AA1145AA1113A1/CaiFeifan/datasets/VimeoTecoGAN/
summary_dir: /media/smartcity/E6AA1145AA1113A1/CaiFeifan/datasets/VimeoTecoGAN/log/
REMOVE: True
TEST: False
End of configuration
Try loading 308x120.
https://vimeo.com/121649159
[vimeo] 121649159: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/121649159
Skipped invalid link or other error:https://vimeo.com/121649159
https://vimeo.com/40439273
[vimeo] 40439273: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/40439273
Skipped invalid link or other error:https://vimeo.com/40439273
https://vimeo.com/87389090
[vimeo] 87389090: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/87389090
Skipped invalid link or other error:https://vimeo.com/87389090
https://vimeo.com/335874600
[vimeo] 335874600: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/335874600
Skipped invalid link or other error:https://vimeo.com/335874600
https://vimeo.com/114053015
[vimeo] 114053015: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/114053015
Skipped invalid link or other error:https://vimeo.com/114053015
https://vimeo.com/160578133
[vimeo] 160578133: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/160578133
Skipped invalid link or other error:https://vimeo.com/160578133
https://vimeo.com/148058982
[vimeo] 148058982: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/148058982
Skipped invalid link or other error:https://vimeo.com/148058982
https://vimeo.com/150225201
[vimeo] 150225201: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [Errno 110] Connection timed out> (caused by URLError(TimeoutError(110, 'Connection timed out')))
youtube_dl error:https://vimeo.com/150225201
Skipped invalid link or other error:https://vimeo.com/150225201
https://vimeo.com/145096806

Some papers use features before relu activation like ESRGAN, why do you use that after relu activation.

Bash test How should I write the parameters after sh-- exp_ dir ./ experiments_$ {degradation}/${model}/${exp_id}
--mode test
--model ${model}
--opt test. yml
--gpu_ id ${gpu_id}
Can you give me an example? There is no problem with my path. It keeps reminding me that I can't find the file

https://www.bilibili.com/video/BV1rb4y1B7t1/
270p到1080p速度16FPS比论文声称低很多，而且伪影有些大，不知道哪里有问题，还是本身效果实际如此．机器配置RTX2080.

Testing Datasets download link is not working

It's great that you provide elaborate ways to compare this method against previous models on known datasets, but from a practical usability standpoint those script are not very useful...

It would be amazing if you could provide a sample script like
upsample.py --input.mp4 that simply upscales an input video...

Hi. I have tried your code as
bash test.sh "BD" "EGVSR"
I am getting results much lower than the paper"Real-Time Super-Resolution System of 4K-Video Based on Deep Learning" mentioned on the Vid4 Dataset. Here is the screen grab.

Hello,
MSU Graphics & Media Lab Video Group has recently launched Video Super Resolution Benchmark.
We provide a comprehensive comparison of a variety of different VSR models.
You can see our current results: MSU VSR Benchmark.
If you are interested in participating, you can add your algorithm, following the submission steps.
You can read about MSU Graphics & Media Lab Video Group here and here.

I want to scale 1920x1080 video to 3840x2160, do I need change the codes?

The link has expired, can you give me a new download address

I don't understand what the symbol (+) is trying to get the resized residual and the SRNET output done.
When implementing on egvsr_nets.py, there is no clue about performing these things.
Can you explain the flow of the model on details?