joshuaebenezer / chipqa Goto Github PK

Hi,

I try to use ChipQA to evaluate the quality of a sequence and I failed. Can you tell me what is wrong in my following steps:
1 - I get a "feature" file after the command
python.exe chipqa_yuv.py --input_file file.yuv --results_file .\result --width 1920 --height 1080 --bit_depth 8 --color_space BT709
2 - I run
python zip_feat_and_scores.py chipqa_apv_features apv_livestream_scores.csv ai
3 - I run
python svr.py ai
4 - I run
python testing.py result.

Last step failed with the error "FileNotFoundError: [Errno 2] No such file or directory: 'LIVE_Livestream_trained_svr.z'"

When I check the code, to produce 'LIVE_Livestream_trained_svr.z', I need to run svr.py with the variable dataset to "onlytrain". But if I apply this change I have another error.

Can you tell me how I can use your software to evaluate my YUV sequence ?

Thanks in advance,
Adrien

Hi Joshua,
I tried to use chipQA to train and test its performance on a CSIQ-VQA database, which is a 480p resolution database.
1 - I run chipqa_yuv.py get the feature file
2 - I run python cleaner_svr.py --score_file /path/to/score.csv --feature_folder feature_folder --train_and_test
I got the all_pred = [33.22243675 49.20781647 50.0144947 41.65980157 41.57749611 40.87659356, 61.43243688 58.08024139 38.79844636 58.73480296 46.18201971 36.00328378, 36.96726173 42.92148637 53.04071207 63.78199282 53.71268326 31.00923555, 43.38495816 44.25350569 43.77634616 44.97062795 44.97958702 44.92278459, 49.21896745 50.34141739 48.01144443 50.7113197 53.70022118 53.09089083, 36.81422243 42.11125906 47.5120631 48.23488525 52.38174794 59.13939887, 43.95188126 40.72350856 39.07306079 39.36255459 38.9502675 37.87678828, 36.04681885 38.40384619 41.65701426 40.27273715 42.31758531 43.51008817, 33.85725812 39.69753213 48.37801187 43.89804409 44.25391719 44.2835234 ]
while all_dmos = [30.96926305 55.12598144 68.47434569 63.19511855 44.82338636 39.05790258, 61.77650141 43.23640628 27.29835247 55.44590755 39.26934316 28.35209766, 29.65262045 41.59899252 55.96629109 71.88924176 34.53450825 17.19991484, 26.41774852 46.88645613 79.15402107 50.65216125 45.56089672 36.8136669, 64.98568555 49.49478196 29.56212976 68.14515278 49.32783463 39.70465263, 29.9807714 40.99972896 58.42660889 85.19789617 53.10270256 24.20572819, 31.1199481 51.57753506 64.18712587 61.9394302 52.56382728 39.07539394, 61.0901873 42.19819949 27.14502109 73.33284815 42.48086625 34.19254771, 26.21587958 40.64126874 52.39742685 70.05419936 42.42780915 26.91805556]
I would get "lib\site-packages\scipy\optimize\minpack.py:834: OptimizeWarning: Covariance of the parameters could not be estimated
category=OptimizeWarning)" several times during this step. And the results of PLCC and SROCC only (0.33308124176152726, 0.3385172479512102).

Can you tell me how to solve this problem and get the right result.

Thanks in advance,
Hugh