Evaluation data from table 1

[BloodLemonS]

How to obtain evaluation data for table 1? The values obtained when testing the DAVIS data of the release model using the provided evaluation.py file differ significantly from those in the paper.

[Paper99]

Just follow our instructions to perform the evaluation.
You may need to check the installed requirements.

[BloodLemonS]

I have checked the installation requirements and found that installing different versions of third-party libraries due to differences in device hardware configuration may result in significant calculation errors?

[Paper99]

We have tested on both 3090 and V100, and the metrics are consistent. Could you please tell me whether you used our mask for evaluation?

[BloodLemonS]

Yes, we conducted the test on the 3070 graphics card using 50 provided test datasets. Except for one dataset with an inf test result, the average PSNR of the other datasets was around 20

[Paper99]

This is very weird. Please carefully check whether the environment configuration is the same as ours. The difference in GPU will not lead to different results.