I'm new to this challenge. I can see the leaderboard in the results webpage. There are columns such as "inal Score", "SROCC", "PLCC", "Rank1", "Rank2".
How to calculate this metrics for each submission and what are the content requirements of this submission?
Do I need to submit a csv file indicating the file_name and score as shown in train_data.csv?
Or should I submit a prediction script? Where should I upload my model? The submission size is limited to 300 megabyte(s), what is my model is over this limitation?
The only explaination is pointing to a github repo: [https://github.com/lixinustc/KVQ-Challenge-CVPR-NTIRE2024], there is no clue in this repo indicating the "submission" guideline.
I could only see some complicated codes naming train/test. There is even no "predict" demo code.
Could the organizer be more clear about this submission?
Posted by: yw-kw1 @ March 8, 2024, 9:36 a.m.Dear Participant,
Sorry for the late response, the submission example is already depicted in the Page Data. In the development stage, we do not ask to submit the model. It will be uploaded in the submission of the fact sheet.
Best wishes!
Xin Li