What is the maximum no. of decimals when considering spearman correlations in the evaluation script?
Posted by: natgillin @ Aug. 17, 2023, 3:25 a.m.Also, relating to the evaluation schema, are the submission's scores clip to [0, 100] if the scores reported below 0 or above 100? Or would that allow the spearman correlation to take the higher difference to reflect "more confidence", e.g. when the model reports -10000 instead of 0 or 99999 instead of 100?
Posted by: natgillin @ Aug. 17, 2023, 3:35 a.m.