Hello Organizers,
I sometimes (recently more often) get an error with this prompt:
WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap.
Traceback (most recent call last):
File "/tmp/codalab/tmpptU6ir/run/program/evaluate.py", line 73, in <module>
f1_macro_public = f1_score(true_labels_public, predicted_labels_public, average='macro')
File "/opt/conda/lib/python3.9/site-packages/sklearn/metrics/_classification.py", line 1132, in f1_score
return fbeta_score(
File "/opt/conda/lib/python3.9/site-packages/sklearn/metrics/_classification.py", line 1270, in fbeta_score
_, _, f, _ = precision_recall_fscore_support(
File "/opt/conda/lib/python3.9/site-packages/sklearn/metrics/_classification.py", line 1556, in precision_recall_fscore_support
labels = _check_set_wise_labels(y_true, y_pred, average, labels, pos_label)
File "/opt/conda/lib/python3.9/site-packages/sklearn/metrics/_classification.py", line 1357, in _check_set_wise_labels
y_type, y_true, y_pred = _check_targets(y_true, y_pred)
File "/opt/conda/lib/python3.9/site-packages/sklearn/metrics/_classification.py", line 84, in _check_targets
check_consistent_length(y_true, y_pred)
File "/opt/conda/lib/python3.9/site-packages/sklearn/utils/validation.py", line 387, in check_consistent_length
raise ValueError(
ValueError: Found input variables with inconsistent numbers of samples: [2709, 2]
After trying for few times,the same file would eventually go through (sometimes), however it can take a while. In my last 15 submits only 1 went through, which severly paralyses my ability for testing.
Do you know what may cause it?
Sincerely,
Jakub Chojnacki
Apologies for this. Currently a huge number of submissions are going on and since our competition migrates your date from open Leaderboard to the closed one, the submission is failing due to the backend (provided by the platform itself) breaking due to memory usage errors. We are increasing the daily submissions to 50 per day to hopefully balance the failures.
Posted by: OLIVES @ Aug. 11, 2023, 2:09 p.m.