This is the Fashion IQ challenge submission and leaderboard site. The Fashion IQ challenge features a novel computer vision task: retrieving images by natural language based feedback. Advancement on this task can lead to image search engines with more natural and effective interface and can pave the way towards conversational image search retrieval systems.
Please check the challenge website for more details of the challenge.
Please check the Fashion IQ challenge 2020 website
Sep-30-2019: The challenge is over. Please send your technical report to email@example.com by Oct 5th.
July-20-2019: We released the baseline code for the challenge.
July-16-2019: We are truly sorry that we loss all the entries due to Codalab system failure. The server is now back to normal for submission.
June-15-2019: The dev phase has started. We offer 4k USD for prizes.
June-01-2019: We released the Fashion IQ dataset.
Please leave your comments and questions in the Forum Tab. Our team will respond in a speedy fashion. Alternatively, you can send your questions to firstname.lastname@example.org
The retrieval results are evaluated by recall on the test splits of the dataset. For each of the three fashion categories (dresses, tops, shirts), Recall@10 and Recall@50 will be computed on all test queries. The overall performance is computed by taking the average of Recall@10 and Recall@50 on the three fashion categories.
Please save your results in three files: "dress.predict.json", "toptee.predict.json", "shirt.predict.json" for both the development submission and the test submission. Please zip all three files into one "zip" file and submit it to the leaderboard of the respective phase. For each query, you will only need to keep the top 50 image IDs of the retrieval ranking list, since we only need to compute recall@10 and recall@50.
The submission should use the following format:
The Fashion IQ Dataset: Retrieving Images by Combining Side Information and Relative Natural Language Feedback. Xiaoxiao Guo*, Hui Wu*, Yupeng Gao, Steve Rennie and Rogerio Feris. Arxiv. 2019
Start: June 15, 2019, midnight
Description: In this phase, you can submit the result of validation set and see your rank in leaderboard.
Start: Sept. 1, 2019, midnight
Description: In this phase, you can submit the result of test set and the leaderboard will show the result of testing set.
Sept. 30, 2019, 11:59 p.m.
You must be logged in to participate in competitions.Sign In