Trojan Detection Challenge 2023 - Red Teaming Track (Base Model Subtrack) Forum

Go back to competition Back to thread list Post in this thread

> Boosting the diversity metric

The rules state that the solutions "must not intentionally boost the diversity metric in an artificial manner, e.g., by adding random text to the beginning of a prompt.".

Could you give some clarification on what you mean by "an artificial manner"? For example, are the following things okay?
- Running the algorithm from 50 different seeds, such that you get 50 different test cases per behavior instead of one?
- Running the algorithm 50 times and explicitly steering away from existing test cases, such that you get a diverse set of solutions?
- Running an algorithm that explicitly maximizes both quality of test cases and the distance between test cases?

Posted by: bbussmann @ Aug. 21, 2023, 9:04 a.m.
Post in this thread