[Feature Request]More Results based on Same Value about promptfoo HOT 3 CLOSED

Thanks for the suggestion, I'll see if I can build in an option to do this. How many times do you think you'd run it to decide if it's stable?

Right now, the easiest way to accomplish what you want is to include the prompt multiple times, either in the same file:

<prompt>
---
<prompt repeated>
---
...

Or by passing it multiple times:

promptfoo -p prompt.txt prompt.txt

from promptfoo.

Hi, I will want to test the same prompt more than three times. And your suggestion is useful for me either.

from promptfoo.

Closing this as the requirement can be met by adding the same prompt several times!

from promptfoo.