Implement Docker for testing about llmtest_needleinahaystack HOT 1 OPEN

I like the idea of making improvements around testing but by adding a dockerfile we will only give developers a common dev environment, which would be python:3.12 in your example.

Integration testing can only be done if the user has an API key for the provider and evaluator. I think a good option is to create some GitHub Actions that will load the API keys into the environment through the use of secrets. I believe @gkamradt will have to use his keys and save them as secrets. Here are some resources on what im talking about:

• creating secrets
• using secrets in an action

Unit testing on the other hand is something we can totally tackle and should probably prioritize soon before things get too big.

from llmtest_needleinahaystack.