[Contribution Request] Align promptflow traces and metrics with OpenLLMetry about promptflow HOT 5 OPEN

Yes. We can align with the convention when it goes stable.

from promptflow.

Thanks @nirga, promptlfow is working on integrate with open telemetry, i.e. to emit trace produced by promptflow and internall call like OpenAI with open telemetry standard.

I wrote an example on this, which is demostrating Tracing LangChain apps using Prompt flow & OpenTelemery. This is not merged yet, so not fully ready for customer use.
In this example, I used the use opentelemetry-instrumentation-langchain package provided by Traceloop. Which is provided by OPenLLMetry I think.

Is this something you epxect to align with?

from promptflow.

Yes, but not just that. Also aligning on the spans created by Promptflow itself:

• Things like prompt and token count
• Sending out the prompt key as an attribute to the OpenAI span
• Sending out workflow and task spans

from promptflow.

Thanks @nirga for reaching out to us. I have some comments in your PR, let's discuss the details there.

from promptflow.

Thanks @zzn2! Afterwards, does it make sense to switch using these here as well?

from promptflow.