Comments (4)
hi @CodeFree-xzk , thanks for your feedback! currently, we have not exposed such API to get the node or line level information; but these informations are already stored locally, so it's possible to collect them from the disk - let me briefly introduce that:
- for each run, you can get its output path from run object; by default, it's a path under
~/.promptflow/.runs
, named with its run name, and you can get its precise value via CLI commandpf run show --name <run>
- navigate to that folder, there will be two folders
node_artifacts
andflow_artifacts
, which contains the informations about nodes and lines. there are same numbers of JSON files as the lines, each one corresponds to a line, and you can get what you expect (status, output and something else) from those files. - then it's your turn to collect what you need and transform them with your magic!
besides, we are working on some new features related to line level metrics with telemetry, which will expose some APIs to retrieve something related to your ask; but I cannot get you a precise timeline for now.
please take a look on the collection from run local storage first, and feel free to let me know if that does not work fine with your case, and I can explain more on what we are doing.
from promptflow.
Thank you for your suggestion! However, if I run the flow in web UI, where can I find the output file?
from promptflow.
Thank you for your suggestion! However, if I run the flow in web UI, where can I find the output file?
oh, I didn't realize we are talking about the runs in Azure - sorry about that.
for runs in Azure, those artifacts are persisted in Azure blob storage, which can be a little bit difficult to traverse, however, we have a feature that enable you to download all the artifacts from Azure to local, after that, you can do what I suggested above; you can refer to this doc: pfazure run download for more detail.
from promptflow.
Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!
from promptflow.
Related Issues (20)
- [BUG] Fallback to DefaultAzureCredential isn't compatible with AzureDeveloperCliCredential HOT 1
- [BUG] UnicodeEncodeError during evaluation HOT 5
- [BUG] pf connection create complains that creating an AI connection can't be done from PromptFlow HOT 7
- [BUG] Serving UI doesn't return flow result HOT 9
- [BUG] prompty-quickstart.ipynb run evaluation not working due to RuntimeError HOT 2
- [Feature Request] JSON formatted Logs HOT 1
- chat pdf viewer code release? HOT 2
- [BUG] AI Search connection in `mlindex_content` not detected HOT 8
- [BUG] Connection for Azure OpenAI not working when following README procedure HOT 2
- [Feature Request]Export the eval result. HOT 4
- [BUG] Cannot resolve connection value from OS environments HOT 4
- [Feature Request] Remove Flask/FastAPI from promptflow-core dependencies? HOT 2
- [BUG] OTLP metrics error on export HOT 2
- [BUG] Setting OTEL_EXPORTER_OTLP_ENDPOINT causes export error HOT 3
- [BUG] LLM tool reports error code: 422 with Mistral-large HOT 3
- How do I use a different Python version for my custom promptflow runtime on AML? HOT 6
- [Feature Request] Add button to force restart promptflow server HOT 1
- [Feature Request] add native support to integrated vectorization query in Azure AI Search, when index lookup (node)
- [BUG] promptflow 1.11.0 raises IndexError: list index out of range HOT 2
- [Feature Request] Enable search filters and search params in Index Lookup tool HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from promptflow.