Comments (6)
thanks for your help! I may try the #38 to get familiar with how langcheck render a graph by using plotly dash.
from langcheck.
Hello, I am interested in this project. Is there anyone handle this issue right now? if not I want to handle it.
from langcheck.
Hi @Vela-zz! Feel free to take on this issue. I think it's a bit non-trivial though. Another option to explore is if we can run multiple Plotly servers in one notebook kernel so that there can be multiple interactive charts running at the same time.
from langcheck.
FYI this might be a slightly easier issue to take on: #38
from langcheck.
Is using plotl.js plot the graph and embed them by "display, HTML, Javascript" module from IPython.core.display be an alternative solution for this?
I used BertViz before, they support multi-interacitve plot in one notebook, they plot their graph like this https://github.com/jessevig/bertviz/blob/master/bertviz/model_view.js
https://github.com/jessevig/bertviz/blob/master/bertviz/model_view.py
plot graph using chart.js or d3.js works most of time, but plotly.js is a little bit of weired.
from langcheck.
Thanks for the reference to BertViz! I looked at their head_view
implementation since it includes a dropdown:
IIUC, the frontend stores all of the chart data in const config
on load, and then modifies the chart client-side in JS when the user changes the dropdown.
Plotly is different and runs a Python server where new data is fetched from a Python endpoint every time the user types in the search boxes.
There's pros and cons to each approach. I'm not opposed to switching to a more client-side chart framework, but it would be a pretty major refactoring, so would prefer to see if there's an easier way we can extend Plotly Dash first.
from langcheck.
Related Issues (20)
- Installing tensorflow breaks the transformers library in `test_factual_consistency()` HOT 2
- Fix `NOQA E501` showing up in documentation
- Add "refusal to answer" metric HOT 2
- Visualize thresholds when plotting MetricValueWithThresholds HOT 2
- Fix documentation page title for MetricValue
- Add versions to ReadTheDocs documentation HOT 1
- Support OpenAI >= 1
- Installation problem on Python 3.10 on Apple Silicon Mac
- Eliminate unexpected spaces introduced before periods by `TreebankWordDetokenizer().detokenize()`.
- Allow metrics to run on GPU
- Create langcheck.utils.detect_language() HOT 7
- Add docstrings for object properties so they show up in documentation
- Pin versions for HuggingFace models HOT 5
- Specify langcheck.__version__
- Consider computing German fluency without translating to English
- Improve testing of installation on different machines and python base images
- Document maximum allowed input lengths for each metric
- Split LangCheck into language-specific packages such as `langcheck[ja]`, `langcheck[de]`, etc HOT 4
- Follow up `use_async` option HOT 1
- Improve the stability of metrics by repeated queries
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from langcheck.