batsresearch / alfred Goto Github PK
View Code? Open in Web Editor NEWA system for prompted weak supervision.
License: BSD 3-Clause "New" or "Revised" License
A system for prompted weak supervision.
License: BSD 3-Clause "New" or "Revised" License
Is your feature request related to a problem? Please describe.
Since lm-eval-harness is going to be one of the de facto eval benchmark repo, I believe documenting the way to integrate alfred with it will be great. Since if a person wants to evaluate with Alfred, he/she has to set up the eval scripts/prompt templates by themselves, I believe this can be ameliorated if there's an integration with lm-eval-harness.
Describe the solution you'd like
An extra piece of code that connects both.
Additional context
I will work on this. Welcome any suggestions on how to make this work.
Is your feature request related to a problem? Please describe.
Nope.
Describe the solution you'd like
Since transformers' agents are new, it would be cool to see the integration of transformer agents into Alfred for a wider audience reach. Transformers agents are similar, if I understand Alfred correctly, to the initialization of multimodal agents in Alfred, but Alfred offers other capabilities such as calibrating. Since there will be more and more people using Transformers Agents, it would be great to think about its integration for the next version of Alfred.
Describe alternatives you've considered
N/A
Additional context
N/A
Tentative Usage:
Client.embed(Union[instance, dataset]) -> embedding(s)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.