Comments (8)
aatmanvaidya
commented on July 19, 2024
A blog from LSE - https://blogs.lse.ac.uk/impactofsocialsciences/2014/05/05/fork-merge-crowdsourcing-data-curation/
list few tools like:
- EpicCollect - https://five.epicollect.net/
from uli.
dennyabrain
commented on July 19, 2024
Great find.
"Free and easy-to-use mobile data-gathering platform." I think we can add "mobile" as a requirement. Could help us understand user requirements with this issue better #255
from uli.
dennyabrain
commented on July 19, 2024
@aatmanvaidya is around till end of day today, I'll take over after that and have a final evaluation of which tool we should go ahead with by Wednesday Nov 8.
from uli.
aatmanvaidya
commented on July 19, 2024
| Tool | Supported On | Sign Up/Login | Open Source | Description | Recommendation |
|---|---|---|---|---|---|
| Google Sheets | PC/Mobile | easy | No | I feel that the since there will be no UI (to select options in checkbox format etc), annotation could be a bit messy to make sense | 3.5/5 |
| Airtable | PC/Mobile | easy (via google supported) | No - but we can test its open source alternative - https://nocodb.com/ | We can create a grid view, where there will be a spreadsheet like option to add metadata for slurs, the best part is, each column can be interactive, meaning we can add checkboxes and radio button making it easeir for users to annotate | 4.5/5 |
| Kobo Tool Box | PC/Mobile | bit of medium difficulty - google is not supported. A user has to fill a form just noticed, the form requires no sign-in, so an external user can fill it up | No | A form has to be filled by users as a part of data collection. - The data is stored in a excel type format, so think of this like google forms and the data being stored in google sheets. - A user will have to enter the slur word that they are annotating. Pre-filled slur words won't be put I guess - Once nice thing is that it supports offline annotation as well. - I think this tool doesn't store the user information of the person filling the form, so we have to explicitly ask for the name of the user. | 4/5 |
| EpiCollect | PC/Mobile | easy (via google supported) | No | same as Kobo - but I think the data annotated is visible to all | 3/5 |
I found few open-source tools, but they needed some tech setup from our side and then I think, hosting was also required, which is a no-go for us, for ex - https://github.com/doccano/doccano, https://github.com/koaning/bulk, https://github.com/HumanSignal/label-studio
Some Relevant Links
from uli.
dennyabrain
commented on July 19, 2024
Take a call on monday.
from uli.
dennyabrain
commented on July 19, 2024
Another tool to evaluate - https://www.kobotoolbox.org/pricing/
from uli.
dennyabrain
commented on July 19, 2024
We'll need to setup the platform in a state that its usable for the contributors by end of this week. Our first sync event is on Nov 27 but best to have it ready before we leave for the IRL trip.
from uli.
dennyabrain
commented on July 19, 2024
@aatmanvaidya has made a google sheet where this will happen. He'll walk us through it today on the planning call. most likely one of us would be incharge of talking people through it on the open call since aatman might be unavailable then.
from uli.
Related Issues (20)
- Timeline for Uli Roadmap HOT 1
- Upgrade the Plugin HOT 1
- Enable Metadata collection on mobile HOT 2
- Expanding to multi-modal HOT 1
- Translated metadata to appear in the language of the slur HOT 1
- Clean up the Slur Dataset HOT 1
- Help manage the Slack channel for the DPG Program: send reminders, messages, homework HOT 1
- Help ideate on Hacktoberfest assistance to DPGs HOT 1
- Archive dashboard HOT 1
- Show Slur Metadata in the webpage HOT 2
- Review DOM diffing/patching techniques HOT 27
- Inject SVG element into DOM HOT 5
- Backlog Initiatives HOT 1
- Data Governance HOT 1
- Continuing Sync Sessions HOT 1
- Partnership sessions/events relevant to the product track HOT 1
- Research/Experiments: Cross-Platform/Federated Responses HOT 1
- Research: Women Candidates' Online Presence HOT 1
- ML Commons- Online Safety Proposal
- Participatory Approaches to Building Datasets on Abuse
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from uli.