Giter Club home page Giter Club logo

biomedical's Introduction

BigBIO: Biomedical Dataset Library

BigBIO (BigScience Biomedical) is an open library of biomedical dataloaders built using Huggingface's (๐Ÿค—) datasets library for data-centric machine learning.

Our goals include:

  • Lightweight, programmatic access to biomedical datasets at scale
  • Promoting reproducibility in data processing
  • Better documentation for dataset provenance, licensing, and other key attributes
  • Easier generation of meta-datasets for natural language prompting, multi-task learning

Currently BigBIO provides support for:

  • 126+ biomedical datasets
  • 10+ languages
  • 12 task categories
  • Harmonized dataset schemas by task type
  • Metadata on licensing, coarse/fine-grained task types, domain, and more!

How to Use BigBIO

The preferred way to use these datasets is to access them from the Official BigBIO Hub.

Minimally, ensure you have the datasets library installed. Preferably, install the requirements as follows:

pip install -r requirements.txt.


You can access BigBIO datasets as follows:

from datasets import load_dataset
data = load_dataset("bigbio/biosses")

In most cases, scripts load the original schema of the dataset by default. You can also access the BigBIO split that streamlines access to key information in datasets given a particular task.


For example, the biosses dataset follows a pairs based schema, where text-based inputs (sentences, paragraphs) are assigned a "translated" pair.

from datasets import load_dataset
data = load_dataset("bigbio/biosses", name="biosses_bigbio_pairs")

Generally, you can load your datasets as follows:

# Load original schema
data = load_dataset("bigbio/<your_dataset>")

# Load BigBIO schema
data = load_dataset("bigbio/<your_dataset_here>", name="<your_dataset>_bigbio_<schema_name>")

Check the datacards on the Hub to see what splits are available to you. You can find more information about schemas in Documentation below.

Benchmark Support

BigBIO includes support for almost all datasets included in other popular English biomedical benchmarks.

Task Type Dataset BigBIO (ours) BLUE BLURB BoX DUA needed
NER BC2GM โœ“ โœ“ โœ“
NER BC5-chem โœ“ โœ“ โœ“ โœ“
NER BC5-disease โœ“ โœ“ โœ“ โœ“
NER EBM PICO โœ“ โœ“
NER JNLPBA โœ“ โœ“ โœ“
NER NCBI-disease โœ“ โœ“ โœ“
RE ChemProt โœ“ โœ“ โœ“ โœ“
RE DDI โœ“ โœ“ โœ“ โœ“
RE GAD โœ“ โœ“
QA PubMedQA โœ“ โœ“ โœ“
QA BioASQ โœ“ โœ“ โœ“ โœ“
DC HoC โœ“ โœ“ โœ“ โœ“
STS BIOSSES โœ“ โœ“ โœ“
STS MedSTS * โœ“ โœ“
NER n2c2 2010 โœ“ โœ“ โœ“ โœ“
NER ShARe/CLEF 2013 * โœ“ โœ“
NLI MedNLI โœ“ โœ“ โœ“
NER n2c2 deid 2006 โœ“ โœ“ โœ“
DC n2c2 RFHD 2014 โœ“ โœ“ โœ“
NER AnatEM โœ“ โœ“
NER BC4CHEMD โœ“ โœ“
NER BioNLP09 โœ“ โœ“
NER BioNLP11EPI โœ“ โœ“
NER BioNLP11ID โœ“ โœ“
NER BioNLP13CG โœ“ โœ“
NER BioNLP13GE โœ“ โœ“
NER BioNLP13PC โœ“ โœ“
NER CRAFT * โœ“
NER Ex-PTM โœ“ โœ“
NER Linnaeus โœ“ โœ“
POS GENIA * โœ“
SA Medical Drugs โœ“ โœ“
SR COVID private
SR Cooking private
SR HRT private
SR Accelerometer private
SR Acromegaly private

* denotes dataset implementation in-progress

Documentation

Tutorials

TBA - Links may not be applicable yet!

Contributing

BigBIO is an open source project - your involvement is warmly welcome! If you're excited to join us, we recommend the following steps:

  • Looking for ideas? See our Volunteer Project Board to see what we may need help with.

  • Have your own idea? Contact an admin in the form of an issue.

  • Implement your idea following guidelines set by the official contributing guide

  • Wait for admin approval; approval is iterative, but if accepted will belong to the main repository.

Currently, only admins will be merging all accepted changes to the Hub.

Feel free to join our Discord!

Citing

If you use BigBIO in your work, please cite

@article{fries2022bigbio,
	title = {
		BigBIO: A Framework for Data-Centric Biomedical Natural Language
		Processing
	},
	author = {
		Fries, Jason Alan and Weber, Leon and Seelam, Natasha and Altay,
		Gabriel and Datta, Debajyoti and Garda, Samuele and Kang, Myungsun
		and Su, Ruisi and Kusa, Wojciech and Cahyawijaya, Samuel and others
	},
	journal = {arXiv preprint arXiv:2206.15076},
	year = 2022
}

Acknowledgements

BigBIO is a open source, community effort made possible through the efforts of many volunteers as part of BigScience and the Biomedical Hackathon.

biomedical's People

Contributors

galtay avatar hakunanatasha avatar leonweber avatar jason-fries avatar sg-wbi avatar nomisto avatar sunnnymskang avatar debajyotidatta avatar barthfab avatar wojciechkusa avatar ruisi-su avatar mariosaenger avatar johngiorgi avatar samuelcahyawijaya avatar bwang482 avatar shamikbose avatar giganttheo avatar j-chim avatar stephenbach avatar qanastek avatar danilexn avatar singhay avatar albertvillanova avatar karthikrangasai avatar jdposada avatar trishalaneeraj avatar sidkiblawi avatar s-desh avatar mart1nro avatar hallerpatrick avatar

Stargazers

 avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.