Giter Club home page Giter Club logo

attention-based-clinical-note-summarization's Introduction

BERTOLOGY-Based-Extractive-Summarization-for-Clinical-Notes

Link to preprint: https://arxiv.org/abs/2104.08942 Link to paper: https://dl.acm.org/doi/abs/10.1145/3477314.3507256

Requirments

  • simpletransformers
  • jsonline
  • seqval
  • tensorboardx
  • transformers
  • Spacy
  • regex
  • Betviz

Demo Version of MIMIC-III

https://physionet.org/content/mimiciii-demo/1.4/

Abstract

In recent years, the trend of deploying digital systems in numerous industries has hiked. The health sector has observed an extensive adoption of digital systems and services that generate significant medical records. Electronic health records contain valuable information for prospective and retrospective analysis that is often not entirely exploited because of the complicated, dense information storage. The crude purpose of condensing health records is to select the information that holds the most characteristics of the original documents based on a reported disease. These summaries may boost diagnosis and save a doctor's time during a saturated workload situation like the COVID-19 pandemic. In this paper, we are applying a multi-head attention-based mechanism to perform extractive summarization of meaningful phrases on clinical notes. Our method finds major sentences for a summary by correlating tokens, segments, and positional embeddings of sentences in a clinical note. The model outputs attention scores that are statistically transformed to extract critical phrases for visualization on the heat-mapping tool and for human use.

image

Vizualization using Neat-Vision

image

if you use this work, or improve this further; please cite this;

@inproceedings{kanwal2022attention,
  title={Attention-based clinical note summarization},
  author={Kanwal, Neel and Rizzo, Giuseppe},
  booktitle={Proceedings of the 37th ACM/SIGAPP Symposium on Applied Computing},
  pages={813--820},
  year={2022}
}

attention-based-clinical-note-summarization's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

attention-based-clinical-note-summarization's Issues

Could we get the code from datasets.py?

Hello, I am trying to reproduce the results. Could we get the code from datasets.py?

I would greatly appreciate it if you could provide answers to the following questions:

  1. Since there are a lot of labels in each note, how did the label be created for fine-tuning?
  2. Since there are different discharge summaries in each admission for each person, did you combined all the discharge summaries in each admission as a combined note?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.