Giter Club home page Giter Club logo

extractive_research_slide_generation_using_windowed_labeling_ranking's Introduction

This article is published at the Scientific Scholarly Processing (SDP) 2021 workshop.

Preprocess data

  1. Download the original papers and slides from here and put it in the slide_generator_data directory
  2. data dir structure:
all_test.txt: list of test files
all_train.txt: list of train files
all_val.txt:  list of validation files
train train  val: directories containing the data
*.sents.txt: sentences from the paper extracted by GROBID. Each line represents one sentence.
*.windowed_summarunner_scores.txt: Each line represents the label for the corresponding sentence
  1. You need to download and set the glove word vectors

Train Model

To train the model run:

$CUDA_VISIBLE_DEVICES=0 python3 batch_train.py

If the data_files/vocab.txt and lookup.pkl do not exist it will create the vocab file and lookup table.

Note: To change the training mode from summarunner to windowed_summarunner: change the batch_data_utils.py -> get_article_labels

Test model

  1. Change the cpt (checkpoint) variable in batch_test.py.
  2. Set the name of the output file e.g. predicted_windowed_summarunner.
  3. Run $CUDA_VISIBLE_DEVICES=2 python3 batch_test.py

Evaluate the results

run python3 evaluateROUGE155.py

extractive_research_slide_generation_using_windowed_labeling_ranking's People

Contributors

larxel avatar atharsefid avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.