Giter Club home page Giter Club logo

klue-level2-nlp-09's Introduction

KLUE Relation Extraction Competition, Naver Boostcamp AI Tech 2기

Competition Abstract

🤗 KLUE RE(Relation Extraction) Dataset으로 주어진 문장의 지정된 두 Entity의 관계를 추출, 분류하는 Task.
🤗 Public, Private 데이터가 분리된 Leaderboard 평가가 이루어짐.
🤗 하루 10회로 모델 제출 제한

Our solutions

  • 'klue/roberta-large' with BiLSTM
  • Modify Input format
    • Typed Entity Marker with Punctuation
    • Add Query like Question and Answering
  • Augmentation
    • Subject & Object Entity Random Masking
    • AEDA
    • Random Delete
    • Entity swap
  • Ensemble
    • Stratified K-Fold & OOF(Out-of-Fold) Prediction
    • K-fold Ensemble via weighted soft voting

최종 순위 2등!


Docs

Quickstart

Installation

pip install -r requirements.txt

Train model

# default wandb setting in train.py
run = wandb.init(project= 'klue', entity= 'quarter100', name= f'KFOLD_{fold}_{args.wandb_path}')
python train.py

Models are saved in "./best_model/".

Inference

python inference_fold.py

Prediction csv files are saved in "./prediction".

Ensemble

python vote.py

Ensemble result is saved in "./prediction/submission_fold_total.csv".

klue-level2-nlp-09's People

Contributors

naem1023 avatar danny980521 avatar minji-o-j avatar jay-ppark avatar rockmiin avatar donggunseo avatar keemdy avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.