Giter Club home page Giter Club logo

ybayle / ism2017 Goto Github PK

View Code? Open in Web Editor NEW
8.0 4.0 4.0 38.38 MB

Reproducible research code for the experiments presented in our article "Kara1k: a karaoke dataset for cover song identification and singing voice analysis" published at IEEE ISM 2017

Home Page: http://yannbayle.fr/karamir/

License: MIT License

Python 100.00%
yaafe feature-extraction essentia extract-features mir music dataset reproducible-research reproducibility reproducible-science

ism2017's Introduction

IEEE ISM 2017

Reproducible research code for the article published to IEEE ISM 2017 conference:

@inproceedings{Bayle2017,
  author = {Bayle, Yann and Maršík, Ladislav and Rusek, Martin and Robine, Matthias and Hanna, Pierre and Slaninová, Kateřina and Martinovič, Jan and Pokorný, Jaroslav},
  booktitle = {Proceedings of the 19th IEEE International Symposium on Multimedia},
  link = {http://ism2017.asia.edu.tw/december-12/},
  month = {Dec.},
  title = {Kara1k: a karaoke dataset for cover song identification and singing voice analysis},
  year = {2017},
  address={Taichung, Taiwan},
  pages = {1--8}
}

Aim of the paper

  • Propose a novel industrial musical database
  • Cover Song Identification task on the before-mentioned database
  • Singer's Gender Classification task on the before-mentioned database

Tree structure (Description of available files)

  • The folder src/ contains python files necessary to reproduce our algorithm
  • The folder data/ contains a file named filelist.csv that lists for each audio file:
    • the unique identifier
    • the artist name
    • the track name
    • the gender tag (female, male, females, males, mixed)
    • the language tag (en, fr, es, it, de, pt, nl)
    • a boolean indicating if features have been extracted for this audio file by:
      1. YAAFE
      2. Marsyas
      3. Essentia
      4. Vamp
      5. harmony-analyser
  • The folder features/ contains features extracted by
    • bextract from Marsyas with the following command: bextract -mfcc -zcrs -ctd -rlf -flx -ws 1024 -as 898 -sv -fe.

As concerns features extracted by YAAFE, Essentia, Vamp and harmony-analyser they cannot be stored on this github repository because of their inherent size and so are available upon request for direct download. The command used for extracting features with:

  • YAAFE: yaafe -r 22050 -f "mfcc: MFCC blockSize=2048 stepSize=1024" --resample -b output_dir_features input_filename
  • Essentia: essentia-extractors-v2.1_beta2/streaming_extractor_music input_filename output_filename
  • Vamp extracted via harmony-analyser using JNI wrapper:
    • java -jar ha-script.jar -a nnls-chroma:nnls-chroma -s .wav -t 0.07
    • java -jar ha-script.jar -a nnls-chroma:chordino-tones -s .wav -t 0.07
    • java -jar ha-script.jar -a nnls-chroma:chordino-labels -s .wav -t 0.07
    • java -jar ha-script.jar -a qm-vamp-plugins:qm-keydetector -s _wav -t 0.07
  • harmony-analyser with the following commands (note that Vamp plugin analysis was first performed to extract low-level features):
    • java -jar ha-script.jar -a chord_analyser:chord_complexity_distance -s .wav -t 0.07
    • java -jar ha-script.jar -a chroma_analyser:complexity_difference -s .wav -t 0.07
    • java -jar ha-script.jar -a chord_analyser:average_chord_complexity_distance -s .wav -t 0.07
    • java -jar ha-script.jar -a chord_analyser:tps_distance -s .wav -t 0.07
    • java -jar ha-script.jar -a filters:chord_vectors -s .wav -t 0.07
    • java -jar ha-script.jar -a filters:key_vectors -s .wav -t 0.07

ism2017's People

Contributors

lacimarsik avatar ybayle avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.