lvaleriu / musictagging_msd Goto Github PK

# README
----------------------------------------------------------------------------
* Contact Info *

<Jongpil Lee>
Korea Advanced Institute of Science and Technoloty (KAIST)
Graduate School of Culture Techonology (GSCT)
[email protected]

----------------------------------------------------------------------------
* Description *

This is slightly modifided versions from our submission to the 2017 MIREX audio classification (train/test) tasks.
Used model is based on our previously published paper [https://arxiv.org/abs/1706.06810].
Dataset [https://github.com/jongpillee/music_dataset_split/tree/master/MSD_split]

There are total two functions in this repo.

1. predicting 50 tags using sampleCNN learned from MSD tagging dataset.

2. transfer last hidden layer of the sampleCNN to your new task.
	This function consists of two stage: feature extraction and train/classification.

----------------------------------------------------------------------------
* Platform and Requirements *

<Dependencies>
keras 1.1.0
theano 0.8.2
python 2.7.6

<Python Libraries>
librosa
numpy
sklearn

<input>
30s, 22.05kHz, wav file is expected input 

----------------------------------------------------------------------------
* Use *

1. 50 tag prediction

./ForwardProp.sh -m=prediction /path/to/save/folder /path/to/fileList.txt

Example fileList.txt
/media/bach1/dataset/gtzan/blues/blues.00035.wav	
/media/bach1/dataset/gtzan/blues/blues.00036.wav	
/media/bach1/dataset/gtzan/blues/blues.00037.wav	

{"file_name": "./path/to/save/folder/individual_file_List.json", "prediction_msd": {"beautiful": "0.0206099", "punk": "0.00465381", "indie": "0.0876653", "male vocalists": "0.0211934", "female vocalist": "0.00529418", "heavy metal": "0.00191998", "pop": "0.063148", "sad": "0.015539", "00s": "0.0115924", "ambient": "0.0148107", "alternative": "0.0425866", "hard rock": "0.00436063", "electronic": "0.016531", "blues": "0.143018", "folk": "0.315052", "classic rock": "0.0361686", "alternative rock": "0.00850769", "90s": "0.00585691", "60s": "0.0267258", "indie rock": "0.0129534", "electronica": "0.00600895", "female vocalists": "0.0476008", "easy listening": "0.0104203", "dance": "0.00346507", "funk": "0.00661781", "House": "0.00164513", "80s": "0.00953005", "party": "0.00136872", "Mellow": "0.0486049", "electro": "0.00234408", "chillout": "0.017821", "happy": "0.00424408", "oldies": "0.0182328", "rnb": "0.00878901", "jazz": "0.123137", "70s": "0.0187786", "instrumental": "0.0407893", "indie pop": "0.0125248", "sexy": "0.00269948", "Hip-Hop": "0.00374524", "chill": "0.0139084", "guitar": "0.0837907", "country": "0.0271717", "metal": "0.00198551", "soul": "0.0420783", "catchy": "0.00135911", "rock": "0.118368", "acoustic": "0.203366", "Progressive rock": "0.0103604", "experimental": "0.024019"}}

These json files of file list would be saved in the save folder.



2. get last hidden layer and train svm onto new label dataset

# get last hidden layer
./ForwardProp.sh -m=encoding /path/to/save/folder /path/to/fileList.txt

# train and classification
./TrainAndClassify.sh /path/to/save/folder /path/to/trainListFile.txt /path/to/testListFile.txt /path/to/output
	
Example trainListFile.txt	
/media/bach1/dataset/gtzan/blues/blues.00029.wav	blues
/media/bach1/dataset/gtzan/blues/blues.00030.wav	blues
/media/bach1/dataset/gtzan/blues/blues.00031.wav	blues
/media/bach1/dataset/gtzan/blues/blues.00032.wav	blues
...

Example testListFile.txt
/media/bach1/dataset/gtzan/blues/blues.00035.wav	
/media/bach1/dataset/gtzan/blues/blues.00036.wav	
/media/bach1/dataset/gtzan/blues/blues.00037.wav	
	
Expected output file
/media/bach1/dataset/gtzan/blues/blues.00035.wav	blues
/media/bach1/dataset/gtzan/blues/blues.00036.wav	blues
/media/bach1/dataset/gtzan/blues/blues.00037.wav	blues

---------------------------------------------------------------------------
* Example Usage *
1.
./ForwardProp.sh -m=prediction ./prediction_folder train_list.txt

2.
./ForwardProp.sh -m=encoding ./encoding_folder train_list.txt
./ForwardProp.sh -m=encoding ./encoding_folder test_list.txt
./TrainAndClassify.sh ./encoding_folder train_list.txt test_list.txt output.txt

---------------------------------------------------------------------------