참고: https://github.com/deepmind/code_contests
Install bazel and Cloud SDK for gsutil and clone Riegeli.
>> clone https://github.com/deepmind/code_contests
>> cp covert_riegeli2cpp.py code_contests
>> cd code_contests
>> clone https://github.com/google/riegeli
# bazel build 중 'logical_config_python' 관련 에러 발생 시
# export PYTHON2_BIN_PATH="python3"
>> bazel build -c opt :print_names_and_sources
>> cat ../BUILD >> ./BUILD
>> gsutil -m cp -r gs://dm-code_contests /tmp
>> bazel run -c opt \
:convert_riegeli2cpp /tmp/dm-code_contests/*
>> cd ..
>> python make_code_edit_dist.py
>> ./train.sh
# test_file 변수를 바꿔서 데이터 변경
# test_model 변수를 바꿔서 모델 변경
>> ./eval.sh
>> python --FILE test_0
# total = ???, fault = ???, same == ???
# total = ???, fault = fault/total, same = same/total
- Single(이하 S) CodeBERT + Transformer(6 Layers, 이하 6L) *curr.
- S BERT + S CodeBERT + Transformer (6L)
- 2 BERT + S CodeBERT + Transformer(6L)
- N BERT + N CodeBERT + Transformer(6L)