error in HERV about xtea HOT 9 CLOSED

Hi, for HERV, could you try to run with "-f 1555" instead of "-f 5907".

from xtea.

Hi, I tried "-f 1555" with other default options, but it didn't work too. The job stopped in the middle and the final files are like this.

Last standard out is below.
`Running command: bwa mem -t 8 -T 9 -k 9 -o my_path/tmp/cns/temp_clip.sam.non_polyA.sam /home/sijaewoo/tools/xTea/rep_lib_annotation/consensus/HERV.fa my_path/tmp/cns/candidate_sites_all_clip.fq.non_polyA.fq

Running command: bwa mem -t 8 -T 7 -k 7 -o my_path/tmp/cns/temp_clip.sam.polyA.sam -c 70 /home/sijaewoo/tools/xTea/rep_lib_annotation/consensus/HERV.fa my_path/tmp/cns/candidate_sites_all_clip.fq.polyA.fq

Running command: bwa mem -t 8 -o my_path/tmp/cns/temp_disc.sam /home/sijaewoo/tools/xTea/rep_lib_annotation/consensus/HERV.fa my_path/tmp/cns/candidate_sites_all_disc.fa

/home/sijaewoo/.conda/envs/xtea/lib/python3.6/site-packages/sklearn/externals/joblib/externals/cloudpickle/cloudpickle.py:47: DeprecationWarning: the imp module is deprecated in favour of importlib; see t
he module's documentation for alternative uses
import imp`

from xtea.

Could you post the content of the generated .sh file? Also any error reported?

from xtea.

This is the content of the generated .sh file.

And total standard output and standard error are in this file. Final standard output and final generated files are same as above comment.
test1_xtea_HERV_sdout.txt

from xtea.

Could you post the content of run_xTEA_pipeline.sh?

from xtea.

This is the content of run_xTEA_pipeline.sh.
PREFIX=/home/sijaewoo/test_xtea/test1/HERV/ ############ ############ ANNOTATION=/home/sijaewoo/tools/xTea/rep_lib_annotation/HERV/hg38/hg38_HERV.out REF=/commons/Reference/1000Genomes/GRCh38_full_analysis_set_plus_decoy_hla.fa ANNOTATION1=/home/sijaewoo/tools/xTea/rep_lib_annotation/HERV/hg38/hg38_HERV.out GENE=/home/sijaewoo/gencode/gencode.v38.chr_patch_hapl_scaff.annotation.gff3 BLACK_LIST=null L1_COPY_WITH_FLANK=/home/sijaewoo/tools/xTea/rep_lib_annotation/HERV/hg38/hg38_HERV_copies_with_flank.fa SF_FLANK=null L1_CNS=/home/sijaewoo/tools/xTea/rep_lib_annotation/consensus/HERV.fa XTEA_PATH=/home/sijaewoo/tools/xTea/xtea/ BAM_LIST=${PREFIX}"bam_list.txt" BAM1=${PREFIX}"10X_phased_possorted_bam.bam" BARCODE_BAM=${PREFIX}"10X_barcode_indexed.sorted.bam" TMP=${PREFIX}"tmp/" TMP_CLIP=${PREFIX}"tmp/clip/" TMP_CNS=${PREFIX}"tmp/cns/" TMP_TNSD=${PREFIX}"tmp/transduction/" ############ ############ python ${XTEA_PATH}"x_TEA_main.py" -C --dna -i ${BAM_LIST} --lc 3 --rc 3 --cr 1 -r ${L1_COPY_WITH_FLANK} -a ${ANNOTATION} --cns ${L1_CNS} --ref ${REF} -p ${TMP} -o ${PREFIX}"candidate_list_from_clip.txt" -n 8 --cp /home/sijaewoo/test_xtea/test1/pub_clip/ python ${XTEA_PATH}"x_TEA_main.py" -D --dna -i ${PREFIX}"candidate_list_from_clip.txt" --nd 5 --ref ${REF} -a ${ANNOTATION} -b ${BAM_LIST} -p ${TMP} -o ${PREFIX}"candidate_list_from_disc.txt" -n 8 python ${XTEA_PATH}"x_TEA_main.py" -N --dna --cr 3 --nd 5 -b ${BAM_LIST} -p ${TMP_CNS} --fflank ${SF_FLANK} --flklen 3000 -n 8 -i ${PREFIX}"candidate_list_from_disc.txt" -r ${L1_CNS} --ref ${REF} -a ${ANNOTATION} -o ${PREFIX}"candidate_disc_filtered_cns.txt" python ${XTEA_PATH}"x_TEA_main.py" --gene -a ${GENE} -i ${PREFIX}"candidate_disc_filtered_cns.txt" -n 8 -o ${PREFIX}"candidate_disc_filtered_cns_with_gene.txt"

from xtea.

candidate_disc_filtered_cns_with_gene.txt this one is the final output.

from xtea.

Dear @simoncchu

Thanks a lot for helping with issues and questions, the program works perfectly for LINE1, ALU, and SVA now. But I have the same error mentioned above for HERV. However, job is completed (not failed) and the final output (candidate_disc_filtered_cns_with_gene.txt) is there. I was wondering why VCF file is not made for HERV like other MEIs (such as L1, ALU, and SVA). And how to use the information of candidate_disc_filtered_cns_with_gene.txt file along with those VCF files of other MEIs for downstream analysis?

Thank you for your kind help,

Best regards,

from xtea.

@dr-ashu-geno right now I didn't output the vcf format. As initially, we do not think there are many herv insertions. The current output tells you the positions, maybe you can covert to a simpler version of vcf for now. I'll add the standard output in the next release.

from xtea.