Giter Club home page Giter Club logo

absplice's Issues

Can't find cause of the error

AbSplice was launched with the command from tutorial python -m snakemake -j 1 --use-conda from the AbSplice container, installed strictly by instructions in READ.md

End of the output:

[Fri Feb  9 17:37:54 2024]
Error in rule mmsplice_splicemap:
    jobid: 8
    input: ../data/resources/analysis_files/vcf_files/DIV_train_all_annotated.vcf.gz, ../data/resources/downloaded_files/GRCh38.primary_assembly.genome.fa, ../data/resources/downloaded_files/splicemap_hg38/Adipose_Subcutaneous_splicemap_psi5_method=kn_event_filter=median_cutoff.csv.gz, ../data/resources/downloaded_files/splicemap_hg38/Adipose_Subcutaneous_splicemap_psi3_method=kn_event_filter=median_cutoff.csv.gz
    output: ../data/results/hg38/model_scores_from_absplice_features/DIV_train_all_annotated.vcf.gz_MMSplice_SpliceMap.csv

Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
Complete

I think that the VCF file can be the cause of the problem(despite successful annotation by SpliceAI and SPiP). It's attached below (modified extension to txt to upload it on github).
DIV_train_all_annotated.txt

Can you help me to find the cause of the error? Thank you!

Numpy Error appears in Example-Workflow-Execution

Hey guys, thx very much for your tool!

I just wanted to try it out, because it seems really interesting.
However, I stumbled over the following error when I tried to execute the example workflow:

AttributeError: module 'numpy' has no attribute 'object'.

Here the whole output:

Building DAG of jobs...
Creating conda environment ../envs/environment_spliceai_rocksdb.yaml...
Downloading and installing remote packages.
Environment for /home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/splicing_pred/DNA/../../../envs/environment_spliceai_rocksdb.yaml created (location: .snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_)
Using shell: /usr/bin/bash
Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
Job stats:
job                     count    min threads    max threads
--------------------  -------  -------------  -------------
absplice_dna                1              1              1
all                         1              1              1
download_human_fasta        1              1              1
download_splicemaps         1              1              1
mmsplice_splicemap          1              1              1
spliceai                    1              1              1
spliceai_vcf_to_csv         1              1              1
total                       7              1              1

Select jobs to execute...

[Fri May 24 12:42:46 2024]
rule download_splicemaps:
    output: ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi3_method=kn_event_filter=median_cutoff.csv.gz, ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi5_method=kn_event_filter=median_cutoff.csv.gz
    jobid: 2
    reason: Missing output files: ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi3_method=kn_event_filter=median_cutoff.csv.gz, ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi5_method=kn_event_filter=median_cutoff.csv.gz
    wildcards: genome=hg19, tissue=Brain_Cortex
    resources: tmpdir=/tmp

Downloading SpliceMaps...
  0%|                                                                                                                              | 0/98 [00:00<?, ?it/s]../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi5_method=kn_event_filter=median_cutoff.csv.gz
 12%|██████████████▎                                                                                                      | 12/98 [00:02<00:20,  4.26it/s]../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi3_method=kn_event_filter=median_cutoff.csv.gz
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 98/98 [00:06<00:00, 16.23it/s]
[Fri May 24 12:42:54 2024]
Finished job 2.
1 of 7 steps (14%) done
Select jobs to execute...

[Fri May 24 12:42:54 2024]
rule download_human_fasta:
    output: ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa
    jobid: 1
    reason: Missing output files: ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa
    resources: tmpdir=/tmp

--2024-05-24 12:42:54--  https://ftp.ebi.ac.uk/pub/databases/gencode/Gencode_human/release_39/GRCh37_mapping/GRCh37.primary_assembly.genome.fa.gz
Auflösen des Hostnamens proxy.charite.de (proxy.charite.de)… 141.42.5.215
Verbindungsaufbau zu proxy.charite.de (proxy.charite.de)|141.42.5.215|:8080 … verbunden.
Proxy-Anforderung gesendet, auf Antwort wird gewartet … 200 OK
Länge: 869924494 (830M) [application/x-gzip]
Wird in »STDOUT« gespeichert.

-                                       34%[========================>                                                  ] 286,27M  1,99MB/s    ETA-                                      34%[=======================>                                                ] 286,33M  1,9-   -                                  100%[===============================================================>] 829,62M  1,99MB/s    in 7m 3s

2024-05-24 12:49:57 (1,96 MB/s) - auf die Standardausgabe geschrieben [869924494/869924494]

[Fri May 24 12:49:57 2024]
Finished job 1.
2 of 7 steps (29%) done
Select jobs to execute...

[Fri May 24 12:49:57 2024]
rule mmsplice_splicemap:
    input: ../data/resources/analysis_files/vcf_files/example_hg19.vcf.gz, ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa, ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi5_method=kn_event_filter=median_cutoff.csv.gz, ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi3_method=kn_event_filter=median_cutoff.csv.gz
    output: ../data/results/hg19/model_scores_from_absplice_features/example_hg19.vcf.gz_MMSplice_SpliceMap.csv
    jobid: 4
    reason: Missing output files: ../data/results/hg19/model_scores_from_absplice_features/example_hg19.vcf.gz_MMSplice_SpliceMap.csv; Input files updated by another job: ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi3_method=kn_event_filter=median_cutoff.csv.gz, ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa, ../data/resources/downloaded_files/splicemap_hg19/Brain_Cortex_splicemap_psi5_method=kn_event_filter=median_cutoff.csv.gz
    wildcards: genome=hg19, vcf_id=example_hg19.vcf.gz
    resources: tmpdir=/tmp, mem_mb=32000, mem_mib=30518, threads=4

285750it [00:00, 353311.71it/s]
284409it [00:00, 452003.67it/s]
2024-05-24 12:50:25.336222: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  SSE4.1 SSE4.2 AVX AVX2 AVX512F FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
0it [00:00, ?it/s]2024-05-24 12:50:25.684759: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:116] None of the MLIR optimization passes are enabled (registered 2)
2024-05-24 12:50:25.697128: I tensorflow/core/platform/profile_utils/cpu_utils.cc:112] CPU Frequency: 2400000000 Hz
WARNING:tensorflow:5 out of the last 5 calls to <function Model.make_predict_function.<locals>.predict_function at 0x7f2ad8583310> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for  more details.
1it [00:00,  1.62it/s]
[Fri May 24 12:50:27 2024]
Finished job 4.
3 of 7 steps (43%) done
Select jobs to execute...

[Fri May 24 12:50:27 2024]
rule spliceai:
    input: ../data/resources/analysis_files/vcf_files/example_hg19.vcf.gz, ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa
    output: ../data/results/hg19/model_scores_from_absplice_features/example_hg19.vcf.gz_SpliceAI.vcf
    jobid: 6
    reason: Missing output files: ../data/results/hg19/model_scores_from_absplice_features/example_hg19.vcf.gz_SpliceAI.vcf; Input files updated by another job: ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa
    wildcards: genome=hg19, vcf_id=example_hg19.vcf.gz
    resources: tmpdir=/tmp, mem_mb=16000, mem_mib=15259, threads=1, gpu=1

Activating conda environment: .snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_
/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:585: FutureWarning: In the future `np.object` will be defined as the corresponding NumPy scalar.
  np.object,
Traceback (most recent call last):
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/bin/spliceai", line 7, in <module>
    from spliceai.__main__ import main
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/spliceai/__main__.py", line 5, in <module>
    from spliceai.utils import Annotator, get_delta_scores
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/spliceai/utils.py", line 6, in <module>
    from keras.models import load_model
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/keras/__init__.py", line 21, in <module>
    from tensorflow.python import tf2
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/__init__.py", line 41, in <module>
    from tensorflow.python.tools import module_util as _module_util
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/__init__.py", line 46, in <module>
    from tensorflow.python import data
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/__init__.py", line 25, in <module>
    from tensorflow.python.data import experimental
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/experimental/__init__.py", line 97, in <module>
    from tensorflow.python.data.experimental import service
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/experimental/service/__init__.py", line 353, in <module>
    from tensorflow.python.data.experimental.ops.data_service_ops import distribute
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/experimental/ops/data_service_ops.py", line 26, in <module>
    from tensorflow.python.data.experimental.ops import compression_ops
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/experimental/ops/compression_ops.py", line 20, in <module>
    from tensorflow.python.data.util import structure
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/util/structure.py", line 26, in <module>
    from tensorflow.python.data.util import nest
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/data/util/nest.py", line 40, in <module>
    from tensorflow.python.framework import sparse_tensor as _sparse_tensor
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/framework/sparse_tensor.py", line 28, in <module>
    from tensorflow.python.framework import constant_op
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/framework/constant_op.py", line 29, in <module>
    from tensorflow.python.eager import execute
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/eager/execute.py", line 27, in <module>
    from tensorflow.python.framework import dtypes
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py", line 585, in <module>
    np.object,
  File "/home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_/lib/python3.9/site-packages/numpy/__init__.py", line 324, in __getattr__
    raise AttributeError(__former_attrs__[attr])
AttributeError: module 'numpy' has no attribute 'object'.
`np.object` was a deprecated alias for the builtin `object`. To avoid this error in existing code, use `object` by itself. Doing this will not modify any behavior and is safe.
The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
    https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
[Fri May 24 12:50:27 2024]
Error in rule spliceai:
    jobid: 6
    input: ../data/resources/analysis_files/vcf_files/example_hg19.vcf.gz, ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa
    output: ../data/results/hg19/model_scores_from_absplice_features/example_hg19.vcf.gz_SpliceAI.vcf
    conda-env: /home/kuechleo/splice-prediction-tools/absplice/absplice/example/workflow/.snakemake/conda/7b529f67ba9587a5b21fa83be7c2e50e_
    shell:
        spliceai -I ../data/resources/analysis_files/vcf_files/example_hg19.vcf.gz -O ../data/results/hg19/model_scores_from_absplice_features/example_hg19.vcf.gz_SpliceAI.vcf -R ../data/resources/downloaded_files/GRCh37.primary_assembly.genome.fa -A grch37
        (one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)

Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
Complete log: .snakemake/log/2024-05-24T123919.336725.snakemake.log

My set-up: I used the set-up optoin where one uses a Conda-Environment.

My Conda-Env:

conda list
# packages in environment at /home/kuechleo/miniforge3/envs/absplice_env:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
abseil-cpp                20210324.0           h9c3ff4c_0    conda-forge
absl-py                   0.15.0                   pypi_0    pypi
absplice                  0.0.1                     dev_0    <develop>
aioeasywebdav             2.4.0           py38h578d9bd_1001    conda-forge
aiohttp                   3.9.5            py38h01eb140_0    conda-forge
aiosignal                 1.3.1              pyhd8ed1ab_0    conda-forge
amply                     0.1.6              pyhd8ed1ab_0    conda-forge
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
argcomplete               3.3.0              pyhd8ed1ab_0    conda-forge
argh                      0.31.2             pyhd8ed1ab_0    conda-forge
arrow                     1.3.0              pyhd8ed1ab_0    conda-forge
arrow-cpp                 4.0.0           py38ha12db41_1_cpu    conda-forge
astor                     0.8.1              pyh9f0ad1d_0    conda-forge
asttokens                 2.4.1                    pypi_0    pypi
astunparse                1.6.3              pyhd8ed1ab_0    conda-forge
async-timeout             4.0.3              pyhd8ed1ab_0    conda-forge
attmap                    0.13.2             pyhd8ed1ab_0    conda-forge
attrs                     23.2.0             pyh71513ae_0    conda-forge
aws-c-cal                 0.5.11               h95a6274_0    conda-forge
aws-c-common              0.6.2                h7f98852_0    conda-forge
aws-c-event-stream        0.2.7               h3541f99_13    conda-forge
aws-c-io                  0.10.5               hfb6a706_0    conda-forge
aws-checksums             0.1.11               ha31a3da_7    conda-forge
aws-sdk-cpp               1.8.186              hecaee15_4    conda-forge
backcall                  0.2.0                    pypi_0    pypi
bcrypt                    4.1.3            py38h31a4407_0    conda-forge
binaryornot               0.4.4                      py_1    conda-forge
biopython                 1.83             py38h01eb140_0    conda-forge
blinker                   1.8.2              pyhd8ed1ab_0    conda-forge
boto3                     1.34.111           pyhd8ed1ab_0    conda-forge
botocore                  1.34.112        pyge38_1234567_0    conda-forge
brotli                    1.1.0                hd590300_1    conda-forge
brotli-bin                1.1.0                hd590300_1    conda-forge
brotli-python             1.1.0            py38h17151c0_1    conda-forge
bzip2                     1.0.8                hd590300_5    conda-forge
c-ares                    1.28.1               hd590300_0    conda-forge
ca-certificates           2024.2.2             hbcca054_0    conda-forge
cachetools                4.2.4              pyhd8ed1ab_0    conda-forge
certifi                   2024.2.2           pyhd8ed1ab_0    conda-forge
cffi                      1.14.4           py38ha312104_0    conda-forge
chardet                   5.2.0            py38h578d9bd_1    conda-forge
charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
cloudpickle               3.0.0                    pypi_0    pypi
coin-or-cbc               2.10.10              h9002f0b_0    conda-forge
coin-or-cgl               0.60.7               h516709c_0    conda-forge
coin-or-clp               1.17.8               h1ee7a9c_0    conda-forge
coin-or-osi               0.108.10             haf5fa05_0    conda-forge
coin-or-utils             2.11.11              hee58242_0    conda-forge
coincbc                   2.10.10           0_metapackage    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
coloredlogs               15.0.1             pyhd8ed1ab_3    conda-forge
colorlog                  6.8.2            py38h578d9bd_0    conda-forge
comm                      0.2.2                    pypi_0    pypi
commonmark                0.9.1                      py_0    conda-forge
conda                     4.12.0           py38h578d9bd_0    conda-forge
conda-package-handling    2.2.0              pyh38be061_0    conda-forge
conda-package-streaming   0.9.0              pyhd8ed1ab_0    conda-forge
configargparse            1.7                pyhd8ed1ab_0    conda-forge
connection_pool           0.0.3              pyhd3deb0d_0    conda-forge
contourpy                 1.1.1            py38h7f3f72f_1    conda-forge
cookiecutter              2.6.0              pyhca7485f_0    conda-forge
cryptography              39.0.0           py38h1724139_0    conda-forge
cycler                    0.12.1             pyhd8ed1ab_0    conda-forge
cython                    3.0.10           py38h17151c0_0    conda-forge
cyvcf2                    0.30.15                  pypi_0    pypi
dash                      2.10.2                   pypi_0    pypi
dash-core-components      2.0.0                    pypi_0    pypi
dash-cytoscape            1.0.1                    pypi_0    pypi
dash-html-components      2.0.0                    pypi_0    pypi
dash-table                5.0.0                    pypi_0    pypi
dataclasses               0.8                pyhc8e2a94_3    conda-forge
datrie                    0.8.2            py38h01eb140_7    conda-forge
debugpy                   1.8.1                    pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
deepdiff                  7.0.1              pyhd8ed1ab_0    conda-forge
defusedxml                0.7.1              pyhd8ed1ab_0    conda-forge
deprecation               2.1.0              pyh9f0ad1d_0    conda-forge
dill                      0.3.8                    pypi_0    pypi
docutils                  0.20.1           py38h578d9bd_3    conda-forge
dpath                     2.1.6              pyha770c72_0    conda-forge
dropbox                   11.36.2            pyhd8ed1ab_0    conda-forge
enum34                    1.1.10           py38h32f6830_2    conda-forge
exceptiongroup            1.2.0              pyhd8ed1ab_2    conda-forge
executing                 2.0.1                    pypi_0    pypi
fastbetabino3             0.0.1                    pypi_0    pypi
filechunkio               1.8                        py_2    conda-forge
filelock                  3.14.0             pyhd8ed1ab_0    conda-forge
flask                     2.2.5                    pypi_0    pypi
fonttools                 4.51.0           py38h01eb140_0    conda-forge
freetype                  2.12.1               h267a509_2    conda-forge
frozenlist                1.4.1            py38h01eb140_0    conda-forge
ftputil                   5.1.0              pyhd8ed1ab_0    conda-forge
future                    1.0.0              pyhd8ed1ab_0    conda-forge
gast                      0.3.3                      py_0    conda-forge
gevent                    24.2.1                   pypi_0    pypi
gffutils                  0.13               pyh7cba7a3_0    bioconda
gflags                    2.2.2             he1b5a44_1004    conda-forge
giflib                    5.2.2                hd590300_0    conda-forge
gitdb                     4.0.11             pyhd8ed1ab_0    conda-forge
gitpython                 3.1.43             pyhd8ed1ab_0    conda-forge
glog                      0.4.0                h49b9bf7_3    conda-forge
google-api-core           2.10.0             pyhd8ed1ab_0    conda-forge
google-api-python-client  2.130.0            pyhd8ed1ab_0    conda-forge
google-auth               1.35.0             pyh6c4a22f_0    conda-forge
google-auth-httplib2      0.2.0              pyhd8ed1ab_0    conda-forge
google-auth-oauthlib      0.4.6              pyhd8ed1ab_0    conda-forge
google-cloud-core         2.3.1              pyhd8ed1ab_0    conda-forge
google-cloud-storage      2.11.0             pyh1a96a4e_0    conda-forge
google-crc32c             1.1.2            py38hf9d55a7_5    conda-forge
google-pasta              0.2.0              pyh8c360ce_0    conda-forge
google-resumable-media    2.7.0              pyhd8ed1ab_0    conda-forge
googleapis-common-protos  1.57.0           py38h578d9bd_0    conda-forge
greenlet                  3.0.3                    pypi_0    pypi
grpc-cpp                  1.37.1               h36de60a_0    conda-forge
grpcio                    1.37.1           py38hdd6454d_0    conda-forge
h5py                      2.10.0          nompi_py38h9915d05_106    conda-forge
hdf5                      1.10.6          nompi_h6a2412b_1114    conda-forge
htslib                    1.17                 h6bc39ce_1    bioconda
httplib2                  0.22.0             pyhd8ed1ab_0    conda-forge
humanfriendly             10.0               pyhd8ed1ab_6    conda-forge
icu                       68.2                 h9c3ff4c_0    conda-forge
idna                      3.7                pyhd8ed1ab_0    conda-forge
imageio                   2.34.1                   pypi_0    pypi
importlib-metadata        7.1.0              pyha770c72_0    conda-forge
importlib-resources       6.4.0              pyhd8ed1ab_0    conda-forge
importlib_resources       6.4.0              pyhd8ed1ab_0    conda-forge
iniconfig                 2.0.0              pyhd8ed1ab_0    conda-forge
interpret                 0.2.7                    pypi_0    pypi
interpret-core            0.2.7                    pypi_0    pypi
ipykernel                 6.29.4                   pypi_0    pypi
ipython                   8.12.3                   pypi_0    pypi
itsdangerous              2.2.0                    pypi_0    pypi
jedi                      0.19.1                   pypi_0    pypi
jinja2                    3.1.4              pyhd8ed1ab_0    conda-forge
jmespath                  1.0.1              pyhd8ed1ab_0    conda-forge
joblib                    1.4.2              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   h0b41bf4_3    conda-forge
jsonschema                4.22.0             pyhd8ed1ab_0    conda-forge
jsonschema-specifications 2023.12.1          pyhd8ed1ab_0    conda-forge
jupyter-client            8.6.2                    pypi_0    pypi
jupyter_core              5.7.2            py38h578d9bd_0    conda-forge
keras                     2.4.3              pyhd8ed1ab_0    conda-forge
keras-preprocessing       1.1.2              pyhd8ed1ab_0    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kipoi                     0.8.5              pyh5e36f6f_0    bioconda
kipoi-conda               0.1.6                      py_0    bioconda
kipoi-utils               0.7.7              pyh7cba7a3_0    bioconda
kipoiseq                  0.7.1              pyhdfd78af_0    bioconda
kiwisolver                1.4.5            py38h7f3f72f_1    conda-forge
krb5                      1.20.1               hf9c8cef_0    conda-forge
lazy-loader               0.4                      pypi_0    pypi
lcms2                     2.12                 hddcbb42_0    conda-forge
ld_impl_linux-64          2.40                 h55db66e_0    conda-forge
libarchive                3.5.1                h3f442fb_1    conda-forge
libblas                   3.9.0           20_linux64_openblas    conda-forge
libbrotlicommon           1.1.0                hd590300_1    conda-forge
libbrotlidec              1.1.0                hd590300_1    conda-forge
libbrotlienc              1.1.0                hd590300_1    conda-forge
libcblas                  3.9.0           20_linux64_openblas    conda-forge
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcurl                   7.87.0               h6312ad2_0    conda-forge
libdeflate                1.13                 h166bdaf_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 hd590300_2    conda-forge
libevent                  2.1.10               h9b69904_4    conda-forge
libffi                    3.2.1             he1b5a44_1007    conda-forge
libgcc-ng                 13.2.0               h77fa898_7    conda-forge
libgfortran-ng            13.2.0               h69a702a_7    conda-forge
libgfortran5              13.2.0               hca663fb_7    conda-forge
libgomp                   13.2.0               h77fa898_7    conda-forge
libiconv                  1.17                 hd590300_2    conda-forge
liblapack                 3.9.0           20_linux64_openblas    conda-forge
liblapacke                3.9.0           20_linux64_openblas    conda-forge
libnghttp2                1.51.0               hdcd2b5c_0    conda-forge
libopenblas               0.3.25          pthreads_h413a1c8_0    conda-forge
libpng                    1.6.43               h2797004_0    conda-forge
libprotobuf               3.15.8               h780b84a_1    conda-forge
libsodium                 1.0.18               h36c2ea0_1    conda-forge
libsolv                   0.7.29               ha6fb4c9_0    conda-forge
libsqlite                 3.45.3               h2797004_0    conda-forge
libssh2                   1.10.0               haa6b8db_3    conda-forge
libstdcxx-ng              13.2.0               hc0a3c3a_7    conda-forge
libthrift                 0.14.1               he6d91bd_2    conda-forge
libtiff                   4.2.0                hbd63e13_2    conda-forge
libutf8proc               2.8.0                h166bdaf_0    conda-forge
libwebp-base              1.4.0                hd590300_0    conda-forge
libxml2                   2.9.12               h72842e0_0    conda-forge
libzlib                   1.2.13               hd590300_5    conda-forge
lime                      0.2.0.1                  pypi_0    pypi
llvmlite                  0.41.1                   pypi_0    pypi
logmuse                   0.2.6              pyh8c360ce_0    conda-forge
lz4-c                     1.9.3                h9c3ff4c_1    conda-forge
lzo                       2.10              hd590300_1001    conda-forge
mamba                     0.15.3           py38h2aa5da1_0    conda-forge
markdown                  3.6                pyhd8ed1ab_0    conda-forge
markupsafe                2.1.5            py38h01eb140_0    conda-forge
matplotlib-base           3.7.3            py38h58ed7fa_0    conda-forge
matplotlib-inline         0.1.7                    pypi_0    pypi
mmsplice                  2.4.0                    pypi_0    pypi
multidict                 6.0.5            py38h01eb140_0    conda-forge
multiprocess              0.70.16                  pypi_0    pypi
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
natsort                   8.4.0              pyhd8ed1ab_0    conda-forge
nbformat                  5.10.4             pyhd8ed1ab_0    conda-forge
ncls                      0.0.68           py38he5da3d1_2    bioconda
ncurses                   6.5                  h59595ed_0    conda-forge
nest-asyncio              1.6.0                    pypi_0    pypi
networkx                  3.1                      pypi_0    pypi
numba                     0.58.1                   pypi_0    pypi
numpy                     1.23.0           py38h3a7f9d9_0    conda-forge
oauth2client              4.1.3                      py_0    conda-forge
oauthlib                  3.2.2              pyhd8ed1ab_0    conda-forge
olefile                   0.47               pyhd8ed1ab_0    conda-forge
openjpeg                  2.4.0                hb52868f_1    conda-forge
openssl                   1.1.1w               hd590300_0    conda-forge
opt_einsum                3.3.0              pyhc1e730c_2    conda-forge
orc                       1.6.7                heec2584_1    conda-forge
ordered-set               4.1.0              pyhd8ed1ab_0    conda-forge
orjson                    3.10.3           py38h31a4407_0    conda-forge
packaging                 24.0               pyhd8ed1ab_0    conda-forge
pandas                    2.0.3            py38h01efb38_1    conda-forge
paramiko                  3.4.0              pyhd8ed1ab_0    conda-forge
parquet-cpp               1.5.1                         2    conda-forge
parso                     0.8.4                    pypi_0    pypi
patsy                     0.5.6              pyhd8ed1ab_0    conda-forge
peppy                     0.40.1             pyhd8ed1ab_0    conda-forge
pexpect                   4.9.0                    pypi_0    pypi
pickleshare               0.7.5                    pypi_0    pypi
pillow                    10.3.0                   pypi_0    pypi
pip                       24.0               pyhd8ed1ab_0    conda-forge
pkgutil-resolve-name      1.3.10             pyhd8ed1ab_1    conda-forge
plac                      1.4.3              pyhd8ed1ab_0    conda-forge
platformdirs              4.2.2              pyhd8ed1ab_0    conda-forge
plotly                    5.22.0                   pypi_0    pypi
pluggy                    1.5.0              pyhd8ed1ab_0    conda-forge
ply                       3.11               pyhd8ed1ab_2    conda-forge
pooch                     1.8.1              pyhd8ed1ab_0    conda-forge
prettytable               3.10.0             pyhd8ed1ab_0    conda-forge
prompt-toolkit            3.0.43                   pypi_0    pypi
protobuf                  3.15.8           py38h709712a_0    conda-forge
psutil                    5.9.8            py38h01eb140_0    conda-forge
ptyprocess                0.7.0                    pypi_0    pypi
pulp                      2.7.0            py38h578d9bd_1    conda-forge
pure-eval                 0.2.2                    pypi_0    pypi
pyarrow                   4.0.0           py38hc9229eb_1_cpu    conda-forge
pyasn1                    0.6.0              pyhd8ed1ab_0    conda-forge
pyasn1-modules            0.4.0              pyhd8ed1ab_0    conda-forge
pycosat                   0.6.6            py38h01eb140_0    conda-forge
pycparser                 2.22               pyhd8ed1ab_0    conda-forge
pyfaidx                   0.8.1.1            pyhdfd78af_0    bioconda
pygments                  2.18.0             pyhd8ed1ab_0    conda-forge
pyjwt                     2.8.0              pyhd8ed1ab_1    conda-forge
pynacl                    1.5.0            py38h01eb140_3    conda-forge
pyopenssl                 23.2.0             pyhd8ed1ab_1    conda-forge
pyparsing                 3.1.2              pyhd8ed1ab_0    conda-forge
pyranges                  0.0.125                  pypi_0    pypi
pyrle                     0.0.40           py38he5da3d1_0    bioconda
pysam                     0.21.0           py38h1c8baaf_0    bioconda
pysftp                    0.2.9                      py_1    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
pytest                    8.2.1              pyhd8ed1ab_0    conda-forge
python                    3.8.0                h357f687_5    conda-forge
python-dateutil           2.9.0              pyhd8ed1ab_0    conda-forge
python-fastjsonschema     2.19.1             pyhd8ed1ab_0    conda-forge
python-flatbuffers        1.12               pyhd8ed1ab_1    conda-forge
python-irodsclient        2.0.1              pyhd8ed1ab_0    conda-forge
python-slugify            8.0.4              pyhd8ed1ab_0    conda-forge
python-tzdata             2024.1             pyhd8ed1ab_0    conda-forge
python_abi                3.8                      2_cp38    conda-forge
pytz                      2024.1             pyhd8ed1ab_0    conda-forge
pyu2f                     0.1.5              pyhd8ed1ab_0    conda-forge
pyvcf3                    1.0.3              pyhdfd78af_0    bioconda
pywavelets                1.4.1                    pypi_0    pypi
pyyaml                    6.0.1            py38h01eb140_1    conda-forge
pyzmq                     26.0.3                   pypi_0    pypi
re2                       2021.04.01           h9c3ff4c_0    conda-forge
readline                  8.2                  h8228510_1    conda-forge
referencing               0.35.1             pyhd8ed1ab_0    conda-forge
related                   0.7.3              pyhd8ed1ab_0    conda-forge
reproc                    14.2.4.post0         hd590300_1    conda-forge
reproc-cpp                14.2.4.post0         h59595ed_1    conda-forge
requests                  2.32.2             pyhd8ed1ab_0    conda-forge
requests-oauthlib         2.0.0              pyhd8ed1ab_0    conda-forge
reretry                   0.11.8             pyhd8ed1ab_0    conda-forge
rich                      12.0.1                   pypi_0    pypi
rpds-py                   0.18.1           py38h31a4407_0    conda-forge
rsa                       4.9                pyhd8ed1ab_0    conda-forge
ruamel_yaml               0.15.80         py38h01eb140_1009    conda-forge
s2n                       1.0.10               h9b69904_0    conda-forge
s3transfer                0.10.1             pyhd8ed1ab_0    conda-forge
salib                     1.4.8                    pypi_0    pypi
scikit-image              0.21.0                   pypi_0    pypi
scikit-learn              1.3.2            py38ha25d942_2    conda-forge
scipy                     1.10.1           py38h59b608b_3    conda-forge
seaborn                   0.13.2               hd8ed1ab_2    conda-forge
seaborn-base              0.13.2             pyhd8ed1ab_2    conda-forge
setuptools                70.0.0             pyhd8ed1ab_0    conda-forge
shap                      0.44.1                   pypi_0    pypi
simplejson                3.19.2           py38h01eb140_0    conda-forge
singledispatch            3.6.1              pyh44b312d_0    conda-forge
six                       1.15.0             pyh9f0ad1d_0    conda-forge
skope-rules               1.0.1                    pypi_0    pypi
slacker                   0.14.0                     py_0    conda-forge
slicer                    0.0.7                    pypi_0    pypi
smart_open                7.0.4              pyhd8ed1ab_0    conda-forge
smmap                     5.0.0              pyhd8ed1ab_0    conda-forge
snakemake                 7.26.0               hdfd78af_0    bioconda
snakemake-minimal         7.26.0             pyhdfd78af_0    bioconda
snappy                    1.1.10               hdb0a2a9_1    conda-forge
sorted_nearest            0.0.39           py38he5da3d1_1    bioconda
spliceai                  1.3.1              pyh864c0ab_1    bioconda
splicemap                 0.0.1                    pypi_0    pypi
sqlite                    3.45.3               h2c6b66d_0    conda-forge
stack-data                0.6.3                    pypi_0    pypi
statsmodels               0.14.1           py38h7f0c24c_0    conda-forge
stone                     3.3.6              pyhd8ed1ab_0    conda-forge
stopit                    1.1.2                      py_0    conda-forge
tabix                     1.11                 hdfd78af_0    bioconda
tabulate                  0.9.0              pyhd8ed1ab_1    conda-forge
tenacity                  8.3.0                    pypi_0    pypi
tensorboard               2.4.1              pyhd8ed1ab_1    conda-forge
tensorboard-plugin-wit    1.8.1              pyhd8ed1ab_0    conda-forge
tensorflow                2.4.3            py38h578d9bd_0    conda-forge
tensorflow-base           2.4.3            py38h83f5f1d_0    conda-forge
tensorflow-estimator      2.4.0              pyh9656e83_0    conda-forge
termcolor                 1.1.0                    pypi_0    pypi
text-unidecode            1.3                pyhd8ed1ab_1    conda-forge
threadpoolctl             3.5.0              pyhc1e730c_0    conda-forge
throttler                 1.2.2              pyhd8ed1ab_0    conda-forge
tifffile                  2023.7.10                pypi_0    pypi
tinydb                    4.8.0              pyhd8ed1ab_0    conda-forge
tk                        8.6.13          noxft_h4845f30_101    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
toposort                  1.10               pyhd8ed1ab_0    conda-forge
tornado                   6.4                      pypi_0    pypi
tqdm                      4.66.4             pyhd8ed1ab_0    conda-forge
traitlets                 5.14.3             pyhd8ed1ab_0    conda-forge
treeinterpreter           0.2.3                    pypi_0    pypi
types-python-dateutil     2.9.0.20240316     pyhd8ed1ab_0    conda-forge
typing-extensions         3.7.4.3                       0    conda-forge
typing_extensions         3.7.4.3                    py_0    conda-forge
ubiquerg                  0.7.0              pyhd8ed1ab_0    conda-forge
unicodedata2              15.1.0           py38h01eb140_0    conda-forge
uritemplate               4.1.1              pyhd8ed1ab_0    conda-forge
urllib3                   1.26.18            pyhd8ed1ab_0    conda-forge
veracitools               0.1.3                      py_0    conda-forge
wcwidth                   0.2.13             pyhd8ed1ab_0    conda-forge
werkzeug                  2.2.3                    pypi_0    pypi
wget                      3.2                      pypi_0    pypi
wheel                     0.43.0             pyhd8ed1ab_1    conda-forge
wrapt                     1.12.1                   pypi_0    pypi
xz                        5.2.6                h166bdaf_0    conda-forge
yaml                      0.2.5                h7f98852_2    conda-forge
yarl                      1.9.4            py38h01eb140_0    conda-forge
yte                       1.5.4              pyha770c72_0    conda-forge
zipp                      3.17.0             pyhd8ed1ab_0    conda-forge
zlib                      1.2.13               hd590300_5    conda-forge
zope-event                5.0                      pypi_0    pypi
zope-interface            6.4.post2                pypi_0    pypi
zstandard                 0.19.0           py38h0a891b7_0    conda-forge
zstd                      1.4.9                ha95c52a_0    conda-forge

How to get CATs data

I want to get CATs data to validate the absplice performance. How to get CATs data?

SpliceAI running time

Hello,
I an testing absplice on a human WGS sample using default configurations (and tissues).
Currently I ran snakemake workflow inside the docker container using 20 threads.

MMSplice finished quite qwickly, but SpliceAI in running since 6 days and is still at chr2...

Is there a way for speeding SpliceAI up?
Does SpliceAI scale up with the threads given as input to snakemake?

Can't get attribute 'EBMPreprocessor' on <module 'interpret.glassbox.ebm.ebm'

Hey guys, your tool looks really interesting to me! :)
And so I wanted to give it a try.

However, I stumbled over this error when running the example on my Linux-server.
Do you know how to get around it?

[Sat Dec 24 01:35:02 2022]
rule absplice_dna:
    input: mmsplice_splicemap.csv, spliceai.vcf
    output: absplice_dna.csv
    jobid: 1
    reason: Missing output files: absplice_dna.csv; Input files updated by another job: mmsplice_splicemap.csv
    resources: tmpdir=/tmp

2022-12-24 01:35:06.874355: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  SSE4.1
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
Traceback (most recent call last):
  File "/home/mi/olivek95/git_projects/absplice/example/.snakemake/scripts/tmp5a1c9dig.absplice_dna.py", line 11, in <module>
    splicing_result.predict_absplice_dna()
  File "/home/mi/olivek95/git_projects/absplice/absplice/result.py", line 568, in predict_absplice_dna
    model = pickle.load(open(pickle_file, 'rb'))
AttributeError: Can't get attribute 'EBMPreprocessor' on <module 'interpret.glassbox.ebm.ebm' from '/buffer/ag_bsc/PS_SEQAN_STUDENTS/olivek95/miniconda3/envs/absplice/lib/python3.9/site-packages/interpret/glassbox/ebm/ebm.py'>
[Sat Dec 24 01:35:17 2022]
Error in rule absplice_dna:
    jobid: 1
    input: mmsplice_splicemap.csv, spliceai.vcf
    output: absplice_dna.csv

RuleException:
CalledProcessError in file /home/mi/olivek95/git_projects/absplice/example/Snakefile, line 88:
Command 'set -euo pipefail;  /buffer/ag_bsc/PS_SEQAN_STUDENTS/olivek95/miniconda3/envs/absplice/bin/python /home/mi/olivek95/git_projects/absplice/example/.snakemake/scripts/tmp5a1c9dig.absplice_dna.py' returned non-zero exit status 1.
  File "/home/mi/olivek95/git_projects/absplice/example/Snakefile", line 88, in __rule_absplice_dna
  File "/buffer/ag_bsc/PS_SEQAN_STUDENTS/olivek95/miniconda3/envs/absplice/lib/python3.9/concurrent/futures/thread.py", line 58, in run
Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
Complete log: .snakemake/log/2022-12-24T013405.664404.snakemake.log

Initial command:
cd example; python -m snakemake -j 1

Container Environment problem

Hello,

We are trying to make the container work on our slurm based HPCC. We don't have docker available to us on the server and images before allowing them to be used but .oci isn't accepted. They asked for a tar.gz version of the image to convert to a sif before we could use it.

I installed docker locally, loaded the oci following the commands on git:
docker load -i absplice.oci docker run -it --name absplice_container localhost/absplice:latest /bin/bash
Then saved to a tar.gz
docker save localhost/absplice:latest | gzip > absplice_latest.tar.gz)
The IT team created a sif for us using this and gave us the following command to load it.
singularity shell -B /n /n/app/singularity/containers/absplice.sif

However, I run into an error trying to load the conda environment and conda init bash has no effect. Is this a problem with the system that we have to run it, the process of converting to tar.gz, or the image itself? And are there any recommendations for how to get around this problem?

`[user@compute-node ~]$ singularity shell -B /n /path/to/absplice.sif
Apptainer> conda activate absplice_dock

CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run

$ conda init <SHELL_NAME>

Currently supported shells are:

  • bash
  • fish
  • tcsh
  • xonsh
  • zsh
  • powershell

See 'conda init --help' for more information and options.

IMPORTANT: You may need to close and restart your shell after running 'conda init'.`

Thank you so much for your help!!!
Shayna

Bugs in Absplice implementation

Dear Dr. Gagneur.

We are also working on the implementation of the Absplice reported in this issue.
However, I have been working on it based on the readme at the following URL, but an error occurred in the test sample.
I would like to know what to do in this case.

The command that caused the error is as follows
python -m snakemake -j 1 --use-conda

The following is the ERROR message.

Error in rule download_splicemaps:
jobid: 4
output: splicemap_gtex_v8
shell:
splicemap_download --version gtex_v8 --splicemap_dir splicemap_gtex_v8 --tissues Testis --tissues Cells_Cultured_fibroblasts
(one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)

Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
Complete log: .snakemake/log/2023-05-17T141553.827340.snakemake.log

Absplice-RNA

Hi,

I am trying to implement Absplice-RNA with a VCF file and RNAseq data from the same individual. I see the example code in README is made for Absplice-DNA. Could you point out how to use Absplice-RNA?

Thanks!
Yan

Splicemap_tissues

Dear Developer

Thank you for your making docker container.

I want to know about "Splicemap_tissues"

If I have a blood DNA sample but want to know the splicing mutations in the liver, can I select Splicemap_tissues for the liver?

License

Hello developers of absplice,

First of all many thanks for such a nice open-source project to improve splicing variant prediction and annotation.
I'm opening this issue because I struggle to find a license for using the code or precomputed scores. Do you happen to have a license for your wonderful project?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.