Giter Club home page Giter Club logo

core-tso-data's People

Contributors

fneum avatar janfrederickunnewehr avatar noffermann avatar pre-commit-ci[bot] avatar richard-weinhold avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

core-tso-data's Issues

Snakemake jobs not reproducible - JAO download data changed?

While trying to contribute to #14 I ran into the error below at the step snakemake -j 1 process_data. I was running this on GNU/Linux, also tried on a Windows machine - it looks like the JAO download has changed?

Building DAG of jobs...
Using shell: /usr/bin/bash
Provided cores: 1 (use --cores to define parallelism)
Rules claiming more threads will be scaled down.
Job stats:
job              count    min threads    max threads
-------------  -------  -------------  -------------
process_data         1              1              1
retrieve_data        1              1              1
total                2              1              1

Select jobs to execute...

[Sun Jan  1 19:55:05 2023]
rule retrieve_data:
    input: www.jao.eu/download/archive/paragraph/545/field_attachments
    output: data/jao/Core _Static Grid Model_template_AT.xlsx, data/jao/Core _Static Grid Model_template_BE_Q4-2021_all_EIC_0.xlsx, data/jao/Core _Static Grid Model_template_CZ.xlsx, data/jao/Core _Static Grid Model_template_D2.xlsx, data/jao/Core _Static Grid Model_template_D4_0.xlsx, data/jao/Core _Static Grid Model_template_D7.xlsx, data/jao/Core _Static Grid Model_template_D8.xlsx, data/jao/Core _Static Grid Model_template_FR.xlsx, data/jao/Core _Static Grid Model_template_HR.xlsx, data/jao/Core _Static Grid Model_template_HU.xlsx, data/jao/Core _Static Grid Model_template_LU.xlsx, data/jao/Core _Static Grid Model_template_NL.xlsx, data/jao/Core _Static Grid Model_template_PL.xlsx, data/jao/Core _Static Grid Model_template_RO.xlsx, data/jao/Core _Static Grid Model_template_SI.xlsx, data/jao/Core _Static Grid Model_template_SK.xlsx
    jobid: 1
    reason: Missing output files: data/jao/Core _Static Grid Model_template_AT.xlsx, data/jao/Core _Static Grid Model_template_HU.xlsx, data/jao/Core _Static Grid Model_template_FR.xlsx, data/jao/Core _Static Grid Model_template_D7.xlsx, data/jao/Core _Static Grid Model_template_RO.xlsx, data/jao/Core _Static Grid Model_template_HR.xlsx, data/jao/Core _Static Grid Model_template_SI.xlsx, data/jao/Core _Static Grid Model_template_SK.xlsx, data/jao/Core _Static Grid Model_template_CZ.xlsx, data/jao/Core _Static Grid Model_template_LU.xlsx, data/jao/Core _Static Grid Model_template_D4_0.xlsx, data/jao/Core _Static Grid Model_template_BE_Q4-2021_all_EIC_0.xlsx, data/jao/Core _Static Grid Model_template_D2.xlsx, data/jao/Core _Static Grid Model_template_NL.xlsx, data/jao/Core _Static Grid Model_template_D8.xlsx, data/jao/Core _Static Grid Model_template_PL.xlsx
    resources: tmpdir=/run/user/1000

Archive:  www.jao.eu/download/archive/paragraph/545/field_attachments
replace data/jao/20220905_Core _Static Grid Model_1.xlsx? [y]es, [n]o, [A]ll, [N]one, [r]ename: A
  inflating: data/jao/20220905_Core _Static Grid Model_1.xlsx  
  inflating: data/jao/20220905_Core Static Grid Model Handbook_final_1.docx  
  inflating: data/jao/outdated_Core Static Grid Model ? 1st Release.zip  
Waiting at most 5 seconds for missing files.
MissingOutputException in rule retrieve_data in file /home/fps/dev/core-tso-data/Snakefile, line 6:
Job 1  completed successfully, but some output files are missing. Missing files after 5 seconds. This might be due to filesystem latency. If that is the case, consider to increase the wait time with --latency-wait:
data/jao/Core _Static Grid Model_template_AT.xlsx
data/jao/Core _Static Grid Model_template_BE_Q4-2021_all_EIC_0.xlsx
data/jao/Core _Static Grid Model_template_CZ.xlsx
data/jao/Core _Static Grid Model_template_D2.xlsx
data/jao/Core _Static Grid Model_template_D4_0.xlsx
data/jao/Core _Static Grid Model_template_D7.xlsx
data/jao/Core _Static Grid Model_template_D8.xlsx
data/jao/Core _Static Grid Model_template_FR.xlsx
data/jao/Core _Static Grid Model_template_HR.xlsx
data/jao/Core _Static Grid Model_template_HU.xlsx
data/jao/Core _Static Grid Model_template_LU.xlsx
data/jao/Core _Static Grid Model_template_NL.xlsx
data/jao/Core _Static Grid Model_template_PL.xlsx
data/jao/Core _Static Grid Model_template_RO.xlsx
data/jao/Core _Static Grid Model_template_SI.xlsx
data/jao/Core _Static Grid Model_template_SK.xlsx
Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
Complete log: .snakemake/log/2023-01-01T195504.022001.snakemake.log

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.