hpc-carpentry / hpc-python Goto Github PK
View Code? Open in Web Editor NEWHPC Python lesson materials
Home Page: https://hpc-carpentry.github.io/hpc-python/
License: Other
HPC Python lesson materials
Home Page: https://hpc-carpentry.github.io/hpc-python/
License: Other
I am bound to teach snakemake at my place. People have expressed high interest, so I just went through the current state of the material. I think it contains a lot of gems and is well written. Thanks to all the authors.
However, I have the feeling that workflows are so important, that they potentially need a repo for their own. I could imagine refactoring the snakemake focussed modules into hpc-carpentry/hpc-workflow. I just wanted to put this idea out there and hope that people comment on this.
There is a fork of this lesson in the Carpentries Incubator which focusses purely on Snakemake (and that is indeed the majority of the content in this lesson). Does it make sense to maintain this lesson if others are willing to maintain that independently? Should we put some effort into making the lesson in the incubator more transferable instead?
Hi!
I forked this repo with the intent of contributing to it.
When I tried to render the lesson locally, it failed with the following error:
Could not find gem 'mdl' in any of the gem sources listed in your Gemfile.
Run `bundle install` to install missing gems.
After running bundle install
, the dependency was installed and I could render the lesson.
However, I propose that the template Gemfile from carpentries/lesson-example be used. This will ensure consistency with other lessons and thus helps to advance the development stage of this lesson. I was able to successfully render the lesson locally using this Gemfile.
I will submit a PR addressing this, but please feel free to reject it if there's a reason to use a custom Gemfile.
Best,
V
this and the dask documentation already has some really good examples that could serve as a jumping off point: https://github.com/sdsc/sdsc-summer-institute-2019/tree/master/hpc0_python_hpc
an overview of the "why" of dask: https://notamonadtutorial.com/interview-with-dasks-creator-scale-your-python-from-one-computer-to-a-thousand-b4483376f200
This should be done along with providing more detailed setup instructions.
I propose to split the hpc-python in half:
new hpc-carpentry repository 'hpc-workflows': episode 11 to episode 18
The introduction to snakemake (the second part of hpc-python) is very well done and would offer more effective real estate to focus contributors attention if in an isolated repository. I feel that it is a bit hidden currently, which I believe is a shame.
see also #13
Hello hpc-carpentry team,
I am an Carpentry Instructor and I'd be quite interested to turn this lesson into an official Data Carpentry lesson ultimately as I see a considerable interest for Snakemake among Life Scientists.
As Snakemake is primarily used in genomics as far as I can tell, I'd like to change the example from words and books to some small sequencing dataset.
An example can be seen here in the official Snakemake read the docs.
What do you think?
Cheers
Marc
@zkamvar
We need to update style for this lesson so that jump lists (anchors for different sections) becomes automatically available for different levels of headings.
The Carpentries stylesheet provides magic to format code. These should be applied throughout the hpc-python lessons.
That link points to:
https://github.com/hpc-carpentry/hpc-python/blob/gh-pages/hpc-carpentry.github.io/hpc-novice
Which results in 404 error.
To remove all files created by snakemake as output files to start from scratch, you can use
$ snakemake some_target --delete-all-output
Silent error unveiled by #40.
@tkphd I added you to the list of maintainers of this project for now. This should give you merge permission. We can revoke this permission at any time.
I am not aware of any code owners right now. But the content of this gem related to snakemake is simply too valuable IMHO. I'd like to make some more suggestions and PRs in order to edge out some inconsistencies in the plot of teaching (just taught this material for the first time). For this, I need an active maintainer to accept the PRs.
@jstaf Are you still involved in this project and have the capacities to review/merge PRs?
As mentioned here, the call to
$ python3 plotcount.py isles.dat show
should open a window to produce a plot. On my system:
Python 3.7.5 (default, Oct 17 2019, 12:09:47)
[GCC 9.2.1 20190827 (Red Hat 9.2.1-1)] on linux
Nothing happens.
The GitHub diff interface wraps lines at 80 characters. Since we use 100 characters as the max width, this makes for ugly diffs with lots of continued lines. To improve the clarity of these diffs, as well as readability in terminal text editors, we should back away from this edge, and wrap our content at 79 characters.
This is easily done with emacs, but the change would touch almost every file in the repository, so this should be coordinated with other efforts to minimize merge conflicts and the number of branch rebases to be done.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.