Giter Club home page Giter Club logo

parsl-tutorial's Introduction

Parsl Tutorials

Parsl is a parallel scripting library for Python that allows users to develop and execute dataflow scripts on parallel and distributed resources.

Parsl runs programs concurrently as soon as their inputs are available, reducing the need for complex parallel programming. Parsl expresses dataflow in a portable fashion: the same script can run on multicore computers, clusters, clouds, grids, and supercomputers.

This repository inlcudes three tutorials:
  • parsl-introduction.ipynb: a quickstart guide to using Parsl
  • parsl-workflows.ipynb: example workflow patterns expressed in Parsl
  • parsl-advanced-features.ipynb: examples of various Parsl features, such as multi-site, elasticity, and fault tolerance

The tutorial repository includes everything needed to run these notebooks. It includes sample applications simulate and stats (mock "science" applications) as well as a basic MPI program. It also includes configuration files for several compute resources.

Running with Binder

The easiest way to run these tutorials is via Binder. Using Binder you can run the tutorial notebooks in your browser without installing any code locally.

Start Binder

Running locally

To run the tutorial locally, ensure that Python (3.5+) and Parsl are installed.

To install Parsl:

$ pip3 install parsl

To install Parsl from source, see the documentation.

Finally, set up the Parsl tutorial:

$ git clone https://github.com/parsl/parsl-tutorial.git

parsl-tutorial's People

Contributors

kylechard avatar yadudoc avatar annawoodard avatar danielskatz avatar zhuozhaoli avatar benclifford avatar ianfoster avatar anti-mony avatar

Stargazers

Roman avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.