Giter Club home page Giter Club logo

servicex's Introduction

ServiceX - Data Delivery for the HEP Community

ServiceX is an on-demand service that delivers data straight from the grid to high energy physics analysts in an easy, flexible, and highly performant manner.

Features

  • Experiment-agnostic: Supports both the ATLAS and CMS collaborations on the LHC.
  • Custom filters and pre-processing: Easily filter events, request specific columns, and unpack compressed formats using the func-adl analysis description language.
  • Choose your format: ServiceX can deliver data in a variety of columnar formats, including streams of ROOT data, small ROOT files, HDF5, and Apache Arrow buffers.
  • No hassle: ServiceX uses Rucio to find and access data wherever it lives, so users don't have to worry about these details.
  • Simple and Pythonic: Using ServiceX takes only a few lines of code in any Python environment, such as a script or Jupyter notebook.

Getting Started

Check out our quick start guide for instructions on how to obtain credentials, install the ServiceX Python library, and make your first ServiceX transformation request.

Documentation

Documentation Status

The ServiceX documentation is hosted on Read the Docs.

Self-Hosting

The Scalable Systems Laboratory (SSL) at IRIS-HEP maintains multiple instances of ServiceX to transform several input formats from different experiments.

In addition, ServiceX is an open-source project, and you are welcome to host your own deployment. Instructions on how to configure and deploy ServiceX can be found in our deployment guide.

Contributing

The ServiceX team welcomes community contributions. If you'd like to get involved, please check out our contributor guide.

License

ServiceX is distributed under a BSD 3-Clause License.

Acknowledgements

ServiceX is a component of the IRIS-HEP Intelligent Data Delivery Service, and is supported by National Science Foundation under Cooperative Agreement OAC-1836650. Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

servicex's People

Contributors

bengalewsky avatar andreweckart avatar sthapa avatar mweinberg2718 avatar ivukotic avatar gordonwatts avatar zorache avatar oshadura avatar ponyisi avatar wookiee2187 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.