Giter Club home page Giter Club logo

ops's Introduction

ops's People

Contributors

lottspot avatar themightychris avatar moosequest avatar ericoc avatar machow avatar

Stargazers

rob bee avatar  avatar  avatar

Watchers

Kevin Curry avatar toby avatar  avatar  avatar James Cloos avatar Mosh avatar Lauren Ancona avatar  avatar speaud avatar Ben Novack avatar Dawn McDougall avatar Raghu Vamshi Challa avatar rob bee avatar  avatar

ops's Issues

Deploy paws_data_pipeline

Deployment specifications

Additional notes

We are looking to set up a data lake in collaboration with PAWS to manage their data (e.g. volunteering, adoptions, donations). We are still exploring different options for scheduling the pipeline (cron, airflow, etc.) and data storage (e.g. PostgreSQL). What resources could Linode help us with for compute resources and/or storage?

Shared infrastructure secrets management

There is some shared infrastructure which it would be in our interest to deploy (e.g., shared databases). Project-specific access to such shared resources would obviously require the creation and distribution of credentials.

Transparently support HTTPS for all projects

Using letsencrypt, we should have the ability to automatically acquire HTTPS certificates for any project hosted on our cluster. We should look into configuring a service to do this so we can support HTTPS by default on all projects.

Deploy CHIME

TODO

  • Verify that application can be started locally with docker-compose up
  • Fill out repository and branch below
  • Set up CodeForPhilly.org project profile and add link below
  • Record any additional notes, if any

Deployment specifications

Additional notes

Project is currently working on implementing scripts to rule them all
project can be launched using

docker build -t chime
docker run -d -p 80:8000 chime

Deployment progress

Persistent volume access

Project owners need to be able to manage the files on persistent volumes for their containers

Bucket Storage Request

Request

The PLSE Project would like to request access for the purpose of storing data that we are using for our expungement and pardon services. We are in a crunch to get access since the information is coming from a publicly available database and the information started being hidden from public view on June 28. In two days, they already hid 170,000 records.

Deployment specifications

We are look to store approx. 200GB of PDF files.

Deploy Prevention Point MVP

TODO

  • Verify that application can be started locally with docker-compose up
  • Fill out repository and branch below
  • Set up CodeForPhilly.org project profile and add link below
  • Record any additional notes, if any

Deployment specifications

Additional notes

Should start postgres db, django back end, create and connect front end, then seed postgres with fake data.

Fake data does not need to persist in future deploys.

Create Data Hackathon DB

Need a protected db (SQL-based, don't care what tech) to house data generated for the upcoming data hack. Data may contain non-public datasets (no PII or PHI) so cannot be available in git repo.

Build inventory of all CfP servers

Before we can know what to do, we need to know what we have. We will need to gather a detailed inventory of what machines are currently active, what application stacks are installed on them, what provider they are hosted with, what web applications are hosted on them, and really every other detail we can get our hands on.

This task can be moved into the "ready" state once:

  • We have decided how to record inventory
  • Our group or some subset thereof has access to the machines which we need to inventory

Access to logs

Docker container logs are being shipped into an elasticsearch backend by default. Project owners need to be able to view and search these logs.

Propagate container updates

Project owners need to be able to tell the cluster that a new version of their container is available without the intervention of a cluster administrator.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.