Name: [Unofficial] UK Government Mirror
Type: Organization
Bio: An unofficial mirror of every UK Government Github repository, to preserve repositories that are removed or made private. Updated at least weekly.
Location: UK
Blog: https://government.github.com/community/#governments-uk-central
[Unofficial] UK Government Mirror's Projects
Ad hod code to time how long it takes to read data into pandas and R from Athena and S3
Automatic structural change detection for CC Receipt data
Easy reading of published civil CSVs
MoJ coffee and coding sessions that can be made publicly available
A program to generate random pairings for Coffee Roulette
Framework for cost modelling in R
Template of a cost model - fill in the gaps with your assumptions and press go!
A sankey diagram for criminal history statistics
Example of project with a Cronjob
A presentation into D3, that covers why and when to use it with examples of how it works.
Pulumi project that creates AWS CodeBuild infrastructure to deploy data-engineering-database-access
Standard content, settings and hooks for data engineering
Generates data using faker and our meta data schemas
Docker image used to automatically validate data
A package to lint data against our meta data schemas
Unit tested functions for cleaning data as part of ETL processes
A python package containing functions that help manage our data management processes on AWS
Fully unit tested utility functions for data engineering. Python 3 only.
Basic wrapper functions to query data using boto3 and Athena
The deflator calculator.
JSONSchema for deploy.json configuration file
DEPRECIATED. For guidance on using databases on the MoJ Analytical Platform. Please refer to the platform guidance
Base conda docker image with some packages installed
Docker Image to run and test the data_linter package
Docker image to parse data from files in github and add them to a data store in lookup tables
A dockerised version of the spark history server which enables us to access metrics in the spark ui from a log generated by AWS glue
An example of an ETL pipeline that lays out or DE processes