Topic: data-quality Goto Github

👇 Here are 279 public repositories matching this topic...

adidas / lakehouse-engine
data-quality,The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
Organization: adidas
Home Page: https://adidas.github.io/lakehouse-engine-docs/
big-data configuration-driven data-engineering data-quality databricks delta-lake framework great-expectations lakehouse spark

aksw / rdfunit
data-quality,An RDF Unit Testing Suite
Organization: aksw
Home Page: http://RDFUnit.aksw.org
shacl rdf data-quality data-quality-checks schema schema-validation web-ontology-language validation unit-testing data-validation

alibaba / feathub
data-quality,FeatHub - A stream-batch unified feature store for real-time machine learning
Organization: alibaba
apache-flink data-engineering data-science feature-engineering feature-store machine-learning streaming data data-quality mlops

astronomer / airflow-provider-great-expectations
data-quality,Great Expectations Airflow operator
Organization: astronomer
Home Page: http://greatexpectations.io
data-science airflow-operators data-quality data-testing airflow airflow-providers

aws-samples / amazon-deequ-glue
data-quality,Automated data quality suggestions and analysis with Deequ on AWS Glue
Organization: aws-samples
deequ aws-glue aws data-quality

bdr76 / csvlint
data-quality,CSV Lint plug-in for Notepad++ for syntax highlighting, csv validation, automatic column and datatype detecting, fixed width datasets, change datetime format, decimal separator, sort data, count unique values, convert to xml, json, sql etc. A plugin for data cleaning and working with messy data files.
User: bdr76
csv notepad-plus-plus plugin fixed-width datasets metadata sorting sql syntax-highlighting tabular-data

canimus / cuallee
data-quality,Possibly the fastest DataFrame-agnostic quality check library in town.
User: canimus
bigdata performance-metrics pyspark python3 unit-testing pydeequ pandas snowpark dataquality data-quality

cleanlab / cleanlab
data-quality,The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Organization: cleanlab
Home Page: https://cleanlab.ai
weak-supervision data-cleaning data-quality data-science noisy-labels data-centric-ai out-of-distribution-detection outlier-detection active-learning data-labeling

cleanlab / cleanvision
data-quality,Automatically find issues in image datasets and practice data-centric computer vision.
Organization: cleanlab
Home Page: https://cleanvision.readthedocs.io/
computer-vision data-centric-ai data-exploration data-quality data-validation deep-learning exploratory-data-analysis image-analysis image-classification image-generation

daochenzha / data-centric-ai
data-quality,A curated, but incomplete, list of data-centric AI resources.
User: daochenzha
ai artificial-intelligence data-centric data-centric-ai data-centric-machine-learning data-curation data-engineering data-quality data-science machine-learning

data-centric-ai-community / awesome-data-centric-ai
data-quality,Open-Source Software, Tutorials, and Research on Data-Centric AI 🤖
Organization: data-centric-ai-community
Home Page: https://datacentricai.community
ai artificial-intelligence awesome awesome-list data data-labelling data-quality data-science data-visualization machine-learning

data-centric-ai-community / awesome-python-for-data-science
data-quality,A curated list of awesome resources such as books, tutorials, courses, open-source libraries, exercises, and other materials that support Pythonistas in the making, and Pythonistas migrating into Data Science! 📊
Organization: data-centric-ai-community
Home Page: http://discord.com/invite/mw7xjJ7b7s
data-science exercises learn-to-code learning-by-doing learning-python learning-resources machine-learning python awesome-list data-quality

data-drift / data-drift
data-quality,Metrics Observability & Troubleshooting
Organization: data-drift
Home Page: https://www.data-drift.io/
context data-monitoring data-observability data-quality dbt metrics semantic-layer dbt-metrics analytics data-diffing

datafold / data-diff
data-quality,Compare tables within or across databases
Organization: datafold
Home Page: https://docs.datafold.com
database mysql postgresql snowflake rdbms trino data-engineering data-quality data-science data-quality-monitoring

encord-team / encord-active
data-quality,The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.
Organization: encord-team
Home Page: https://encord.com/active
computer-vision data data-science data-validation deep-learning machine-learning ml mlops python active-learning

eugeneyan / applied-ml
data-quality,📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
User: eugeneyan
applied-machine-learning production applied-data-science machine-learning data-science reinforcement-learning data-engineering recsys search deep-learning

feast-dev / feast
data-quality,Feature Store for Machine Learning
Organization: feast-dev
Home Page: https://feast.dev
machine-learning features ml big-data feature-store python mlops data-engineering data-science data-quality

feathr-ai / feathr
data-quality,Feathr – A scalable, unified data and AI engineering platform for enterprise
Organization: feathr-ai
Home Page: https://join.slack.com/t/feathrai/shared_invite/zt-1ffva5u6v-voq0Us7bbKAw873cEzHOSg
feature-engineering feature-store artificial-intelligence mlops data-engineering data-quality machine-learning apache-spark azure data-science

featureform / featureform
data-quality,The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
Organization: featureform
Home Page: https://www.featureform.com
machine-learning data-science vector-database embeddings-similarity embeddings hacktoberfest feature-store mlops data-quality feature-engineering

frederick0329 / tracin
data-quality,Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)
User: frederick0329
influence data-quality

gclunies / reflekt
data-quality,Define, govern, and model event data for warehouse-first product analytics.
User: gclunies
avo customer-data-platform data-modeling data-quality data-warehouse dbt dbt-package events governance product-analytics

gokumohandas / made-with-ml
data-quality,Learn how to design, develop, deploy and iterate on production-grade ML applications.
User: gokumohandas
Home Page: https://madewithml.com
machine-learning deep-learning pytorch natural-language-processing data-science python mlops data-engineering data-quality distributed-ml

gokumohandas / mlops-course
data-quality,Learn how to design, develop, deploy and iterate on production-grade ML applications.
User: gokumohandas
Home Page: https://madewithml.com
machine-learning deep-learning pytorch mlops data-engineering data-quality data-science distributed-ml llms natural-language-processing

great-expectations / great_expectations
data-quality,Always know what to expect from your data.
Organization: great-expectations
Home Page: https://docs.greatexpectations.io/
pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest data-unit-tests eda exploratory-data-analysis exploratory-analysis exploratorydataanalysis data-quality data-engineering pipeline-debt data-profilers mlops

great-expectations / great_expectations_action
data-quality,A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.
Organization: great-expectations
actions data-science mlops data-quality data-integrity continuous-integration

hyhyhyhyhyhyh / django-data-quality-system
data-quality,数据治理、数据质量检核/监控平台（Django+jQuery+MySQL）
User: hyhyhyhyhyhyh
Home Page: http://data.sghen.cn
data-quality data-quality-checks data-quality-monitor data-quality-monitoring

impetus / jumbune
data-quality,Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,
Organization: impetus
Home Page: http://www.jumbune.org
hadoop-cluster yarn yarn-hadoop-cluster optimization-framework hadoop hadoop-monitor data-quality data-analysis devops-tools developer-tools monitoring-tool hadoop-monitoring cluster-monitoring apm aiops

infuseai / piperider
data-quality,Code review for data in dbt
Organization: infuseai
Home Page: https://www.piperider.io/
data-pipeline data-profiling data-quality data-science data-exploration eda exploratory-data-analysis data-testing python data-observability

kennethleungty / failed-ml
data-quality,Compilation of high-profile real-world examples of failed machine learning projects
User: kennethleungty
Home Page: https://towardsdatascience.com/when-ai-goes-astray-high-profile-machine-learning-mishaps-in-the-real-world-26bd58692195
ai artificial-intelligence data-science deep-learning machine-learning ml failed-ml computer-vision data-engineering data-quality

kestra-io / kestra
data-quality,Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Organization: kestra-io
Home Page: https://kestra.io
workflow workflow-engine orchestration scheduler data-pipeline elt etl data data-engineering data-orchestration data-orchestrator low-code data-integration reverse-etl data-quality pipeline

kevinadhiguna / dqlab-career-track
data-quality,A collection of scripts written to complete DQLab Data Analyst Career Track 📊
User: kevinadhiguna
dqlab career-track python data-manipulation data-quality data-visualization exploratory-data-analysis sql machine-learning data-analyst

ohdsi / dataqualitydashboard
data-quality,A tool to help improve data quality standards in observational data science.
Organization: ohdsi
Home Page: https://ohdsi.github.io/DataQualityDashboard
data-quality

open-metadata / openmetadata
data-quality,Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.
Organization: open-metadata
Home Page: https://open-metadata.org
metadata datadiscovery data-science dataquality data-profiling metadata-management dataengineering data-catalog data-observability dbt

opendatadiscovery / awesome-data-catalogs
data-quality,📙 Awesome Data Catalogs and Observability Platforms.
Organization: opendatadiscovery
data-catalog data-discovery metadata dataops awesome observability data-engineering data-quality big-data opensource open-source ml awesome-list oss opendata datadiscovery metadata-management datacatalog

opendatadiscovery / odd-platform
data-quality,First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
Organization: opendatadiscovery
Home Page: https://opendatadiscovery.org
oss data-platform metadata metadata-management data-pipelines data-engineering observability data-catalog datacatalog data-discovery

polyaxon / traceml
data-quality,Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.
Organization: polyaxon
pandas pandas-summary dataframes data-science spark dask plotly statistics matplotlib data-profiling

re-data / dbt-re-data
data-quality,re_data - fix data issues before your users & CEO would discover them 😊
Organization: re-data
Home Page: https://getre.io
data-quality dbt data-monitoring data-observability data-testing dbt-packages sql

re-data / re-data
data-quality,re_data - fix data issues before your users & CEO would discover them 😊
Organization: re-data
Home Page: https://docs.getre.io/latest/docs/start_here
data-monitoring data-analysis data-quality data-quality-monitoring open-source-tooling data-observability dataquality data-testing data-quality-checks dbt

rstudio / pointblank
data-quality,Data quality assessment and metadata reporting for data frames and database tables
Organization: rstudio
Home Page: https://rstudio.github.io/pointblank/
data-validation database-tables data-dictionaries easy-to-understand data-frames reporting-tool data-profiler data-management schema-validation data-verification

seddryck / nbi
data-quality,NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile your test suite. Just create an Xml file and let the framework interpret it and play your tests. The framework is designed as an add-on of NUnit but with the possibility to port it easily to other testing frameworks.
User: seddryck
Home Page: http://www.nbi.io
nunit database cube etl business-intelligence test-automation test-framework data-quality data-quality-checks

socialpoint-labs / sqlbucket
data-quality,Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.
Organization: socialpoint-labs
sql etl etl-framework data-integrity data-quality-checks data-quality data-engineering-workflows

sodadata / soda-core
data-quality,:zap: Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
Organization: sodadata
Home Page: https://go.soda.io/core-docs
python data-engineering data-governance data-monitoring data-observability data-profiling data-quality data-quality-checks data-quality-monitoring data-reliability

swiple / swiple
data-quality,Swiple enables you to easily observe, understand, validate and improve the quality of your data
Organization: swiple
Home Page: https://swiple.io
data data-analytics data-observability data-profiling data-quality data-quality-checks data-quality-framework data-quality-monitoring data-reliability data-science fastapi observability python swiple validation

treeverse / lakefs
data-quality,lakeFS - Data version control for your data lake | Git for data
Organization: treeverse
Home Page: https://docs.lakefs.io
data-engineering data-versioning go object-storage data-lake aws-s3 data-quality azure-blob-storage google-cloud-storage golang

ubisoft / mobydq
data-quality,:whale: Tool to automate data quality checks on data pipelines
Organization: ubisoft
Home Page: https://ubisoft.github.io/mobydq/
big-data data-pipeline data-quality data-quality-checks data-quality-monitoring data-warehouse

voxel51 / fiftyone
data-quality,The open-source tool for building high-quality datasets and computer vision models
Organization: voxel51
Home Page: https://fiftyone.ai
machine-learning artificial-intelligence deep-learning computer-vision developer-tools data-science python active-learning data-centric-ai data-cleaning

webankfintech / qualitis
data-quality,Qualitis is a one-stop data quality management platform that supports quality verification, notification, and management for various datasource. It is used to solve various data quality problems caused by data processing. https://github.com/WeBankFinTech/Qualitis
Organization: webankfintech
quality quality-check quality-improvement data-quality linkis dss datashperestudio workflow data-quality-model compare

whylabs / whylogs
data-quality,An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈
Organization: whylabs
Home Page: https://whylogs.readthedocs.io/
ai-pipelines approximate-statistics statistical-properties data-quality calculate-statistics python logging mlops dataops ml-pipelines

whylabs / whylogs-java
data-quality,Profile and monitor your ML data pipeline end-to-end
Organization: whylabs
ai-pipelines approximate-statistics dataset data-quality statistics whylogs aiops mlops spark apache-spark

ydataai / ydata-profiling
data-quality,1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
Organization: ydataai
Home Page: https://docs.profiling.ydata.ai
pandas-profiling pandas-dataframe statistics jupyter-notebook exploration data-science python pandas machine-learning deep-learning