Topic: data-cleaning Goto Github

Some thing interesting about data-cleaning

👇 Here are 2674 public repositories matching this topic...

aai-institute / pydvl

data-cleaning,pyDVL is a library of stable implementations of algorithms for data valuation and influence function computation

Organization: aai-institute

Home Page: https://pydvl.org

data-valuation shapley-value machine-learning transferlab least-core influence-functions game-theory data-quality robust-machine-learning data-centric-ai

ajaymache / data-analysis-using-python

data-cleaning,Exploratory data analysis 📊using python 🐍of used car 🚘 database taken from ⓚ𝖆𝖌𝖌𝖑𝖊

User: ajaymache

data-science data-analysis data-visualization data-cleaning data-cleansing data-wrangling data-science-python data-analytics data-analysis-python eda

akanz1 / klib

data-cleaning,Easy to use Python library of customized functions for cleaning and analyzing data.

User: akanz1

Home Page: https://medium.com/p/97191d320f80

data-science data-analysis klib data-visualization python feature-selection data-cleaning data-preprocessing

akvo / akvo-lumen

data-cleaning,Make sense of your data

Organization: akvo

Home Page: https://akvo.org/akvo-lumen

clojure akvo d3 react agplv3 akvo-lumen data-visualization data-cleaning

awesome-mlops / awesome-ml-monitoring

data-cleaning,A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

Organization: awesome-mlops

mlops aiops dataops datascience machine-learning concept-drift data-cleaning data-drift data-management data-monitoring

data-cleaning,CSV Lint plug-in for Notepad++ for syntax highlighting, csv validation, automatic column and datatype detecting, fixed width datasets, change datetime format, decimal separator, sort data, count unique values, convert to xml, json, sql etc. A plugin for data cleaning and working with messy data files.

User: bdr76

csv notepad-plus-plus plugin fixed-width datasets metadata sorting sql syntax-highlighting tabular-data

cambioml / uniflow-llm-based-pdf-extraction-text-cleaning-data-clustering

data-cleaning,LLM-based text extraction from unstructured data like PDFs, Words and HTMLs. Transform and cluster the text into your desired format. Less information loss, more interpretation, and faster R&D!

User: cambioml

Home Page: https://www.cambioml.com

data-cleaning generative-ai llm

charlesdedampierre / bunkatopics

data-cleaning,🗺️ Data Cleaning and Textual Data Visualization 🗺️

User: charlesdedampierre

Home Page: https://charlesdedampierre.github.io/BunkaTopics/index.html

natural-language-processing nlp topic-modeling cartography llms machine-learning summarization data-cleaning explainability fine-tuning

chrismuir / refinr

data-cleaning,Cluster and merge similar string values: an R implementation of Open Refine clustering algorithms

User: chrismuir

openrefine fuzzy-matching ngram approximate-string-matching data-cleaning data-clustering clustering cran r rstats

cleanlab / cleanlab

data-cleaning,The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Organization: cleanlab

Home Page: https://cleanlab.ai

weak-supervision data-cleaning data-quality data-science noisy-labels data-centric-ai out-of-distribution-detection outlier-detection active-learning data-labeling

cosbidev / pytrack

data-cleaning,a Map-Matching-based Python Toolbox for Vehicle Trajectory Reconstruction

Organization: cosbidev

Home Page: https://pytrack-lib.readthedocs.io/en/latest/#

map-matching python tracking intelligent-transportation-systems snapping data-cleaning network-graph networkx maps openstreetmap

data-cleaning / validate

data-cleaning,Professional data validation for the R environment

Organization: data-cleaning

r validation data-cleaning

data-forge / data-forge-ts

data-cleaning,The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

Organization: data-forge

Home Page: http://www.data-forge-js.com/

data-wrangling data-forge data data-analysis javascript nodejs linq pandas visualization data-visualization

desbordante / desbordante-core

data-cleaning,Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

Organization: desbordante

data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-profiling data-science data-wrangling data-preprocessing

ecnu-icalk / educhat

data-cleaning,An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM

Organization: ecnu-icalk

Home Page: http://educhat.top/

belle chinese-nlp data-cleaning education llama llm moss open-models

ekstroem / datamaid

data-cleaning,An R package for data screening

User: ekstroem

data-screening reproducible-research data-cleaning

encord-team / encord-active

data-cleaning,The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.

Organization: encord-team

Home Page: https://encord.com/active

computer-vision data data-science data-validation deep-learning machine-learning ml mlops python active-learning

genomoncology / fuzztypes

data-cleaning,Pydantic extension for annotating autocorrecting fields.

Organization: genomoncology

Home Page: https://genomoncology.com

data-cleaning fuzzy-string-matching named-entity-linking pydantic

hi-primus / bumblebee

data-cleaning,🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)

Organization: hi-primus

Home Page: https://hi-bumblebee.com/

data-profiling data-cleaning bumblebee gui data-preparation python dask optimus gpu cudf

hi-primus / optimus

data-cleaning,:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

Organization: hi-primus

Home Page: https://hi-optimus.com

spark pyspark data-wrangling bigdata big-data-cleaning data-science data-cleansing data-cleaner data-transformation machine-learning

holoclean / holoclean-legacy-deprecated

data-cleaning,A Machine Learning System for Data Enrichment.

Organization: holoclean

Home Page: http://www.holoclean.io

machine-learning inference-engine pytorch data-science data-enrichment data-cleaning

iam-mhaseeb / skytrax-data-warehouse

data-cleaning,A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

User: iam-mhaseeb

python python3 database data-visualization data-analysis data-warehouse data-warehousing redshift airflow docker

ibug-group / fpage

data-cleaning,FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild

Organization: ibug-group

age-estimation age-classification imdb-wiki-dataset data-cleaning face-analysis facial-attributes gender-classification face-parsing attention-mechanism ibug

iqrar99 / data-analytics-portfolio

data-cleaning,Portfolio of data science and data analyst projects completed by me for academic, self learning, and hobby purposes.

User: iqrar99

python data-science data-analyst data-analysis data-visualization-project data-visualisation data-mining data-cleaning data-visualization data-analytics

jim-schwoebel / allie

data-cleaning,🤖 An automated machine learning framework for audio, text, image, video, or .CSV files (50+ featurizers and 15+ model trainers). Python 3.6 required.

User: jim-schwoebel

machine-learning deep-learning machine-learning-library machine-learning-api automl tpot data-augmentation data-cleaning datasets machine-learning-models

jim-schwoebel / voicebook

data-cleaning,🗣️ A book and repo to get you started programming voice computing applications in Python (10 chapters and 200+ scripts).

User: jim-schwoebel

Home Page: https://neurolex.ai/voicebook

voice voice-assistant voice-recognition voice-recording transcription featurization data data-cleaning visualization generation

johnkerl / miller

data-cleaning,Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

User: johnkerl

Home Page: https://miller.readthedocs.io

data-processing data-cleaning csv csv-format streaming-data streaming-algorithms tsv json json-data data-reduction

justmarkham / dat8

data-cleaning,General Assembly's 2015 Data Science course in Washington, DC

User: justmarkham

data-science machine-learning scikit-learn data-analysis pandas jupyter-notebook python course linear-regression logistic-regression

justmarkham / pandas-videos

data-cleaning,Jupyter notebook and datasets from the pandas video series

User: justmarkham

Home Page: https://courses.dataschool.io/pandas-in-30-days

data-science jupyter-notebook python pandas tutorial data-analysis data-cleaning

kulikdm / pythresh

data-cleaning,Outlier Detection Thresholding

User: kulikdm

Home Page: https://pythresh.readthedocs.io/en/latest/?badge=latest

contamination-detection data-cleaning filtering-algorithm outlier-detection outlier-selection thresholding

laureberti / learn2clean

data-cleaning,Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning

User: laureberti

reinforcement-learning data-cleaning data-cleaning-pipeline automated data-curation data-preprocessing

librarycarpentry / lc-open-refine

data-cleaning,Library Carpentry: OpenRefine

Organization: librarycarpentry

Home Page: https://librarycarpentry.org/lc-open-refine/

carpentries library-carpentry lesson openrefine data-cleaning data-management english stable

lolei / redditcleaner

data-cleaning,Cleans Reddit Text Data :scroll: :broom:

User: lolei

reddit pushshift data-cleaning text-data nlp python praw psaw hacktoberfest

msamogh / nonechucks

data-cleaning,Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!

User: msamogh

pytorch data-processing data-preprocessing data-pipeline data-cleaning preprocessing machine-learning torch

msberends / clean

data-cleaning,Fast and Easy Data Cleaning (in R)

User: msberends

Home Page: https://msberends.github.io/clean

r data-cleaning

opendataval / opendataval

data-cleaning,OpenDataVal: a Unified Benchmark for Data Valuation in Python (NeurIPS 2023)

Organization: opendataval

Home Page: https://opendataval.github.io/

data-valuation machine-learning python research statistics data-centric-ai data-cleaning game-theory

probcomp / pclean

data-cleaning,A domain-specific probabilistic programming language for scalable Bayesian data cleaning

Organization: probcomp

probabilistic-programming probabilistic-graphical-models data-cleaning data-cleansing bayesian-inference

rasgointelligence / feature-engineering-tutorials

data-cleaning,Data Science Feature Engineering and Selection Tutorials

Organization: rasgointelligence

Home Page: https://www.rasgoml.com/

notebook tutorials tutorial python pandas data-science machine-learning scikit-learn feature-engineering feature-selection

renumics / sliceguard

data-cleaning,A library for detecting problematic data segments in structured and unstructured data with few lines of code.

User: renumics

data-analysis data-cleaning data-curation data-exploration data-science data-visualization deep-learning exploratory-data-analysis machine-learning python visualization eda

ropensci / taxa

data-cleaning,taxonomic classes for R

Organization: ropensci

Home Page: https://docs.ropensci.org/taxa

taxonomy taxon data-cleaning rstats r r-package

rvanasa / pandas-gpt

data-cleaning,Power up your data science workflow with ChatGPT.

User: rvanasa

Home Page: https://pypi.org/project/pandas-gpt

chatgpt data-engineering data-science data-visualization low-code matplotlib numpy openai pandas productivity

schema-inspector / schema-inspector

data-cleaning,Schema-Inspector is a simple JavaScript object sanitization and validation module.

Organization: schema-inspector

Home Page: http://schema-inspector.github.io/schema-inspector/

javascript validation sanitization data-cleaning

scottythered / gratefuldata

data-cleaning,Grateful Data isn't programming code, but an online tutorial about data acquisition, cleaning and enriching, using publicly accessible data on the band the Grateful Dead as examples. Read the Wiki to find out how to use the sample data.

User: scottythered

grateful-dead grateful-data data-acquisition digital-humanities open-refine data-cleaning

sfirke / janitor

data-cleaning,simple tools for data cleaning in R

User: sfirke

Home Page: http://sfirke.github.io/janitor/

data-cleaning data-science data-analysis r pivot-tables dirty-data tabulations spss excel tidyverse

sharad461 / nepali-translator

data-cleaning,Neural Machine Translation on the Nepali-English language pair

User: sharad461

machine-translation nepali-english parallel-corpus data-cleaning

sharmaroshan / drugs-recommendation-using-reviews

data-cleaning,Analyzing the Drugs Descriptions, conditions, reviews and then recommending it using Deep Learning Models, for each Health Condition of a Patient.

User: sharmaroshan

recommendation-system data-visualization data-analysis data-mining data-cleaning feature-engineering feature-selection machine-learning deep-learning hybrid-model