qinxuye Goto Github PK

ai-infra-landscape

This is a landscape of the infrastructure that powers the generative AI ecosystem

atlas

A Framework for Model-Backed Generators. Backend for AutoPandas (https://autopandas.io)

auto-llama-cpp

Uses Auto-GPT with Llama.cpp

awesome-python

A curated list of awesome Python frameworks, libraries, software and resources

azureftp

A ftp software implemented in Azure platform

bodo-examples

carte

Carte is a hyper-graph parallel computation framework.

chineblog

My blog: qinxuye.me

cloudbackup

Data backup to several cloud storage in security.

codecracking

My solution of wirtten or interview questions.

cola

A high-level distributed crawling framework.

dask

Parallel computing with task scheduling

dataframe-benchmarks

dataframe_sql

Parses sql and interprets it as methods that act upon existing data frames that have been declared and registered

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

distributed-python

Python 分布式编程

eht-imaging

Imaging, analysis, and simulation software for radio interferometry

functionary

Chat language model that can interpret and execute functions/plugins

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

huggingface-datasets-text-quality-analysis

Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in dataset using pandas

inference

Xorbits Inference(Xinference) is a powerful and versatile library designed to serve language, speech recognition, and multimodal models.

io

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

keras

Deep Learning for humans

libvineyard

llama-factory

Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM2)

mars

Mars is a tensor-based unified framework for large-scale data computation.

mars-example

mars-profiling

Create HTML profiling reports from Mars DataFrame objects

mars.github.io

Mars website

martian

Mars client beyond Python.