- ๐ค Machine Learning Intern at @HuggingFace. Working on
optimum-benchmark
; an open source library aiming to create a benchmarking utility for any model on HuggingFace's Hub supporting Optimum's inference & training, optimizations & quantizations, on different backends & hardwares (OnnxRuntime, Intel Neural Compressor, OpenVINO, Habana Gaudi Processor (HPU), etc).
ilyasmoutawwakil / py-txi Goto Github PK
View Code? Open in Web Editor NEWA Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
License: Apache License 2.0