shintaro-iwasaki Goto Github PK

followers: 24.0 following: 0.0 repos: 39.0 gists: 0.0

Name: Shintaro Iwasaki

Type: User

Blog: https://shintaro-iwasaki.github.io/

Shintaro Iwasaki's Projects

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

dist_shampoo

For optimization algorithm research and development.

ecp-st-car-public

The Exascale Computing Project Software Technologies Capability Assessment Report - Public Version

fbgemm

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as recommendation and natural language processing. We showed this library can reduce the total model size by up to 100x in Facebook’s open sourced DLRM model while achieving same model quality. Our implementation is faster than the state-of-the-art implementations. Existing the state-of-the-art library also decompresses the whole embedding tables on the fly therefore they do not provide memory reduction during runtime of the training. Our library decompresses only the requested rows therefore can provide 10,000 times memory footprint reduction per embedding table. The library also includes a software cache to store a portion of the entries in the table in decompressed format for faster lookup and process.

folly

An open-source C++ library developed and used at Facebook.

izem

jekyll-action

A GitHub Action to publish Jekyll based content as a GitHub Pages site

kineto

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

libevent

Event notification library

llvm-project

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at http://reviews.llvm.org.