Giter Club home page Giter Club logo

[2023.08 - Current] LLM Researcher @Kakaobrain

  • Developing Language Foundation Model a.k.a. KoGPT2

[2020.03 - 2023.08] Machine Learning Engineer @SK Telecom & EleutherAI

  • Developing Large Language Model for SK Telecom
  • Developed Multimodal AI Service at SKT A.
    • AI Eraser (Object Removal with Image Inpainting)
      • role: project manager & implementation of pipeline algorithm (segmentation postprocessing & enhancement in inpainting performance).
  • Developing polyglot and oslo project at EleutherAI
    • polyglot: Large Language Models of Well-balanced Competence in Multi-languages
      • role: distributed training of LM with Megatron LM & data crawling, preprocessing and model evaluaton. Published 1.3B, 3.8B, 5.8B, 12.8B polyglot-ko models.
    • oslo: Open Source for Large-scale Optimization
      • role: tensor parallel 1D, 2D, 3D implementation.

Interest

  • Foundation Model / NLP / Multimodal AI

Linkedin Badge Gmail Badge Google Scholar Badge

Minho Ryu's Projects

adamp icon adamp

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights

airbnb-clone icon airbnb-clone

Cloning Airbnb using Python, Django, Tailwind and more...

bert-aad icon bert-aad

Adversarial Adaptation with Distillation for BERT Unsupervised Domain Adaptation

bert-as-service icon bert-as-service

Mapping a variable-length sentence to a fixed-length vector using BERT model

dalle-mini icon dalle-mini

DALLΒ·E Mini - Generate images from a text prompt

datasets icon datasets

πŸ€— Fast, efficient, open-access datasets and evaluation metrics in PyTorch, TensorFlow, NumPy and Pandas

dialogwae icon dialogwae

Source Code for DialogWAE: Multimodal Response Generation with Conditional Wasserstein Autoencoder (https://arxiv.org/abs/1805.12352)

ea-lstm icon ea-lstm

EA-LSTM: Evolutionary attention-based LSTM for time series prediction

flamingo-pytorch icon flamingo-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

image-gpt icon image-gpt

PyTorch Implementation of OpenAI's Image GPT, trained on MNIST and Fashion MNIST

kobigbird icon kobigbird

πŸ¦… Pretrained BigBird Model for Korean (up to 4096 tokens)

kss icon kss

Kss: A Toolkit for Korean sentence segmentation

lama icon lama

πŸ¦™ LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022

lightning-hydra-template icon lightning-hydra-template

PyTorch Lightning + Hydra. A very general, feature-rich template for rapid and scalable ML experimentation with best practices. ⚑πŸ”₯⚑

lightning-transformers icon lightning-transformers

Flexible interface for high-performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.