zinengtang Goto Github PK

audio-diffusion

Apply diffusion models using the new Hugging Face diffusers package to synthesize music instead of images.

audioclip

Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)

audioldm

AudioLDM: Generate speech, sound effects, music and beyond, with text.

continuousflownlg

Pytorch version of Continuous Language Generative Flow (ACL 2021)

cs184_finalproject

Computational Design of High-level Interlocking Puzzles (Siggraph 2022 Journal Track Paper)

decembert

Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)

i-code

make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

perceiver_vl

PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

tvlt

PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)

udop

vidlankd

Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))

vilt

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

youtube-dl

Command-line program to download videos from YouTube.com and other video sites

zinengtang.github.io

Personal Website