jamespark3922 Goto Github PK

adv-inf

Adversarial Inference for Multi-Sentence Video Descriptions (CVPR 2019)

ask-anything

[VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

cider

python codes for CIDEr - Consensus-based Image Caption Evaluation

coco-caption

densevid_eval

Evaluation code for Dense-Captioning Events in Videos

grounded-segment-anything

Grounded-SAM: Marrying Grounding-DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

localized-skd

Localized Symbolic Knowledge Distillation for Visual Commonsense Models (Neurips 2023]

lsmdc-baseline

lsmdc-fillin

Identity-Aware Multi-Sentence Video Description

movie_eval

nlg-eval

Evaluation code for various unsupervised automated metrics for Natural Language Generation.

retro-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

self-critical.pytorch

Unofficial pytorch implementation for Self-critical Sequence Training for Image Captioning

video-chatgpt

"Video-ChatGPT" is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

video-lang-contrast-set

video-llama

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

visual-comet

VisualCOMET: Reasoning about the Dynamic Context of a Still Image