milankalkenings / multimodal_hateful_memes_detection Goto Github PK
View Code? Open in Web Editor NEWA modular transformer for detecting hateful memes. The model contains 6 submodels for creating input embeddings: 1. BERT embedder (text), 2. sentiment embedder (text), 3. association embedder via knowledge graph (text), 4. CNN embedder (image), 5. VisualBERT embedder (image), 6. Object embedder (image)