Reading list for research topics in multimodal machine learning
-
Updated
Jun 5, 2024
Reading list for research topics in multimodal machine learning
An open-source framework for training large multimodal models.
Papers, code and datasets about deep learning and multi-modal learning for video analysis
A curated list of Multimodal Related Research.
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
A Comparative Framework for Multimodal Recommender Systems
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.
Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem. ⭐ Star to support our work!
[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain
[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition
A PyTorch implementation of "Multimodal Generative Models for Scalable Weakly-Supervised Learning" (https://arxiv.org/abs/1802.05335)
ICCV 2023 Papers: Discover cutting-edge research from ICCV 2023, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. ⭐ support visual intelligence development!
A collection of resources on applications of multi-modal learning in medical imaging.
A paper list of pre-trained language models (PLMs).
Multi-modality pre-training
A curated list of awesome vision and language resources (still under construction... stay tuned!)
[AAAI 2018] Memory Fusion Network for Multi-view Sequential Learning
Add a description, image, and links to the multimodal-learning topic page so that developers can more easily learn about it.
To associate your repository with the multimodal-learning topic, visit your repo's landing page and select "manage topics."