VLAA@UCSC

All

26 repositories

story-adapter
Public
A Training-free Iterative Framework for Long Story Visualization
storytelling generative-model generative-art image-generation visual-storytelling diffusion-models
Python
•
MIT License
•92•686•2•0•Updated Jan 18, 2025Jan 18, 2025
UCSC-VLAA.github.io
Public
HTML
•0•0•0•0•Updated Jan 3, 2025Jan 3, 2025
MedTrinity-25M
Public
This is the official repository of our paper "MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine“
Python
•17•240•8•0•Updated Dec 30, 2024Dec 30, 2024
CLIPS
Public
An Enhanced CLIP Framework for Learning with Synthetic Captions
Python
•
MIT License
•1•25•0•0•Updated Dec 17, 2024Dec 17, 2024
AttnGCG-attack
Public
Python
•
MIT License
•1•13•1•0•Updated Oct 14, 2024Oct 14, 2024
o1_medical
Public
Python
•
Other
•1•41•1•0•Updated Sep 25, 2024Sep 25, 2024
o1_medicine
Public
JavaScript
•0•1•0•0•Updated Sep 24, 2024Sep 24, 2024
Redteaming_Challenge
Public
Python
•0•7•0•0•Updated Sep 4, 2024Sep 4, 2024
Recap-DataComp-1B
Public
This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
1•126•9•0•Updated Jun 13, 2024Jun 13, 2024
AQA-Bench
Public
Algorithmic-Q&A-Bench: An Interactive Benchmark for Evaluating LLMs’ Sequential Reasoning Ability
Python
•
MIT License
•0•4•0•0•Updated Jun 13, 2024Jun 13, 2024
CLIPA
Public
[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
zero-shot-learning multimodal-learning contrastive-learning zero-shot-classification foundation-models neurips-2023 deep-learning pytorch
Python
•
Apache License 2.0
•13•307•1•0•Updated Jun 3, 2024Jun 3, 2024
CRATE-alpha
Public
This repository includes the official implementation our paper "Scaling White-Box Transformers for Vision"
Python
•1•45•1•0•Updated Jun 3, 2024Jun 3, 2024
MicroDiffusion
Public
[CVPR 2024] This repository includes the official implementation our paper "MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projections"
Python
•0•38•2•0•Updated May 13, 2024May 13, 2024
FedConv
Public
[TMLR'24] This repository includes the official implementation our paper "FedConv: Enhancing Convolutional Neural Networks for Handling Data Heterogeneity in Federated Learning"
Python
•
MIT License
•0•25•0•0•Updated Apr 30, 2024Apr 30, 2024
EVP
Public
[TMLR'24] This repository includes the official implementation our paper "Unleashing the Power of Visual Prompting At the Pixel Level"
Python
•
MIT License
•4•37•0•0•Updated Apr 30, 2024Apr 30, 2024
AdvXL
Public
[CVPR 2024] This repository includes the official implementation our paper "Revisiting Adversarial Training at Scale"
Python
•1•18•4•0•Updated Apr 21, 2024Apr 21, 2024
MixCon3D
Public
[CVPR 2024] The official implementation of paper "Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training"
pytorch 3d multimodal-learning contrastive-learning zero-shot-classification foundation-models
Python
•3•32•3•0•Updated Apr 21, 2024Apr 21, 2024
HQ-Edit
Public
HQ-Edit: A High-Quality and High-Coverage Dataset for General Image Editing
Python
•
Other
•3•79•3•0•Updated Apr 18, 2024Apr 18, 2024
Compress-Align
Public
This repository includes the official implementation and dataset of our paper "Compress & Align: Curating Image-Text Data with Human Knowledge".
0•2•1•0•Updated Mar 22, 2024Mar 22, 2024
vllm-safety-benchmark
Public
[ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"
benchmark safety datasets robustness adversarial-attacks llm vision-language-model multimodal-llm
Python
•3•76•0•0•Updated Nov 28, 2023Nov 28, 2023
SwinMM
Public
[MICCAI 2023] This repository includes the official implementation our paper "SwinMM: Masked Multi-view with Swin Transformers for 3D Medical Image Segmentation"
Python
•6•103•0•0•Updated Oct 13, 2023Oct 13, 2023
Sight-Beyond-Text
Public
[TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
alignment vlm ai-alignment vision-language vicuna llm mllm llava llama2
Python
•
Apache License 2.0
•1•19•0•0•Updated Sep 15, 2023Sep 15, 2023
DMAE
Public
[CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
Python
•
Other
•5•103•3•0•Updated Jul 24, 2023Jul 24, 2023
RobustCNN
Public
[ICLR 2023] This repository includes the official implementation our paper "Can CNNs Be More Robust Than Transformers?"
Python
•
MIT License
•13•143•0•0•Updated Jan 23, 2023Jan 23, 2023
Image-Pretraining-for-Video
Public
[ECCV 2022] This repository includes the official implementation our paper "In Defense of Image Pre-Training for Spatiotemporal Recognition".
image-classification video-understanding 3d-convolutional-network eccv2022 action-recognition
Python
•
MIT License
•0•19•1•0•Updated Dec 22, 2022Dec 22, 2022
vit_cert
Public
[ECCV 2022] This repository includes the official implementation our paper "ViP: Unified Certified Detection and Recovery for Patch Attack with Vision Transformers"
Python
•0•3•0•0•Updated Jul 21, 2022Jul 21, 2022