MMET

Code and data for the paper "Multimodal Entity Tagging with Multimodal Knowledge Base".

Setup

bash build.sh 

You need to start elasticsearch service manually. See https://www.elastic.co/downloads/elasticsearch.

Run

First, run retrieval code to (1) construct retrieval data base for text and image; (2) retrieve text and image from data base.
Then train a reranker to re-rank text and image.