Skip to content

Latest commit

 

History

History
55 lines (36 loc) · 1.63 KB

README.md

File metadata and controls

55 lines (36 loc) · 1.63 KB
Raw

Concept Space Traversal Plugin

concept_traversal

This plugin allows you to "traverse" the concept space of a similarity index by adding text prompts (with configurable strength) to a base image.

Note: This plugin requires a similarity index that supports prompts (i.e. embeds text and images) to be present on the dataset. You can create one with:

import fiftyone as fo
import fiftyone.brain as fob

dataset = fo.load_dataset("my_dataset")
fob.compute_similarity(
    dataset,
    brain_key="my_brain_key",
    model="clip-vit-base32-torch",
    metric="cosine",
    )

Watch On Youtube

Video Thumbnail

Installation

fiftyone plugins download https://github.com/jacobmarks/concept-space-traversal-plugin

Refer to the main README for more information about managing downloaded plugins and developing plugins locally.

Operators

open_traversal_panel

  • Opens the concept space traversal panel on click
  • Only activated when the dataset has a similarity index

traverser

  • Runs the Traverser on the dataset

get_sample_url

  • Returns the resource URL of the media file associated with a sample, from the sample's ID.

💪 Development

This plugin was a joint creation between myself and Ibrahim Manjra. Couldn't have done it without his JavaScript wizardry!