Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ImagePanelLayoutInvocation utility to facilitate In-Context LoRA workflows #7374

Merged
merged 2 commits into from
Nov 27, 2024

Conversation

RyanJDick
Copy link
Collaborator

Summary

This PR adds a ImagePanelLayoutInvocation that makes it easy to calculate the coordinates of panels within an image grid. This utility invocation is intended to make it easier to experiment with In-Context LoRA workflows.

Example 1: Reference-Based In-Context LoRA - Reference Logo Consistency

Instructions:

  1. Install this LoRA: https://huggingface.co/ali-vilab/In-Context-LoRA/blob/main/visual-identity-design.safetensors
  2. Load the sample workflow: flux_icl_single_reference_image.json
  3. Run.

Workflow
image

Sample output (cherry-picked, full grid):
image

Sample output (cherry-picked, cropped):
image

Example 2: Reference-Free In-Context LoRA - Character Consistency

Instructions:

  1. Install this LoRA: https://huggingface.co/ali-vilab/In-Context-LoRA/blob/main/film-storyboard.safetensors
  2. Load the sample workflow: flux_icl_reference_free.json
  3. Run.

Sample output:
image

QA Instructions

Tested via the example workflows shown above.

Merge Plan

No special instructions.

Checklist

  • The PR has a short but descriptive title, suitable for a changelog
  • Tests added / updated (if applicable)
  • Documentation added / updated (if applicable)
  • Updated What's New copy (if doing a release after this PR)

@github-actions github-actions bot added python PRs that change python files invocations PRs that change invocations labels Nov 22, 2024
@psychedelicious psychedelicious enabled auto-merge (rebase) November 27, 2024 04:49
@psychedelicious psychedelicious merged commit 8cfb032 into main Nov 27, 2024
14 checks passed
@psychedelicious psychedelicious deleted the ryan/icl2 branch November 27, 2024 04:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invocations PRs that change invocations python PRs that change python files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants