Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem at high resolutions using PuLID embeddings #22

Open
self-destruction opened this issue May 13, 2024 · 1 comment
Open

Problem at high resolutions using PuLID embeddings #22

self-destruction opened this issue May 13, 2024 · 1 comment

Comments

@self-destruction
Copy link

I'm using a slightly modified version of the original PuLID. The change is to use a custom SDXL model, in my case Juggernaut-XL-v9. If you use a square resolution, everything works fine at low resolution. However, having tested the 2048x2048 resolution, the face literally blurred out of shape in the final image.
Unfortunately, I can't provide this image right now. But you can easily replicate it by taking my cli-version of PuLID and running it with the command python app.py --save_dir ‘{OUTPUT_DIR}/PuLID_output’ --save_file_name ‘{filename}’ --face_img ‘{face_img}’ --h 2048 --w 2048.
Also, if you want to examine this code, the first thing you should look at is this file: https://github.com/self-destruction/PuLID_cli/blob/main/pulid/pipeline.py. As you can see, I have temporarily commented out the using of hidiffusion there.
Thanks for your work!

@self-destruction
Copy link
Author

I will also add that I use the following commands to install dependencies:

!pip install diffusers==0.27.0 
!pip install transformers==4.36.2
!pip install einops ftfy basicsr facexlib insightface onnxruntime-gpu accelerate timm apex opencv-python spaces==0.19.4
!pip install --pre xformers==0.0.20
!pip install torchvision==0.15.2+cu118 --index-url https://download.pytorch.org/whl/cu118
!pip install torch==2.0.1+cu118 --index-url https://download.pytorch.org/whl/cu118
!pip install --upgrade numpy
!pip install hidiffusion

Yes, it's a bit messy, but it works for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant