Skip to content
This repository has been archived by the owner on Dec 14, 2023. It is now read-only.

About VideoLDM #55

Open
suzhenghang opened this issue Apr 22, 2023 · 7 comments
Open

About VideoLDM #55

suzhenghang opened this issue Apr 22, 2023 · 7 comments
Labels
enhancement New feature or request

Comments

@suzhenghang
Copy link

Do you have any knowledge of VideoLDM, and is it possible to integrate its algorithms to further enhance the capabilities of current models, such as generating longer videos?

@ExponentialML
Copy link
Owner

ModelScope's implementation is very similar to theirs in the sense that they add a temporal dimension to the model.
For long video generation, you could follow this PR which uses a similar idea #27.

@suzhenghang
Copy link
Author

Many thanks. Do you have any recommendations for AI video flicker removal?

@ExponentialML
Copy link
Owner

Many thanks. Do you have any recommendations for AI video flicker removal?

No problem! There was a paper released somewhat recently that supposedly tackles this problem, but I can't seem to find it.

For now, I think using a tool outside of the machine learning domain would suffice.

@suzhenghang
Copy link
Author

Nice,have you tried any tools to alleviate the flickering?

Many thanks. Do you have any recommendations for AI video flicker removal?

No problem! There was a paper released somewhat recently that supposedly tackles this problem, but I can't seem to find it.

For now, I think using a tool outside of the machine learning domain would suffice.

@suzhenghang
Copy link
Author

ModelScope's implementation is very similar to theirs in the sense that they add a temporal dimension to the model. For long video generation, you could follow this PR which uses a similar idea #27.

Do you have plans to integrate this PR later on?

@ExponentialML
Copy link
Owner

Nice,have you tried any tools to alleviate the flickering?

Many thanks. Do you have any recommendations for AI video flicker removal?

No problem! There was a paper released somewhat recently that supposedly tackles this problem, but I can't seem to find it.
For now, I think using a tool outside of the machine learning domain would suffice.

Found it 😉 .

https://github.com/chenyanglei/all-in-one-deflicker

@kabachuha
Copy link
Contributor

This person is trying to implement it in Diffusers, last commit just yesterday

https://github.com/srpkdyy/VideoLDM

@ExponentialML ExponentialML added the enhancement New feature or request label Jun 25, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants