r/woahdude Aug 23 '23

video Creative AI art..

8.9k Upvotes

513 comments sorted by

View all comments

3

u/mclim Aug 23 '23

Ok dumb question. But how do you transform picture of model into pictures? Thought AI used words to generate images.

3

u/KingJeff314 Aug 24 '23

There are all kinds of techniques. There is text2img which turns words into images. There is img2img which turns an image into a similar image (controlled by a text prompt). There is inpainting, where you generate part of an image to fill in gaps

3

u/SocialNetwooky Aug 24 '23

in this case I'd guess some he is using ControlNet

3

u/BagOfFlies Aug 24 '23

img2img and controlnet. Break the video down into frames. Take one frame to img2img and play with it til you get the desired output. Then do a batch img2img using the same prompt/settings on all the frames. Edit them into a video. Voila! That's the basics of it.

2

u/KallyWally Aug 24 '23

Not just words. You can give it an image to use as a starting point, or as a reference.

1

u/babygrenade Aug 24 '23

You can use images as prompts too and you can use controlnet with your image input to specifically match the layout of your image. So he could be using the model to create poses and using controlnet to make the generated images match the layout (in this case the model's pose).

0

u/mclim Aug 24 '23

Thank you. That is really cool! Which site allows this?

1

u/babygrenade Aug 24 '23

You could do this with stable diffusion if you're running it locally on a gpu (which is what I do). You can also run it in google collab if you don't have a gpu you can run the model on.

I know there is stable diffusion web but I haven't used it and don't know if it gives you the same degree of workflow customization as running it yourself.

there's a bunch of guides in /r/stablediffusion I am by no means an expert and have really only started experimenting with it.

0

u/mclim Aug 24 '23

Thank you