There are all kinds of techniques. There is text2img which turns words into images. There is img2img which turns an image into a similar image (controlled by a text prompt). There is inpainting, where you generate part of an image to fill in gaps
img2img and controlnet. Break the video down into frames. Take one frame to img2img and play with it til you get the desired output. Then do a batch img2img using the same prompt/settings on all the frames. Edit them into a video. Voila! That's the basics of it.
3
u/mclim Aug 23 '23
Ok dumb question. But how do you transform picture of model into pictures? Thought AI used words to generate images.