Some info about using AI to create videos for in game use. I've been working on that too for a couple of months already. Even before it started here.
It can help, but it's not a quick process if you want good results. You have to create a lot of videos until you get some where the quality is acceptable for what I want to use in the game.
Basically you're facing the following problems:
- Character inconsistencies or changes in the video. This can be the face, the clothes, the breasts size or other things like the background
- Extreme changes in lighting that are noticeable so that the video is not useable
- If the character is too small, most of the time that's the case when you show all of it, including legs, the face becomes a mess.
- You can use sprites, but it's a lenghty process and not always perfect. It speeds up video creation and you will not have the problem that the character is too small. But creating a consistent alpha channel is never perfect.
- Video resolution. You cannot create videos in full HD (or 2560x1440) that have a reasonable length. So you always have to upscale them. This isn't a problem as long as there is movement. But if you want to use single frames and use still images from the video it becomes a noticeable problem
- Not everything can be animated. One character works well enough as long as the performed action is something widely used and seen. So dancing, breats juggling, groping, drinking, even undressing works okay. But sex scenes are a different matter. Mostly it doesn't work at all or at least not well enough to be useable. Also specific things like climbing a ladder to leave the pool don't work well.
- Often you want to have videos that can be looped. Defining start and end frame for a video will lead to bad results most of the time. You can try to play it backwards. But this doesn't always work or is easy either if you don't want it to be very noticeable.
- And another not really AI related problem. Too many videos will blow up the game file size, making it very hard to use on android devices.
To give you an idea about the involved steps in creating a loopable sprite video.
- Create a render that works as a base. Character without a bakcground. Leave enough space on all sides to allow for movement.
- Create the animation/video using AI with whatever action you want to see. E.g. dancing. That's 20 or 30 and you pick the best.
- Remove the background, create alpha channels for each frame of the video
- Remove hue and color shifts on all images
- Upscale the image, it might be necessary to improve the face slightly
- Overlay the sprite video on a background to save space (alternatively you can create a side by side sprite + alpha video) to use in renpy directly
Here is an example, downscaled to 1280x720
If you look closely, you can see that the alpha channel around the hair isn't perfect.
Also the fingernails on her right hand are changing color, giving them a flickering effect.
Now these are 107 single frames looped. Doing a manual correction will take far too much time.
So if you want to use it, that's how it would look in game.
Zoom, etc. can be added with the renpy engine.
View attachment 5462677