Animating with AI? No problem! Full guide for how I make the animated scenes for my game using GenAI.

FurryBangTown

FBTdev
Game Developer
Oct 18, 2024
15
126
Hello everyone! In order to start this I assume you already know how to create AI images this guide is about taking those images and turning it into something animated.

I've been messing around with generative AI for the past few months and I've been improving pretty quick. I've attached some samples so you can see the results. I wanted to share with what I've learned with others.

2OldOld.gif First Attempt
2Old.gif Second Attempt (What's currently in my game)
2New.gif Third Attempt (Not in the game yet, soon)

To make these its important to realize how powerful a tool Image2Image is. To make consistent images and animations you need to utilize it, Its a little more work that just using Text2Image prompts but anyone can do it.

To create something like the 3rd try follow the below steps:

Generate an image to use as your starting frame

Text2Image model -> 1.png .

The plan for this is to animate a handjob.

Using a tool like photoshop you can make edits to this image like moving her hand around.
I put the hand on a separate layer so I can move it around as I wish. 3.png , 4.png

I created 6 frames total of the hand moving up the shaft.

Now you use Image2Image to feed your edit back to the AI model while also using the same prompt. Make sure your denoise is set to something low like 0.2-0.5 to keep the image consistent. but not so low that the AI model isn't able to change anything.

This has the effect of removing any jankyness caused your/my edits as you can see here: 5.png

Now you've created 6 cleaned up frames but your not done yet.

OPTIONAL:
Now's the time to upscale those frames before you move on if you want something high res


Feed those 6 frames trough an and boom you can double them to 12 and also create a smoothing effect.

Once your done that just make it into a gif and enjoy.

Result: 6.gif
 

AlternateDreams

I'm tired, boss.
Game Developer
Apr 6, 2021
209
472
Found this animation (artist: hannahasami)
Do you guys know which tools could have been used to generate it? Considering the result I'm assuming this is not a local install unfortunately
View attachment moar.mp4
 

osanaiko

Engaged Member
Modder
Jul 4, 2017
2,832
5,319
A lot of the softcore and basic jailbreak topless etc stuff i've seen has been from Tencent's Hunyuan Ai video.

With no watermark and no original to see the meta data, there's no way to tell for sure where the resized/format converted clip you posted is from.

Edit: just remembered there is one called Hailuo too.
 
Last edited:
  • Like
Reactions: AlternateDreams

NoTraceOfLuck

Member
Game Developer
Apr 20, 2018
238
353
Found this animation (artist: hannahasami)
Do you guys know which tools could have been used to generate it? Considering the result I'm assuming this is not a local install unfortunately
This is Kling

Unfortunately it's very expensive. $0.50 per video and most attempts to make a video will produce garbage, it can take 5-10 videos to get something of good quality
 
  • Like
Reactions: AlternateDreams

jamescam

Newbie
Sep 24, 2018
33
42
Hey guys I am new to AI ART , I found out that wan2.1 image to video works really well on my 2080ti , 20 steps with tea cache on 512x512 resolution image equal about 4 : 45 mins , any other way to lower it to 1min or 2min? thanks , will be posting soon ;)
 
Last edited:

Waterthose

Member
Game Developer
Sep 14, 2024
381
803
Hey guys I am new to AI ART , I found out that wan2.1 image to video works really well on my 2080ti , 20 steps with tea cache on 512x512 resolution image equal about 4 : 45 mins , any other way to lower it to 1min or 2min? thanks , will be posting soon ;)
Only a better GPU can cut down the time for wan 2.1.
 

thereald00d

Newbie
Jun 3, 2021
15
6
Hey guys I am new to AI ART , I found out that wan2.1 image to video works really well on my 2080ti , 20 steps with tea cache on 512x512 resolution image equal about 4 : 45 mins , any other way to lower it to 1min or 2min? thanks , will be posting soon ;)
I'm not sure, but if you share the workflow maybe we can look to see if there is anything that can be tweeked?
 

NMMMN

Newbie
Feb 19, 2020
36
35
Hello everyone! In order to start this I assume you already know how to create AI images this guide is about taking those images and turning it into something animated.

I've been messing around with generative AI for the past few months and I've been improving pretty quick. I've attached some samples so you can see the results. I wanted to share with what I've learned with others.

View attachment 4441719 First Attempt
View attachment 4441718 Second Attempt (What's currently in my game)
View attachment 4441717 Third Attempt (Not in the game yet, soon)

To make these its important to realize how powerful a tool Image2Image is. To make consistent images and animations you need to utilize it, Its a little more work that just using Text2Image prompts but anyone can do it.

To create something like the 3rd try follow the below steps:

Generate an image to use as your starting frame

Text2Image model -> View attachment 4441743 .

The plan for this is to animate a handjob.

Using a tool like photoshop you can make edits to this image like moving her hand around.
I put the hand on a separate layer so I can move it around as I wish. View attachment 4441877 , View attachment 4441885

I created 6 frames total of the hand moving up the shaft.

Now you use Image2Image to feed your edit back to the AI model while also using the same prompt. Make sure your denoise is set to something low like 0.2-0.5 to keep the image consistent. but not so low that the AI model isn't able to change anything.

This has the effect of removing any jankyness caused your/my edits as you can see here: View attachment 4441891

Now you've created 6 cleaned up frames but your not done yet.

OPTIONAL:
Now's the time to upscale those frames before you move on if you want something high res


Feed those 6 frames trough an and boom you can double them to 12 and also create a smoothing effect.

Once your done that just make it into a gif and enjoy.

Result: View attachment 4441924

Great idea, thank you!


this does have the ai illustrated warping look though.
this gives me and idea for making poses based on segmented parts then using ai to fix the anatomy, but would then need to be segmented again for animation.

something simple like this would be easier to tween or lerp in unity or adobe animate to avoid the ai illustrated warping look.