Unreal Engine How to create a kiss animation using Metahumans facial capture tools inside UE5?

[MagicDragon3D]

So, I'm planning to create a realistic kissing animation for an audiovisual project of mine using Unreal Engine 5's Metahumans. As we already know, UE5 has a feature called "Live Link" which allows you to use your iPhone with ARKit, to capture your face in real time using the phone's camera and transfer it to your Metahuman characters. I was considering the animation itself to be somewhere between 1 and 2 minutes long, but I'm still unsure if it would be possible to create this facial animation.

I discovered that it's possible to use Live Link on two different iPhones, one for each Metahuman character. What I was thinking would be for me and my girlfriend to kiss while our facial expressions were captured live for our male and female Metahuman characters. Would this be possible? Has anyone tried it to see if it works?

 

[osanaiko]

me and my girlfriend

Hold it right there buddy. I'm not sure you're allowed to be on this site.

 

[MagicDragon3D]

Hold it right there buddy. I'm not sure you're allowed to be on this site.

Is there a problem? If you don't know how to answer, don't waste your time.

 

[AllNatural939]

Is there a problem? If you don't know how to answer, don't waste your time.

The issue is you’re posting in the wrong section. This is for guides, tools, that kind of stuff... not for questions. Just check the description of each subforum.

 

[osanaiko]

Is there a problem? If you don't know how to answer, don't waste your time.

Man, it's hard to be a comedian these days. Here's the joke:

F95 is a gathering place for otaku gooners. By stating you have a girlfriend, and even worse, suggesting you may have physical contact with the alleged female girl, you have excluded yourself from the group of allowed users, and no doubt have contracted a case of incurable cooties.

 

[Egglock]

If you haven't found a solution, here's my suggestion.

Capture one face per phone. You need to face the phone for it to capture the face data. So.... this is going to feel awkward, both of you will need to face the camera and pretend the phone is the other person and do the act of kissing. Once you have the mocap's. You would then do the positional adjustments and fine adjustments on the 3D characters.

Hope this points you in the right direction. Something to keep in mind, for any facial mocap you plan to do in the future. There should not be anything between you and the capturing device, in this case the phone.

 

[hardwire666]

Hands down. I would absolutely not use mocap for this if you want it to feel and look natural. Mocap is a great tool, but it has its limits. Done correctly mocap still needs a lot of clean up to make work, always. What Egglock said can work, but in my experience as an animator I wouldn't even bother with the mocap. I feel like I would waste too much time doing the clean up and adjust and blah blah blah that it woudln't be worth it. I could probably just do it from sratch, get better results, and have less issues.

Mocap is great, but liek I said it has it limits. Over all it's just one of many tools in an animators tool box.