- Feb 14, 2019
- 121
- 81
Hey guys, is was bored and did a thing...
Lara Croft 1080p60 & 4K60...
Probably not perfect but looks good to me...
So you pretty much are saying that everything I did was just bad... lol jk...Thanks. The models, the lighting, the animations etc. look very good. Only thing that's bad is the 60FPS interpolation. It's just bad. I'd like to have the original 25(?)FPS video.
Interpolation is usually "just bad". Artifacts, mistimings that lead to jank movement, blurry and inconsistent frames, etc. The one you posted looks like an old[er] version of DAIN, which in the realm of Video Interpolation isn't actually too bad, but there are some (like the latest build of RIFE) that perform a little better. But in general all of them look like shit. Especially in FFmpeg console, the problems really arise.So you pretty much are saying that everything I did was just bad... lol jk...
As I said, It probably is not perfect but looks good to me...
So I don't know what you mean by "just bad"...
Anyway, the OG should be in the OP...
Well, algorithms/AIs are of course never perfect and can just predict intermediate frames, but some work better than others. And yours was not very good, I'm afraid. The worst thing is that there seem to be duplicate frames. Those should not exist. They create a janky movement, when everything should look fluid and natural.So I don't know what you mean by "just bad"...
I'd say they produce artifacts for close ups when the AI simply cannot understand what's going on in the frame and you get blurry frames when there should be jumpcuts, but I think for pretty static cameras and repetitive movements (like porn scenes) it does a fantastic job of creating more lifelike movements.But in general all of them look like shit. Especially in FFmpeg console, the problems really arise.
I would add that interpolation also depends a lot on the quality of the source.Well, algorithms/AIs are of course never perfect and can just predict intermediate frames, but some work better than others. And yours was not very good, I'm afraid. The worst thing is that there seem to be duplicate frames. Those should not exist. They create a janky movement, when everything should look fluid and natural.
You must be registered to see the links
I'd say they produce artifacts for close ups when the AI simply cannot understand what's going on in the frame and you get blurry frames when there should be jumpcuts, but I think for pretty static cameras and repetitive movements (like porn scenes) it does a fantastic job of creating more lifelike movements.
But what do you mean by FFmpeg? Do you use interpolation in FFmpeg and that creates more problems?
Sure, it's much better to just add one additional frame per existing frame, but I think it works even for very bad CGI videos that are low quality and have 24FPS and janky unreal animations. Even those look much more real after interpolation. I'd say because unlike real cameras, which capture real movements in a blurry but always consecutive way, animations can look very choppy. Drawn animations usually include this and since they were filmed in the old days you always got some kind of flow. Now modern CGI CAN exist of just single still images and our brain it not always able to put them all together into one motion, even if we don't see it. And interpolation can help tricking our brain a lot.This has a major impact, as 24 to 60 fps interpolation models are less efficient than 30 to 60 fps models, because the multiplication factor is not an integer.
FFmpeg has frame interpolation, using the filters minterpolate and tblend (minterpolate for this example because it's "better") which I used back then when I started out trying it. It produced insanely bad frames and was really slow. Take the image below for example. Granted this is a "dark" frame where the AI has difficulty differentiating things, but this effect is less in more advanced models. (This video is in 720p)Well, algorithms/AIs are of course never perfect and can just predict intermediate frames, but some work better than others. And yours was not very good, I'm afraid. The worst thing is that there seem to be duplicate frames. Those should not exist. They create a janky movement, when everything should look fluid and natural.
You must be registered to see the links
I'd say they produce artifacts for close ups when the AI simply cannot understand what's going on in the frame and you get blurry frames when there should be jumpcuts, but I think for pretty static cameras and repetitive movements (like porn scenes) it does a fantastic job of creating more lifelike movements.
But what do you mean by FFmpeg? Do you use interpolation in FFmpeg and that creates more problems?
Because it's interesting. Thank you. Didn't even know ffmpeg has any kind of interpolation software. Not that I'm gonna use it ...I don't know why I wrote this thing for a porn forum
It's a very good one, but it has the unfortunate quality of being a darker lit video, where you can see in the frames around 2:23 Lara's labia has a little artifacting going on, as well as in other fast movement scenes (her hand moving at 1:26). Overall this is still a really good example of interpolation software with basically 8/10 of frames being "good". If I had to guess this is with RIFE, probably one of the models optimized for anime which isn't really significant but I found that they preferred frames/videos with very linear movement/little to no in-between frames that smooth out the video.Because it's interesting. Thank you. Didn't even know ffmpeg has any kind of interpolation software. Not that I'm gonna use it ...
What do you think of my video?
It was done with Apollo from Topaz Video AI.If I had to guess this is with RIFE
Apollo IIRC is one of if not the best motion interpolation software out there, so there really is very minimal things you can improve in your example.It was done with Apollo from Topaz Video AI.
This has explained something to me that I had been wondering about. I was initially suspecting my screen recorder of being the problem, but now I am thinking it could be the interpolation process gone awry. Thanks...I'll have to look into my problem again.FFmpeg has frame interpolation, using the filters minterpolate and tblend (minterpolate for this example because it's "better") which I used back then when I started out trying it. It produced insanely bad frames and was really slow. Take the image below for example. Granted this is a "dark" frame where the AI has difficulty differentiating things, but this effect is less in more advanced models. (This video is in 720p)
View attachment 3229884
But this isn't the only example. Even in light areas, as long as the frame has mildly complex pixels that it can't understand, it just goes completely south. These are in 1080p, but the same problem arises. These are the shots I took that show it better freeze framed, but in movement there are noticeable things like in the second frame where Dokkaebi's legwear (and sleeves in another animation by Idemi) has major artifacting where any light spot or reflection will "glitch out" and cease to be recognizable.
View attachment 3229898 View attachment 3229906 View attachment 3229910
Of course on other, better models this doesn't happen, but in FFmpeg the limited capability of the software shows it. Of course it's still industry standard and many (if not all, I'm not a software engineer) interpolation softwares actually base upon it like SVP that does frame interpolation real time.
I don't know why I wrote this thing for a porn forum, but that's what I found.
Edit: I realize that the images look shitty. I'm on a 16:10 monitor that is less than 1920 pixels long.