Topaz AI Gigapixel

May 21, 2017
34
20
#1
If you are an artist or developing a game this is going to be a must have. I'm not super well versed on the tech behind it all, but basically it can enlarge an image without losing any of the quality, and even improving it in most instances. I found out about this because I found an article about people remastering final fantasy 7, apparently the backgrounds in that game were pre-rendered images that were rendered very small, so using this program they were able to not only increase the size but bring much more quality to those images.



Not sure how to embed links but that vid is an overview of the program.

Now its generally known that you can increase the size of a render, like if you render in 4k, and then resize the render afterwards to 1080, it can clean it up a little, just because of whatever the post processing work that happens, again i'm illiterate in this stuff whether its nearest neighbor blah blah. but basically you can get a quality render quicker using this method.

With this program though, you might be able to do even quicker renders, by rendering in just 720p, upscaling it 600 percent, and then downscaling it to 1080, because you are gaining quality in the upscale as well as the downscale.

This means less rendering time, but it does mean more post processing time. However, like batch rendering you can batch image scale numerous photos quickly however, without tweaking settings for individual images etc.

Thought I'd share this with anyone to mess with to help shave rendering times

edit- also I failed to mention its a 100 dollar program, not a free one. I caved and purchased it because I couldn't find it online yet lol
 
Feb 5, 2019
15
6
#2
It upscales stuff quite quickly since it uses gpu processing but its not THAT great as they claim. It depends on the situation, its good at some thing at others not so much. Its kinda hit n mis. So its not some magical fix, if you want quality renders your best bet is still to actually render at high resolution.

It works decently for high res upscaling like fullhd to 4k or 4k to 8k but even then you are not getting any additional detail(that would be there if you rendered at 4k) its just that it doesnt seem you are losing the detail from upscaling so its kinda you get fullhd at 4k its still crisp but real 4k would be better.

It doesnt work too well for low res to high res, so if you are hoping to render at 50% of fullhd and then upscale to fullhd im afraid its not gonna be great simply because in order to upscale properly AI needs details to work with thats why high res upscaling(fullhd to 4k) works better then lowress to highres.

so in the end its not really adding detail it just kindof inteligently upscales it so that it seems as if you didnt lose detail

bottom line - yes its good, no its not as great as they claim it to be and no its not a magical fix. gl
 
Likes: Winterfire

Winterfire

Well-Known Member
Game Developer
Sep 27, 2018
659
521
#3
If anything, a common quick fix to grainy effect should you not let the iray run as much as it should is to scale, so that software probably does a better job with that
 

f95zoneuser463

Active Member
Game Developer
Aug 14, 2017
182
781
#4
and I have good news:

As of right now the software works even after the 30 day trial should be over.
Not sure why that is, could be a bug, could be due to the updates. I know there a ways to "defeat" theses typical time limited trial version, but I haven't done anything like that.

Meanwhile the software got a few updates. The interface changed and bugs that I've noticed in older versions are fixed too.

The software also handles huge amount / long image sequences better (still needs a lot of work) ... this is important because people would love to use this for video-upscaling too. I have done this already, but you MUST know what you are doing. Picking the wrong settings for a image-sequence with 10000+ images can result in process-time of days instead of an hour!
One BIG problem when using it for video/long image sequences: is that the software processes everything in a single thread.
The speed would improve if the devs implement a second thread for writing the upscaled image to the disc while the GPU already processed the next image.

There are other projects that work with similar technology, but for real-time videos. This software got me thinking a lot about "remastering old videos". I searched the net for realtime AI upscale software, found some things, but nothing public yet.

What the software should NOT be used for is denoising! I tried that too, but it's 'wrong thinking'. It's not what the software is build for. There are better algorithms and tools specifically for that. In general it's EXTREMELY important to have a high quality source image. Compression artifacts in the source will only be amplified. Typical JPGs from the web with high lossy compression are a bad source.

If people are interested I can upload a video comparison for upscaled video with this software. It's the intro from 2010 "My Plaything Audrey Bitoni". It's a later DVD generation, digitally recorded and mastered, not the early 2000s stuff where they just sold VHS converted to DVDs, that's important for quality. I've upscaled it 200%.

Here is a I found from someone else. Check his reply in the comment section, he used AI Gigapixel too and he clearly knows what he is doing.

Funny and highly recommend talk about image upscaling with neural networks:


Other projects:


(not upscaling)


While researching I also found a software called . It was used to restore the 1927 silent movie " ". I believe this was after the missing scenes where found.

Exciting times, I can't wait for the day where you can play some old videos, press the "enhance" button and it looks so much better. That will happen, I'm sure.:)
 
May 21, 2017
34
20
#5
Yea I didn't mean to give off the impression that this would fix a grainy image, I was just excitedly posting this quickly after messing with it last night.

I personally have a 6gb 980ti, and I'm working on my first VN. And by first I mean its my tenth attempt at a first lol. Anyways I'm working with lower light enviornments and I'm still super noobish with how it all works, Without using ghostlights and emissives that completely wash out the image and details I continually get minor noise in the renders. I'm also rendering in full 4k. So I've let problem renders go for 10 hours while sleeping, just a single image and STILL got white specs on figures and the like.

I use a scene optimizer for DAZ3d, as well, since I only have 6gb, so if I want multiple figures in a scene, I have to downscale everything possible other than the figures. The enviornment and textures etc. So I'll have a pristine looking figure in a blah enviornment alot of the time.

Using this though, I can take that 4k image and upscale it by 6x/600 percent, and it actually makes the enviornments look much closer to how they shouldve prior to downscaling, while also making the figures look much more crisp.

This is all after I've run a version of a denoiser however. I use photoshop, and since I'm rendering at 4k and not cancelling anything early the only noise i get are these strange white specs, which get taken care of by using "median". This seems to be the least harmful option and by my untrained eye its basically just deleting the white specs themselves, but if you zoom in enough you can see the telltale blurryness. It isn't much but its there.

That also gets taken care of in the upscale

Then, when its downscaled back to 4k or 1080, I get the sharpness benefits from that as well.

I've deleted my original renders and am only left with my final images, but I'll try and get up a few from each stage of the process to show what its doing for me personally. I probably won't post a 6x 4k image however because its something ridiculous like a 280 mb png file, lol, but i'll post a normal 1080 render untouched, a 1080 render after the median denoising, and a 1080 render after median denoising, upscaling and downscaled back to 1080.
 

f95zoneuser463

Active Member
Game Developer
Aug 14, 2017
182
781
#6
I use a scene optimizer for DAZ3d, as well, since I only have 6gb
Oh I remember painfully optimizing every little detail because I started on a 760 GTX 2 GB. Scene optimizer was required for almost every scene. But hey, looking back at it now: I learned how optimized the scenes and many tricks to free up as much VRAM as possible. Even my freaking Ren'Py launcher is configured to run in software rendering to not consume VRAM haha.

I'm also rendering in full 4k. So I've let problem renders go for 10 hours while sleeping, just a single image and STILL got white specs on figures and the like.
We are both doing the same thing then. 4K renders at night. Have you tried the DAZ 4.11 beta with AI denoiser to fight the remaining 'white specs'? I don't know how 'usable' it is on a 6 GB card since this will only increase the memory hunger. I'm on a 1070 GTX 8 GB now and even that's not enough in some cases.

concerning AI Gigapixel:
The quality is obviously questionable and I think it should not be used where it's not necessary. I'm not even that interested upscaling actual 3DCG. Personally I'm not limited by rendering times. The time required to script the VN and create the 3D scenes in the first place is long enough to render in the background. It's probably different for every dev and depends on the workflow.
The thing that excites me: having the option to "enhance" old images and especially videos in cases where simply no better source exists. DVDs are an excellent example. They have a "good enough" resolution. Assuming you could run this in realtime on a movie ... I bet you could trick people to think that it's a 1080p video ... not at a blu ray quality level, but recorded on a phone 1080p cam.
 

Create an account or login to comment

You must be a member in order to leave a comment

Create account

Create an account on our community. It's easy!

Log in

Already have an account? Log in here.