Tool QSP RPGM Unity HTML Java Ren'Py Flash Wolf RPG UltraFast adult games compressor v3.1.3.12

[Da Bi Dimm]

You must be registered to see the links

(install at UAGC v3.1.3 v24 final or newer):
For main RenPy compressor (main, not bulk) changed media files processing logic to support RAM drives (tested with SoftPerfect RAM disk) so now UAGC shouldn't process same files (at RAM disk) several times. Currently highly experimental! Removed "build MacOS before packing back to rpa" feature because it was "born dead" (wasn't working) and since games where it really needed less 0.1% I don't gonna try to fix it since it would need tons of time because very complicated.

Perhaps this will also solve the problem with this game: City of Secrets [v0.10.75] [TheDarkLight] ?
What's going on: UAGC gave an error saying that the compressed version has more files than the original. Through blind testing, it was found that: suppose there is an image named 1%(4) and an image named 2%(4), it compresses image 1%(4) normally in .PNG format, then takes the same image, compresses it in .WEBP format, and names it 1%(4)2%(4)%(4), after which it compresses image 2%(4) normally in .PNG format. This only happened with files whose names contain either % or ().
Unfortunately, I was in a hurry, so I just deleted the .WEBP files without taking screenshots or saving any extra files, and I didn't mention it here right away. But a question has arisen: could any compression errors occur if the PC is being actively used at the same time?

 

[megalol]

Perhaps this will also solve the problem with this game: City of Secrets [v0.10.75] [TheDarkLight] ?
What's going on: UAGC gave an error saying that the compressed version has more files than the original. Through blind testing, it was found that: suppose there is an image named 1%(4) and an image named 2%(4), it compresses image 1%(4) normally in .PNG format, then takes the same image, compresses it in .WEBP format, and names it 1%(4)2%(4)%(4), after which it compresses image 2%(4) normally in .PNG format. This only happened with files whose names contain either % or ().
Unfortunately, I was in a hurry, so I just deleted the .WEBP files without taking screenshots or saving any extra files, and I didn't mention it here right away. But a question has arisen: could any compression errors occur if the PC is being actively used at the same time?

1) I'm not 100% sure that it would solve that specific problem unless u test it by urself using new UAGC version but with new UAGC file logic processing possibility of such errors should be much less.
2) It depends on what u call by active using, if u play 3D games then it could increase error rate for sure especially for av1_nvenc which as showed practice is less stable encoder comparing to others, if u just browsing or watch videos it shouldn't affect compression process especially at fast PC as urs.
3) Btw u asked about logging errors before, forgot to say that if u have file amount or names not same error message u'll got file called flch_lst_err.txt that would be created near UAGC.exe and which have names of files that differs from original. In future as I've said before I'll create log for skipped files (due zero or bigger size than original).

 

[Da Bi Dimm]

1) I'm not 100% sure that it would solve that specific problem unless u test it by urself using new UAGC version but with new UAGC file logic processing possibility of such errors should be much less.
2) It depends on what u call by active using, if u play 3D games then it could increase error rate for sure especially for av1_nvenc which as showed practice is less stable encoder comparing to others, if u just browsing or watch videos it shouldn't affect compression process especially at fast PC as urs.
3) Btw u asked about logging errors before, forgot to say that if u have file amount or names not same error message u'll got file called flch_lst_err.txt that would be created near UAGC.exe and which have names of files that differs from original. In future as I've said before I'll create log for skipped files (due zero or bigger size than original).

Yes, I know about this file, and when an error occurs, I check it immediately, but usually it is empty (that's why I asked about extending its functionality). Only once did it help me find 2 errors in one of the games (there were initially 2 corrupted videos, so an attempt to compress them caused an error). This time, it was empty as well.

 

[Blowerke]

I compressed 22 of my largest renpy games i had today because i was running out of disk space and it was reduced from 138gb to 26gb. That's on the default settings and quite amazing. Thanks for this great tool.

 

[srfsmrf_]

Haven't downloaded + checked this myself, but can it combine AVIF for images + VP9 for video?

At times Bob69 does a compress using AV1/AVIF with the statement that it may not work well on older / lower spec HW.

Wouldn't you have best of both worlds when you'd use AVIF for static images, and VP9 for video? Then again, potatoes may perhaps still struggle with AVIF image based animations (since it requires more CPU to decode), then yet again, I believe Ren'Py does some pre-loading in the background right, so that may be a non-issue.

I did some testing a little while ago, AVIF gives a much better result at the same file size, and to me it feels like a shame WebP still seems to be the default. (Btw, on a side note: personally my pref would be to profit from the quality improvement over (further) file size reduction.))

Note for reference: RP has AV1/AVIF support

You must be registered to see the links

· RP JPEG XL (JXL) support

You must be registered to see the links

 

[megalol]

Haven't downloaded + checked this myself, but can it combine AVIF for images + VP9 for video?

At times Bob69 does a compress using AV1/AVIF with the statement that it may not work well on older / lower spec HW.

Wouldn't you have best of both worlds when you'd use AV1 for static images, and VP9 for video? Then again, potatoes may perhaps still struggle with AVIF image based animations (since it requires more CPU to decode), then yet again, I believe Ren'Py does some pre-loading in the background right, so perhaps that may be a non-issue then.

I did some testing a little while ago, AVIF gives a much better result at the same file size, and to me it feels like a shame WebP still seems to be the default.

Yes, for main RenPy compressor u should be able to combine avif and VP9 (but can't do otherwise webp + AV1) just choose No when asked about (SVT)-AV1 after u selected any avif tool. Btw if comparing with default settings u'll get no advantage comparing to VP9 by choosing AV1 except faster compression speed. Just don't forget that not all RenPy games supports avif so u may consider to use auto avif feature in global UAGC settings so u don't need to check it manually every time.

 

[Da Bi Dimm]

megalol by the way, even ultrafast ffmpeg speed = 16 doesn't load the CPU to 100% when compressing to WebP; it constantly fluctuates between 30-80%, only AVIF maintains a constant 98-100% usage. But maybe I just haven't encountered games that would fully load the CPU, when compressing to WebP.

 

[megalol]

megalol by the way, even ultrafast ffmpeg speed = 16 doesn't load the CPU to 100% when compressing to WebP; it constantly fluctuates between 30-80%, only AVIF maintains a constant 98-100% usage. But maybe I just haven't encountered games that would fully load the CPU, when compressing to WebP.

For webp ultrafast ffmpeg speed is not affects processing speed (since there are no limits at all unless u enable image speed limitting), just this format is much less loads CPU comparing to avif, u can try to switch to cwebp (especially if u set -m =5 or/and -sharp_yuv) and see if there are any difference, maybe it's possible to make it faster by using same method as for avif where I sent compression to rush.exe tool where ultrafast ffmpeg is number of jobs but I think we would hit some Windows limit to allowed processes anyway so not sure if there would be any difference.

 

[Da Bi Dimm]

For webp ultrafast ffmpeg speed is not affects processing speed (since there are no limits at all unless u enable image speed limitting), just this format is much less loads CPU comparing to avif, u can try to switch to cwebp (especially if u set -m =5 or/and -sharp_yuv) and see if there are any difference, maybe it's possible to make it faster by using same method as for avif where I sent compression to rush.exe tool where ultrafast ffmpeg is number of jobs but I think we would hit some Windows limit to allowed processes anyway so not sure if there would be any difference.

I've completely gotten confused: does it turn out that ultrafast ffmpeg speed doesn't work for me at all? Since it doesn't affect the operation of webp, and for avif, with nvenc enabled, there's a strict hidden limitation. So it only works for avif in cases where all the compression happens entirely on the CPU (with nvenc disabled)?

 

[megalol]

I've completely gotten confused: does it turn out that ultrafast ffmpeg speed doesn't work for me at all? Since it doesn't affect the operation of webp, and for avif, with nvenc enabled, there's a strict hidden limitation. So it only works for avif in cases where all the compression happens entirely on the CPU (with nvenc disabled)?

Ultrafast ffmpeg speed (if enabled and implemented for compressor u using) sets number of running processes at same time for: VP9, SVT-AV1, (av1_)nvenc (max=6), H.264/5, avif+process limit (libvips, imagemagick, nconvert).

 

[megalol]

You must be registered to see the links

(install at UAGC v3.1.3 v24 final or newer):
For RenPy compressor (main, not bulk) corrected flch_lst_err.txt file processing logic to fix possible bugs when game path contained spaces, also UAGC now writes full paths instead relative to locate files easier.
Added 2 new files creation (near UAGC.exe) for webp and video check sizes features (if enabled) to see what files was skipped.
chk_vid_size.txt example:

chk_webp_size.txt example:

 

[Da Bi Dimm]

You must be registered to see the links

(install at UAGC v3.1.3 v24 final or newer):
For RenPy compressor (main, not bulk) corrected flch_lst_err.txt file processing logic to fix possible bugs when game path contained spaces, also UAGC now writes full paths instead relative to locate files easier.
Added 2 new files creation (near UAGC.exe) for webp and video check sizes features (if enabled) to see what files was skipped.
chk_vid_size.txt example:
View attachment 5333799
chk_webp_size.txt example:
View attachment 5333800

To reduce the size of the log file, the phrase "original/compressed sizes(in bytes)" can be removed from each line, leaving it only as a note at the very beginning of the list. Instead, use 2-3 tabs so that all numerical values are aligned in a column rather than shifting left and right. This will simplify viewing and visually searching for discrepancies.

 

[megalol]

To reduce the size of the log file, the phrase "original/compressed sizes(in bytes)" can be removed from each line, leaving it only as a note at the very beginning of the list. Instead, use 2-3 tabs so that all numerical values are aligned in a column rather than shifting left and right. This will simplify viewing and visually searching for discrepancies.

Ok, it makes sense.

You must be registered to see the links

there are just header in first line "Numeretic values are original/compressed image/video sizes(in bytes)" instead of "original/compressed sizes(in bytes)" at each and aligned sizes column.

 

[megalol]

You must be registered to see the links

(install at UAGC v3.1.3 v24 final or newer):
For RenPy compressor (main, not bulk) added cwebp + process limit feature, as I've expected even with uffmpeg speed = 50 it doesn't spawns 50 cwebp processes since it should be something with Windows limitations so this feature could be useful if you using advanced cwebp settings and want to limit number of running processes to prevent PC your from freeze.

 

[SonsOfLiberty]

Think I have a bug with v24_2 and using the "donor function"



It builds the "full version". This is also the third time it has done it, with different games.

 

[megalol]

Think I have a bug with v24_2 and using the "donor function"

View attachment 5342998

It builds the "full version". This is also the third time it has done it, with different games.

View attachment 5342999

Ok, I'll check later but what about size after size in ur screen, is it correct or wrong? And what is contens of "full version", is there are any anomalies (like folders that shouldn't be there or duped files with !) or it just don't compressed game folder?

 

[SonsOfLiberty]

Ok, I'll check later but what about size after size in ur screen, is it correct or wrong? And what is contens of "full version", is there are any anomalies (like folders that shouldn't be there or duped files with !) or it just don't compressed game folder?

I mean it builds the full uncompressed version strangely. It's 3GB the same size as the uncompressed version while the source file UAGC does is the correct size of 800MB, so I have to build with SDK.

I'll do it again and see if it does it again then extract the archive and RPA's and see if it doubled them.

EDIT: Did the same game again, same result as above and from what I can tell, no duplicate files. Not sure what is going on atm.

 

[megalol]

I mean it builds the full uncompressed version strangely. It's 3GB the same size as the uncompressed version while the source file UAGC does is the correct size of 800MB, so I have to build with SDK.

I'll do it again and see if it does it again then extract the archive and RPA's and see if it doubled them.

EDIT: Did the same game again, same result as above and from what I can tell, no duplicate files. Not sure what is going on atm.

Can u try with disabled "build MacOS before packing back to rpa" feature, read more there. Also in compressed "full sized" SDK build version there should be (actually shouldn't be if u didn't enabled those feature ) folder called "archive!"

 

[megalol]

You must be registered to see the links

(install at UAGC v3.1.3 v24 final or newer):
For RenPy compressor (main, not bulk) added ability to run cwebp (only with process limit feature activated) and libvpx-vp9 at same time (actual only for fast PC, not recommended to use it if you have slow CPU)

 

[Da Bi Dimm]

megalol excellent new logs, have already come in handy several times and helped identify a problem. However, 'extra files' (when the compressed version contains more files than the original) and errors during the decryption of RPGM files are not displayed.