CREATE YOUR AI CUM SLUT ON CANDY.AI TRY FOR FREE
x

Tool Others F95Checker [WillyJL]

5.00 star(s) 23 Votes

FaceCrap

Ghost of torrents passed
Donor
Oct 1, 2020
1,301
878
WillyJL
First, I made a filter on Score without changing the value, this has as result that if you filter all tabs, you get all your games in a single list.
At least this allowed me to check which images it had converted. (see *ISSUE)

I only checked ASTC compression and left Unload off-screen clear (found out that wasn't the smartest thing to...).

1st attempt it encoded only 356 of the 534 games. Since 313 of those were png converted to webp, I converted those back to png to see if that would change things, but while comparing image names, I saw it had done webp's too before I reconverted those back to png's.

2nd attempt it encoded only 135 images, and no matter what I did, it didn't do anymore. But while creating this post I checked back and somehow it actually had come alive again as the count had risen. But stopped again at 319... (see *NOTE)

Now as I said, I found an easy way to check which it had done. The bad news is none of the encoded image's show. All I get to see is a black area. And it's that black area which revealed which it had encoded.

I discovered that if I opened the More Info popup and scrolled through the list, for every image it had encoded, the black area had the aspect ratio of the original image. For those images that still weren't encoded, the black area was a square (verified by checking ID's against encoded images)..

#NOTE: Then I noticed that whenever I scrolled through images showing a black square, the encoded count went up again. Contrary to this, when I switched to grid view (middle button) scrolling through the list had no effect on the encoded count.

*ISSUE: Doing so, I also ran into an issue. At first, I used the mouse to click the right-arrow button. This resulted in an annoying flashing because the popup gets closed on the current game and recreated/opened on the next which also causes the game list getting undimmed and dimmed again. Surprisingly when I switched to using the keyboard right-arrow (or left-arrow) keys, the popup stayed open, and the flashing was gone.


So, after 45 minutes of scrolling and waiting till it had done all, the total count became 532 out of 534 entries. Turns out I got two tools in my list that don't have a banner.

Conclusion. apart from uncovering a bug, ASTC is not something I can use. Encoding works, as I said, but displaying the result is a total failure. (*Tacent however does show them, so it does something other than directly dumping them to the GPU)

Final note... If I turn off ASTC Compression, it does not load the originals, not even after removing all .aastc files. Here yet another suprise surfaced... it actually did load some and it turned out these were all animated gif's. All the rest just stays a solid black area.
Ah, Now this is a situation where you DO need to have Unload off-screen checked. Doing so immediately made it reload the original images.

EDIT: Almost forgot the most important thing.
No errors showed, neither in the Checker nor in the debug console
 
Last edited:

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
1st attempt it encoded only 356 of the 534 games. Since 313 of those were png converted to webp, I converted those back to png to see if that would change things, but while comparing image names, I saw it had done webp's too before I reconverted those back to png's.

2nd attempt it encoded only 135 images, and no matter what I did, it didn't do anymore. But while creating this post I checked back and somehow it actually had come alive again as the count had risen. But stopped again at 319... (see *NOTE)

Now as I said, I found an easy way to check which it had done. The bad news is none of the encoded image's show. All I get to see is a black area. And it's that black area which revealed which it had encoded.

I discovered that if I opened the More Info popup and scrolled through the list, for every image it had encoded, the black area had the aspect ratio of the original image. For those images that still weren't encoded, the black area was a square (verified by checking ID's against encoded images)..

#NOTE: Then I noticed that whenever I scrolled through images showing a black square, the encoded count went up again. Contrary to this, when I switched to grid view (middle button) scrolling through the list had no effect on the encoded count.
this whole things sounds like trying to link your actions to some meaning where there isnt. whats most likely happening when it appears to be stuck is it is compressing a gif. each frame needs to be converted to png first then compressed to astc, so gifs take a few orders or magnitude longer to compress than normal images. when you said it was stuck at 313, then when it was at 135 and stopped then came back alive, and then when you were scrolling through the more info popup, i believe all of these were cases where it was compressing a large gif image (which using sse2 and the relatively older cpu made even slower than one would expect) but you interpreted it as being stuck, then something else you did coincided with it finishing encoding that large gif and thus moving onto the next image.

Since 313 of those were png converted to webp, I converted those back to png
webp is not supported by astcenc but it should be by pillow, the checker converts to png temporarily using pillow as an intermediary for astcenc

The bad news is none of the encoded image's show. All I get to see is a black area. And it's that black area which revealed which it had encoded.

I discovered that if I opened the More Info popup and scrolled through the list, for every image it had encoded, the black area had the aspect ratio of the original image. For those images that still weren't encoded, the black area was a square (verified by checking ID's against encoded images)..
this makes sense, after compressing and loading from .aastc file it knows the size of the image so it draws the right shape, but then looks like opengl didnt like the texture format. the black square is just a placeholder 1x1 texture (resized to fit the more info popup) while images load (same one that was always there, just that first compression takes longer than loading from file so you noticed it now). i feel like changing it to text that says "Loading..." or a loading spinner is unnecessary and distracting, if youre scrolling by with images slowly loading all that text / spinners doesnt bring much info, and is just distracting, so simply showing a brack image when it is still loading but not yet failed is the best solution. as for why even after loading the compressed image it shows black for you is a separate topic, will need to dig deeper to find a way to fix it or detect it to show an appropriate error

So, after 45 minutes of scrolling and waiting till it had done all, the total count became 532 out of 534 entries. Turns out I got two tools in my list that don't have a banner.
well thats atleast some "good" news, compression worked fine, even if slow. that is of course offset by it being a one-time thing, and from now on it will be 1 or 2 images getting compressed at a time when they get updated. also i suppose it would be wise to add a status message to bottom right like "Compressing X textures..." (where each frame in a gif counts as a texture, so the counter is proportionate to processing time), would also help the uncertainty of what is happening that i explained in the first paragraph.

Conclusion. apart from uncovering a bug, ASTC is not something I can use. Encoding works, as I said, but displaying the result is a total failure. (*Tacent however does show them, so it does something other than directly dumping them to the GPU)
ill have to look at how tacentview does it then

Final note... If I turn off ASTC Compression, it does not load the originals, not even after removing all .aastc files. Here yet another suprise surfaced... it actually did load some and it turned out these were all animated gif's. All the rest just stays a solid black area.
Ah, Now this is a situation where you DO need to have Unload off-screen checked. Doing so immediately made it reload the original images.
toggling the astc compression checkbox, or the astc replace checkbox, will unload all images and reload them from file. i supposed i forgot to add a check to make it prefer the original file instead of the .aastc file when the toggle is off, i will fix that.
what happened here as far as i can tell is:
- you disabled the toggle
- it reloaded the images, but it still preferred the .aastc ones (this is a bug, will fix it)
- you deleted the .aastc files, but did not trigger the program to reload the images (as far as its concerned, they are already loaded, just your gpu cant show them)
- unloading off screen triggered the reload. its not at all required to disable astc compression, i simply forgot to make it avoid .aastc files when the astc compression toggle is off. with that bug fixed, then simply toggling off astc compression will reload all images and use the original files instead of .aastc even if present

EDIT: Almost forgot the most important thing.
No errors showed, neither in the Checker nor in the debug console
yeah hard to say why, i wouldve imagined the gpu wouldve just errored saying astc is not supported and the opengl error wouldve crashed the main loop... but then again tacent view loaded it... will need to look more into it.

EDIT: fixed the priority, now .aastc is avoided if the settings is disabled, prefers .gif first then any other format that is not .aastc. but will use .aastc if no other format is present.
also added a counter for image compression, but i realize that with how its currently architected, it can only process one image at a time, so it cant know how many frames the next images will need to compress (they might not have anything to compress even), so it would always show "Compressing 1 texture" when actually theres many images that are queued to compress. only gifs would show a varying number, as they have multiple frames.
what i think ill do is show "Compressing images..." generically when the counter is exactly one, since thats the case for static images and you can actually see that message blink when it finishes one image and moves to the next. for gifs ill make it "Compressing x frames..."

EDIT: did those, also fixed the flicker when clicking the arrows (i had noticed it long ago and never cared enough, thought it was imgui closing the popup, but it was actually due to how i was telling it to do so). and also made it always show a scrollbar in more info popup so width doesnt keep shiftin when changing the tabs or cycling through games
so of all things reported here, only the fact that your gpu doesnt like the astc textures is missing hmmm
 
Last edited:

Dukez

Member
Dec 19, 2020
440
1,548
i have now mostly fully implemented astc compression, and dropped the dxt testing code. there are now 3 options: astc compression (in general enable compression and save results to file), astc replace (remove original images after compression), unload off-screen (unload images when not visible).
Haven't really read all the previous posts and I ended up going back to an older drive to solve my issue for the time being. Does this use a different way of rendering the software now or something? (As in not opengl or w/e it was) If so, it wouldn't be hard for me to go back to the newer drivers and test it but if it's like something you have to enable/opt into afterwards it would have the same initial problem lol.
 

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
Haven't really read all the previous posts and I ended up going back to an older drive to solve my issue for the time being. Does this use a different way of rendering the software now or something? (As in not opengl or w/e it was) If so, it wouldn't be hard for me to go back to the newer drivers and test it but if it's like something you have to enable/opt into afterwards it would have the same initial problem lol.
sorry, i got you mixed up with Danv . you had the opengl driver goofy shit, he had concerns about vram. when i was pinging you regarding image compression stuff, i meant to ping them instead.
i havent done anything about underlying opengl stuff, i still believe it was some issue with your newer drivers.
then Danv please try the latest beta (macos builds are failing but windows and linux ones work fine) and test out astc compression + unload off-screen
 

Danv

Well-Known Member
Aug 21, 2020
1,181
1,679
then Danv please try the latest beta (macos builds are failing but windows and linux ones work fine) and test out astc compression + unload off-screen
Win10, i7-7700, gtx1070 8gb, 16gb RAM

testing on tab with 182 animation collection threads
version 11.0.1 - (160 gif + 22 png, total 800mb of HDD) - eats all available VRAM (around 7gb) and around 1.5gb of extra RAM (drops to 1gb after few minutes)
build 1458 with ASTC - (all aastc, total 867mb of HDD) - eats all available VRAM (around 7gb) and around 2gb of extra RAM (drops to 1.5gb later), hard freezes while trying to load many images at once, hard freezes with already loaded images too, took quite a few tries to catch middle of the list - it was lag-scrolling from top straight to bottom and back to top again

yeah, i don't know... it was using VRAM much more efficently and it took much longer to fill up, but in the end result is pretty much the same, if not worse
unload off-screen on the other hand is awesome, works without noticeable problems and keeps VRAM under control, i'm totally fine with image load time (it's around a second with gifs for me, longer with aastc and damn those freezes), so this thing just by itself is already great for me
 

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
Win10, i7-7700, gtx1070 8gb, 16gb RAM

testing on tab with 182 animation collection threads
version 11.0.1 - (160 gif + 22 png, total 800mb of HDD) - eats all available VRAM (around 7gb) and around 1.5gb of extra RAM (drops to 1gb after few minutes)
build 1458 with ASTC - (all aastc, total 867mb of HDD) - eats all available VRAM (around 7gb) and around 2gb of extra RAM (drops to 1.5gb later), hard freezes while trying to load many images at once, hard freezes with already loaded images too, took quite a few tries to catch middle of the list - it was lag-scrolling from top straight to bottom and back to top again

yeah, i don't know... it was using VRAM much more efficently and it took much longer to fill up, but in the end result is pretty much the same, if not worse
unload off-screen on the other hand is awesome, works without noticeable problems and keeps VRAM under control, i'm totally fine with image load time (it's around a second with gifs for me, longer with aastc and damn those freezes), so this thing just by itself is already great for me
i see, then id say its safe to assume those stutters are because your gpu doesnt support astc so it has to fallback convert to rgba, meaning the load times wont be improved by astc. well cant win them all i guess, but good to have as an option because if the hardware supports it its heaps better. glad that atleast unloading offscreen images is useful, even without astc )
from what i read astc was invented by either an arm or an amd engineer, and is maintained by both to a certain degree, so makes sense that amd gpus are further ahead with astc support. i have an rx 7800xt. though ascsd has a recent nvidia card and he has it working with astc.
i tried on qubes os (main os i use, but not for f95 stuff) and yeah i got the same stutters loading astc, in qubes everything is virtualized so there is no hardware gpu, and so it makes sense that there is no hardware acceleration for astc so it needs to fallback to rgba and stutter while doing so
 
Last edited:

KaosKally

Member
Dec 21, 2019
163
174
I did notice now site was a minute down and got the error in the screen when it happened. But the issue is that even the site is back online, the error persists...
Screenshot_1.png

Edit: Now seems all is fine.
 
Last edited:

KaosKally

Member
Dec 21, 2019
163
174
So I just did a recheck and got this message.
View attachment 4386927

The problem is, the thread still exists? If I right click the game in F95Checker and select Open Thread, it's still there. Is this an error with F95Checker or is something going wrong with Law School?
Just a question.What version of the checker you use? 11.0.1 or a beta one ? or maybe even 10.2 or what it was.
And second. is the game by MisterMaya? I want to test on my end as well with this particular game.

Edit: not sure if is the same game you mentioned, but i do get the same error as you.Despite the thread being active.
Screenshot_2.png Screenshot_3.png
 
Last edited:
  • Like
Reactions: WolverineCTX

harem.king

Engaged Member
Aug 16, 2023
3,762
6,527
Just a question.What version of the checker you use? 11.0.1 or a beta one ? or maybe even 10.2 or what it was.
my version is 11.0.1 and I am getting that error for a different thread
https://f95zone.to/threads/unren-for-macos-and-linux-v0-8-2.16887/
Screenshot from 2024-12-29 03-16-46.png

v11 retrieves the f95checker data from a mirror site used specifically for f95checker instead of directly getting it from original f95.
maybe it should have a fallback where, if a thread is not found on the mirror site, it would try the original site too to make sure it is gone on both?
 

KaosKally

Member
Dec 21, 2019
163
174
my version is 11.0.1 and I am getting that error for a different thread
https://f95zone.to/threads/unren-for-macos-and-linux-v0-8-2.16887/
View attachment 4387023

v11 retrieves the f95checker data from a mirror site used specifically for f95checker instead of directly getting it from original f95.
maybe it should have a fallback where, if a thread is not found on the mirror site, it would try the original site too to make sure it is gone on both?
Not sure if it would be possible now with the new check rate implemented on the site (a couple of weeks ago i think it was), and it might cause more issues and errors instead of helping. And I am on 11.0.2 1437 beta version now so my guess is it might be an api issue or a database issue.
 
  • Like
Reactions: WillyJL

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
So I just did a recheck and got this message.
View attachment 4386927

The problem is, the thread still exists? If I right click the game in F95Checker and select Open Thread, it's still there. Is this an error with F95Checker or is something going wrong with Law School?
Just a question.What version of the checker you use? 11.0.1 or a beta one ? or maybe even 10.2 or what it was.
And second. is the game by MisterMaya? I want to test on my end as well with this particular game.

Edit: not sure if is the same game you mentioned, but i do get the same error as you.Despite the thread being active.
View attachment 4387012 View attachment 4387013
my version is 11.0.1 and I am getting that error for a different thread
https://f95zone.to/threads/unren-for-macos-and-linux-v0-8-2.16887/
View attachment 4387023

v11 retrieves the f95checker data from a mirror site used specifically for f95checker instead of directly getting it from original f95.
maybe it should have a fallback where, if a thread is not found on the mirror site, it would try the original site too to make sure it is gone on both?
I'll have to check the cache api logs. My guess is the thread was made private for a small amount of time, it was refreshed during that time, so it was cached that it was unavailable, then it was reopened, and threads that don't exist get cached for up to 14 days. Also I'm away for next week or so, can't really do much about it for now.
 

harem.king

Engaged Member
Aug 16, 2023
3,762
6,527
I'll have to check the cache api logs. My guess is the thread was made private for a small amount of time, it was refreshed during that time, so it was cached that it was unavailable, then it was reopened, and threads that don't exist get cached for up to 14 days. Also I'm away for next week or so, can't really do much about it for now.
thanks. and no worries. enjoy your xmas
 
  • Heart
Reactions: WillyJL

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
Not sure if it would be possible now with the new check rate implemented on the site (a couple of weeks ago i think it was), and it might cause more issues and errors instead of helping. And I am on 11.0.2 1437 beta version now so my guess is it might be an api issue or a database issue.
You're right, that's not really feasible. What I could do is try to make it forget that it doesn't exist if it is found in the 12-hour periodic version check (currently it doesn't touch entries that don't have a version cached, so threads that don't exist are skipped), and in the latest updates check (same here)
 
  • Like
Reactions: KaosKally

KaosKally

Member
Dec 21, 2019
163
174
I'll have to check the cache api logs. My guess is the thread was made private for a small amount of time, it was refreshed during that time, so it was cached that it was unavailable, then it was reopened, and threads that don't exist get cached for up to 14 days. Also I'm away for next week or so, can't really do much about it for now.
No worries, have fun and Happy New Year, in case I won't be able to tell you later.
 
  • Heart
Reactions: WillyJL

harem.king

Engaged Member
Aug 16, 2023
3,762
6,527
You're right, that's not really feasible. What I could do is try to make it forget that it doesn't exist if it is found in the 12-hour periodic version check (currently it doesn't touch entries that don't have a version cached, so threads that don't exist are skipped), and in the latest updates check (same here)
Actually, thinking about it some more.
can you make it so that we can just ignore the error and not have it popup every time we check for updates?
currently every single time it checks for updates, it prompts me to delete or convert the thread that was not found. and i don't want to do either. Because I know it is just a matter of time before the thread comes back online.

I want it to remember that I said to ignore that error and stop with the error popups for that thread.
 

KaosKally

Member
Dec 21, 2019
163
174
Actually, thinking about it some more.
can you make it so that we can just ignore the error and not have it popup every time we check for updates?
currently every single time it checks for updates, it prompts me to delete or convert the thread that was not found. and i don't want to do either.
I want to remember to ignore that error for that thread.
This actually sounds like something it could be relatively easy implemented, something like "Ignore X for 24 hours or 1 week" or whatever time it was set.
 
  • Like
Reactions: harem.king
5.00 star(s) 23 Votes