Tool Others F95Checker [WillyJL]

[doctorx6969]

new issue: I went to start a Unity game in linux with this and got this message:
Error - KIO Client:

For security reasons, launching executables is not allowed in this context.

I can run it manually. I get this with all native unity games launched form F95checker 11.0.1

 

[FaceCrap]

new issue: I went to start a Unity game in linux with this and got this message:
Error - KIO Client:

For security reasons, launching executables is not allowed in this context.

I can run it manually. I get this with all native unity games launched form F95checker 11.0.1

And of course, you went straight to google or your fav search engine to find out that you probably need to right-click the Unity executable and probably need to enable "Allow executable" and maybe even "Allow launching"?

At least that's what I got when I did that. Not being a *Nix user I know squat about this, but maybe it means something to you...

Mind you, it also seems to make a difference if it is an "appimage file" or "appimage executable"... One is a native *Nix executable, the other must be ran with wine, proton or whatever.

Any *Nix'ers here that could elaborate on this and tell me if I hit the mark with this?

 

[estrada777]

the tool is made for users managing games theyre playing and keep track of what they have installed and played and so on. i understand that this isnt exactly what you use it for, but youre the minority here then and i cant change the behavior yet again just for you. if you explain better what exactly is your workflow i can suggest a way to use the checkboxes in a way that makes sense for you.

from what i understand you do game ports and modding right? i would imagine you need to download games to do these things. here is what i imagine could work:
- download an update, then mark as installed (checkbox fully set), this will make the finished checkbox half set
- port and mod the version you just downloaded, then mark as finished (checkbox fully set), now youre done with this game until next update
- when an update happens, the installed checkbox will be half set, as you do not have the latest one installed
- again from the start: update it, then mark as installed
- now finished checkbox is half set, because you havent made ports or mods or whatever for this new version you just downloaded
- port and mod this update, then mark as finished, done until next update
you know which games have been updated by the half-set installed checkbox, and you know what you still need to port/mod by the half-set finished checkbox. you cant port/mod the games without downloading, so first step is downloading the update.
if you dont usually keep games installed after youre done modding them, then just delete the files after marking as finished. the tool will remember you marked it as installed and finished for that version, regardless of what files you have downloaded, thus it will still tell you about an update with the installed checkbox being half-set.

if this is not the kind of workflow you need then ill need more information to understand how to help you use it effectively

This is what I'm trying to do but updates are coming in and the state of the checkboxes is not what I expect it to be from the FAQ. Again, I'll see if I can capture anything concrete to report back.

 

[WillyJL]

new issue: I went to start a Unity game in linux with this and got this message:
Error - KIO Client:

For security reasons, launching executables is not allowed in this context.

I can run it manually. I get this with all native unity games launched form F95checker 11.0.1

that should be a notification by kde daemon, not exactly sure why but from what i recall its some kind of permission where an executable is not allowed to launch other executables (as malware often does things like this). the executable of the game should already be marked as executable (the "allow to run as app"), as this is a simple permission flag and the checker will enable this flag on executables before launching *if it detects that they are indeed executables*. it does this by checking the shebang (#!/path/to/interpreter, its used in scripts) or for known exe and msi magic numbers. what executable did you select exactly?

 

[WillyJL]

simple_human rentalunshipped982 M0narh BrockLanders ascsd blackop Nerro MaxTheEro
thanks to FaceCrap finding

You must be registered to see the links

, sorting bug might be fixed
try build 1406 please
basically there is a bug where imgui can return corrupted sort specs if you check them when the specs arent dirty (havent been changed by user). i was doing this because changing tabs with "independent views" option would cause to have different sorting, but would not trigger the dirty flag as its technically just a different table, for which the specs did not change. now i only get new sort specs when dirty flag is set, and save them. meaning when changing tab it just uses the specs it had saved, not ones reported by imgui. and when you change sorting for a given tab, it saved the new specs for it for later use.
the imgui bug has been fixed, but pyimgui is on an older version. the usage i had before was supported by imgui, but not ideal. regardless this new system should be more efficient, and also avoid the bug.

 

[MaxTheEro]

simple_human rentalunshipped982 M0narh BrockLanders ascsd blackop Nerro MaxTheEro
thanks to FaceCrap finding

You must be registered to see the links

, sorting bug might be fixed
try build 1406 please
basically there is a bug where imgui can return corrupted sort specs if you check them when the specs arent dirty (havent been changed by user). i was doing this because changing tabs with "independent views" option would cause to have different sorting, but would not trigger the dirty flag as its technically just a different table, for which the specs did not change. now i only get new sort specs when dirty flag is set, and save them. meaning when changing tab it just uses the specs it had saved, not ones reported by imgui. and when you change sorting for a given tab, it saved the new specs for it for later use.
the imgui bug has been fixed, but pyimgui is on an older version. the usage i had before was supported by imgui, but not ideal. regardless this new system should be more efficient, and also avoid the bug.

Wow thanks , do you want it to be tested? I will report back if the problem still persist

 

[WillyJL]

Wow thanks , do you want it to be tested? I will report back if the problem still persist

that would be great, thanks. no need to spend hours testing, just install that beta build and use as normal, just keep an eye out to see if it happens again, hopefully it wont

 

[doctorx6969]

that should be a notification by kde daemon, not exactly sure why but from what i recall its some kind of permission where an executable is not allowed to launch other executables (as malware often does things like this). the executable of the game should already be marked as executable (the "allow to run as app"), as this is a simple permission flag and the checker will enable this flag on executables before launching *if it detects that they are indeed executables*. it does this by checking the shebang (#!/path/to/interpreter, its used in scripts) or for known exe and msi magic numbers. what executable did you select exactly?

Any unity, but here is an example: world of sisters:

World Of Sisters 0.26.3 (Linux).x86_64

 

[Danv]

app need auto memory cleaning or something
started app (GPU memory around 10% used) -> hover over list of video collection threads (their banners almost always animated) -> GPU memory skyrockets with every hovered thread (with 100+ threads i have in list it reaches 92% used out of 8gigs) -> it stays like this till app is closed, holding all this memory for itself, even in BG mode

 

[Dukez]

from now on ill stop answering this and show this screenshot of the readme instead
View attachment 4355050

I suppose it may be counter intuitive in the sense of reducing load on the forums but is this something that would we ever be able to run locally rather than relying on another party for?

Secondly, if we're receieving cached data from your cache server and comparing it with ours, why does the program require signing in? This seems redundant, I personally don't care about the notifications from this program, telling me someone replied to a thread, etc. That could be done away with, it has no impact on the purpose of this software for me which is keeping track of games and that's it.

Worst case scenario would be we're passing our account info onto your cached servers and you have a copy of it... obviously this could be checked by going through the source code. It wouldn't be the first time someone has done something malicious despite it being available in open source code, after all someone has to go looking for it in order to find it. I'm not saying you're doing that, I'm just highlighting an example for others.

So I guess my question is if we're receiving cached data from your server, is there any plans to be able to remove our account from this program and keep it focused on it's main task which from what I can see, requires no account at all.

 

[ascsd]

app need auto memory cleaning or something
started app (GPU memory around 10% used) -> hover over list of video collection threads (their banners almost always animated) -> GPU memory skyrockets with every hovered thread (with 100+ threads i have in list it reaches 92% used out of 8gigs) -> it stays like this till app is closed, holding all this memory for itself, even in BG mode

what version of the app are you on? and what OS?

 

[Danv]

what version of the app are you on? and what OS?

11.0.1 Win10

 

[WillyJL]

I suppose it may be counter intuitive in the sense of reducing load on the forums but is this something that would we ever be able to run locally rather than relying on another party for?

This is precisely how it was until last month. This program singlehandedly caused multiple downtimes for f95zone. It's basically a DDOS. Now it isn't anymore.

If you mean self hosting your own cache api, technically nothing is stopping you, it's open source and even in the same repository. Only dependency is redis and the xf_user cookie in the env file. But of course this defeats the whole purpose, as we go back to multiple people fetching data from f95zone with the same objective and in the same way for no reason. Also, Sam helped me out by disabling some rate limits on latest updates and the version check api, so you wouldn't be able to run the indexer api as it is (mostly just changing the version check api limit from 1000 to 100), and would encounter some rate limits when getting precise data from latest updates if more than a certain amount of requests in an hour.
The idea is that Sam has some more lenient rate limits for my cache api and that it's the only one, so on its own it's more stressful on the server than 1 single f95checker user in the past, but means that it's only this one thing, not thousands of users all doing it at the same time.

Secondly, if we're receieving cached data from your cache server and comparing it with ours, why does the program require signing in? This seems redundant, I personally don't care about the notifications from this program, telling me someone replied to a thread, etc. That could be done away with, it has no impact on the purpose of this software for me which is keeping track of games and that's it.

So I guess my question is if we're receiving cached data from your server, is there any plans to be able to remove our account from this program and keep it focused on it's main task which from what I can see, requires no account at all.

As stated in the changelog and readme, this is no longer the case. It can be used fully without an account, and it is so by default as notification checking is disabled for new users from now on.
The limitation is mostly download links. To prevent links being taken down, I obviously cannot include naked download links in the cache api. It only includes an indication of where to find the download link in the thread, which then the checker on your machine will retrieve from the f95zone thread, which of course requires an account. This is true for regular, masked, and donor ddl links. Rpdl torrents require their own account, but not an f95zone account.

Worst case scenario would be we're passing our account info onto your cached servers and you have a copy of it... obviously this could be checked by going through the source code. It wouldn't be the first time someone has done something malicious despite it being available in open source code, after all someone has to go looking for it in order to find it. I'm not saying you're doing that, I'm just highlighting an example for others.

You can see in modules/api.py that both fast_check() and full_check(), which are the only methods connecting to my api, use cookies=False.

 

[WillyJL]

app need auto memory cleaning or something
started app (GPU memory around 10% used) -> hover over list of video collection threads (their banners almost always animated) -> GPU memory skyrockets with every hovered thread (with 100+ threads i have in list it reaches 92% used out of 8gigs) -> it stays like this till app is closed, holding all this memory for itself, even in BG mode

Unfortunately that's how it is, banner images are very high quality and the program allows you to zoom a lot into them. With the imgui paradigm this means sending the full resolution texture to the gpu. You can compress the images on disk for yourself to lower both disk and gpu vram usage, and I plan to implement something like this in the tool eventually but it's low priority. Also I hope it's just vram you mean, it used to handle images a bit weirdly in the past, it would keep the texture data in ram if images were shown for a moment then hidden, now it properly passes to gpu.

but yeah keeping all images in vram is a bit of a problem. Not sure what is the correct way to handle it. Loading them is slow, and just having them unload when they go off screen seems like it will just make it horrible to use as it keeps loading images all the time.
As always cache invalidation is the unsolved computer science problem

 

[Danv]

but yeah keeping all images in vram is a bit of a problem. Not sure what is the correct way to handle it. Loading them is slow, and just having them unload when they go off screen seems like it will just make it horrible to use as it keeps loading images all the time.
As always cache invalidation is the unsolved computer science problem

hm, maybe some sort of compromise?
- unload images as tab is switched, so only pics on currently active tab ended up cached (especially helps if one have VNs/animation separated, plus switching tabs can be used to free memory)
- checkbox to disable *display* of banners completely, even better - this checkbox in tab's context menu, so it can be done per tab instead of globally
- straight up button (next to "BG mode" for example) to purge memory without restarting app

considering how aggressive this thing eats memory (with one accidental mouse swoop above the list during scrolling costing few gigs of vram in the instant), at least some sort of a solution still would be nice

 

[Dukez]

As stated in the changelog and readme, this is no longer the case. It can be used fully without an account, and it is so by default as notification checking is disabled for new users from now on.

Ahh that's good to know, perhaps I should be reading the changelogs and stuff lol. I'll have to figure out how to unconnect the account then since I don't need that aspect of it.

The cache api thing makes sense too, wouldn't want to overload the forums and cause issues but it's good to know that it's possible in case the need ever arises for whatever reason.

 

[WillyJL]

Ahh that's good to know, perhaps I should be reading the changelogs and stuff lol. I'll have to figure out how to unconnect the account then since I don't need that aspect of it.

manage > clear > all cookies. though it will make downloads stop working, as those need login as i mentioned. to be honest i could rename that to "F95zone Session" to mimic the "RPDL Session"

 

[FaceCrap]

So I guess my question is if we're receiving cached data from your server, is there any plans to be able to remove our account from this program and keep it focused on it's main task which from what I can see, requires no account at all.

On the one hand I get what you're saying, and by now you have been told how to 'disconnect' your account, so no, there aren't any plans to add this, it's been an option since day one.

But on the other hand.... You've used the checker for how long? And only now you're worried about your login data?

 

[Dukez]

On the one hand I get what you're saying, and by now you have been told how to 'disconnect' your account, so no, there aren't any plans to add this, it's been an option since day one.

But on the other hand.... You've used the checker for how long? And only now you're worried about your login data?

I feel like I might've bought it up a long time ago but this time was because how the program works changed recently with it running through an external server so I was curious on exactly what details get passed to that which is what made me wonder about the whole account thing.

manage > clear > all cookies. though it will make downloads stop working, as those need login as i mentioned. to be honest i could rename that to "F95zone Session" to mimic the "RPDL Session"

Good to know but honestly I've never even used it lol. I guess the Donor DDL thing would automate downloading if I downloaded to the website right? It's something I'll have to think about but for me, I usually install mods in most games so I can get a walkthrough or other patches right so it would still be a manual process anyway.

Perhaps something could be done to automate that too, I know some mods have their own thread altogether but others (e.g the game 'No More Money') have their mods posted under the game as a regular post which probably makes it harder to identify and figure out. If that could all be automated in some way and queued up (important because you need the base game there before adding a mod since they usually overwrite) then it would be pretty neat. It would probably require these mods to be attached to the game in the program somehow though in order to put them all in the same folder in the case of it being like a separate thread altogether?

 

[FaceCrap]

running through an external server so I was curious on exactly what details get passed

Nothing, at least not to the caching server. Your F95zone login cookie is only used and sent to F95zone when accessing F95zone directly.
e.g. using a download link or checking for alerts.

I guess the Donor DDL thing would automate downloading if I downloaded to the website right?

Nope, you'd still need to click a button to start the download. Just like with the regular ones taken from the thread.
The only automatic thing is that it can extract the downloaded archive for you. But since the DDL option downloads to the default C:\Users\<you>\Downloads folder, you also will need to move it yourself to wherever you keep your games.

Perhaps something could be done to automate that too,

Regardless if a mod has its own thread or not... you would still need to download it separately, and manually. It was brought up before but given that the OP of a thread is the only one following a strict template, it's undoable to hunt for mod posts within the thread.
Since these don't follow a strict template it's near impossible to parse them for a download. Some will have them attached, others offering them via filesharing hosts, some even use patreon.
Having the downloads section at least parsed in full makes it easier to get them without having to visit the forum.