CREATE YOUR AI CUM SLUT ON CANDY.AI TRY FOR FREE
x

Tool Others F95Checker [WillyJL]

5.00 star(s) 23 Votes

Sam

Sysadmin
Staff member
Administrator
Dec 22, 2016
2,765
19,397
then wouldn't attachments be broken for me period, not just in this app, but in general?
You're currently posting from a proxy IP. If you disable that, you shouldn't be able to load the attachments domain, as it's known to be blocked by your ISP (1000s of other people have the same problem, and you can search for it on the forums).

Note though, your browser may have cached some attachments via the proxy connection that would still appear to be loaded whislt you have your proxy/vpn disabled.
 
  • Like
  • Thinking Face
Reactions: WillyJL and Danv
Mar 23, 2021
126
110
WhiteVanDaycare is that you refreshing on the indexer beta? I've been seeing requests coming through on the server non stop for a solid 20 minutes or something lol
If it is you, would be cool to know an estimate of how long it took you overall when it's done, just to have an estimate for having all cache misses
Sorry, won't be able to test until tomorrow :(
 

blackop

Newbie
Donor
Apr 14, 2022
27
22
Hm, annoying, I'll look into it soon
I tried rate limiter (asynciolimiter instead of aiolimiter though, it's still in my fork), but I still was getting errors even with like 20 to 5 requests per minute. As I see it whole problem not is per-user, it's overall forum load (not "ratelimiting you" but "ratelimiting everyone at the moment"). For sure it's better than firing requests without any limits at all, but not sure problem can be solved without explicit retries on 429.

upd: place you'd put limiter restriction is better than what I did, now I'm embarrased :D
 
Last edited:
  • Like
Reactions: WillyJL

blackop

Newbie
Donor
Apr 14, 2022
27
22
yes, as i mentioned here - it works with proxy in your modded version
i'm using local Tor for it (SOCKS5 localhost:9150)
Then I think Sam is probably right. Your browser is proxied somehow while checker app is not. It's either try ask/force your ISP to unblock attachments domain or use proxy/vpn in both.
 

Dukez

Member
Dec 19, 2020
440
1,548
there is a build available on github actions for you to try, here's hoping my server doesnt crap out.
MAKE SURE TO BACKUP YOUR db.sqlite3 DATABASE IN F59CHECKER CONFIG FOLDER
Do you ever plan to release an offical one on the main github page rather than requiring users to login and hunt through extra menus? It's 18 months out of date, it's time to push a proper update.
 

KaosKally

Member
Dec 21, 2019
163
174
Do you ever plan to release an offical one on the main github page rather than requiring users to login and hunt through extra menus? It's 18 months out of date, it's time to push a proper update.
From what i can tell, he is releasing only the final version of the checker, leaving beta and alpha builds in the action tab for people that want it and to be fair, i find it ok. That way you have a stable release, but if you feel adventurous you can go on Buggy side of the deal, albeit with a couple hoops to pass by. What i mean is that 10.2 is stable release even if old, and in action tab is 11 but beta build. Considering how many changes to get it back to stable are needed in the past week, to me at least it makes sense why he is doing this way.
 
  • Like
Reactions: WillyJL

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
Do you ever plan to release an offical one on the main github page rather than requiring users to login and hunt through extra menus? It's 18 months out of date, it's time to push a proper update.
My priority these days is another project. I wanted to finally release an update here but wanted to fix Linux Wayland issues. Seems like that not gonna happen easily, and now there's this huge new problem, once this current issue is fixed properly I'll make a release
 
  • Like
Reactions: WhiteVanDaycare

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
I tried rate limiter (asynciolimiter instead of aiolimiter though, it's still in my fork), but I still was getting errors even with like 20 to 5 requests per minute. As I see it whole problem not is per-user, it's overall forum load (not "ratelimiting you" but "ratelimiting everyone at the moment"). For sure it's better than firing requests without any limits at all, but not sure problem can be solved without explicit retries on 429.

upd: place you'd put limiter restriction is better than what I did, now I'm embarrased :D
Looks like I'll end up with a mixed solution then, use aiolimiter but retry indefinitely with some delay if a rate limited response is received. Do you have your rate limited fork code anywhere?
 

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
there is a build available on github actions for you to try, here's hoping my server doesnt crap out.
just checked back thought the logs for the night, no errors at all, and no activity currently. Looks like it's working well and so far it's been managing to keep up with demand (if it hadn't, it would've been going through a backlog of threads to cache slower than it is asked to cache them)
 
Mar 23, 2021
126
110
WhiteVanDaycare is that you refreshing on the indexer beta? I've been seeing requests coming through on the server non stop for a solid 20 minutes or something lol
If it is you, would be cool to know an estimate of how long it took you overall when it's done, just to have an estimate for having all cache misses
Over 580 full refreshes without an error. Was decently fast considering I had forgot to bump the number of workers back up.
 
  • Like
Reactions: WillyJL

ascsd

Newbie
Jul 26, 2021
99
74
im having trouble following what youre saying, im too tired xD but from what it sounds like, its similar to what i actually did implement. read above ^^
haha yea i edited my thoughts as i was brainstorming and even im struggling to read it now.
looks like you already implemented the main points

The one i was suggesting at the end was:
when user fast checks a game, return the timestamp of when the cache on server is due to expire (i.e. time when the server will attempt checking for changes as the cache would be stale). and if the next user fast check happens before that timestamp, do not include the game in the list of fast checks.

slightly reduces the load on your server as the data locally and on server are guaranteed to already be in sync until that timestamp
 

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
haha yea i edited my thoughts as i was brainstorming and even im struggling to read it now.
looks like you already implemented the main points

The one i was suggesting at the end was:
when user fast checks a game, return the timestamp of when the cache on server is due to expire (i.e. time when the server will attempt checking for changes as the cache would be stale). and if the next user fast check happens before that timestamp, do not include the game in the list of fast checks.

slightly reduces the load on your server as the data locally and on server are guaranteed to already be in sync until that timestamp
that would be a great idea, except for one thing: game updates. kinda the whole point of all this really lmao
if an update happens before cache expiration, server invalidates the cache and will re-fetch the thread from f95zone the next time someone asks for it. but if instead, the client doesnt ask again until cache expiration because it doesnt even know it was updated, then it would take up to 7 days to find the update for users.
 

KaosKally

Member
Dec 21, 2019
163
174
Now I am just curious about something. Would it be possible to add a new tab like description etc, when you click on a game that pulls the screen's attachments in it? The ones from OP's post showcase the game. I know is not really needed, but I think for a completionist look, would be ok.
 
Mar 23, 2021
126
110
Hmmm line 514 is in import_f95_watched_threads()... are you on latest build?
Also please send that broken file it saved
LOL - I forgot to exit before updating so files were locked. I'm an idiot basically. Updated again to Beta 1227 and the sync took awhile (it is 2,539 games though and it just ran in background).

Some unusual behaviour - I updated just before exiting and installing update, yet got 38 updates that seem bogus (version change to N/A) and a few games that it says are no longer available on F95 (like https://f95zone.to/threads/quest-failed-chapter-2-christmas-special-frostworks.9774/ and https://f95zone.to/threads/sunny-love-to-cheat-v0-3-1-satanica-hime.195485/ ).
1731791547165.png
1731791793840.png
 

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
LOL - I forgot to exit before updating so files were locked. I'm an idiot basically. Updated again to Beta 1227 and the sync took awhile (it is 2,539 games though and it just ran in background).

Some unusual behaviour - I updated just before exiting and installing update, yet got 38 updates that seem bogus (version change to N/A) and a few games that it says are no longer available on F95 (like https://f95zone.to/threads/quest-failed-chapter-2-christmas-special-frostworks.9774/ and https://f95zone.to/threads/sunny-love-to-cheat-v0-3-1-satanica-hime.195485/ ).
View attachment 4240309
View attachment 4240313
I'll look into those, thanks for the report
 
  • Like
Reactions: WhiteVanDaycare

WillyJL

Veni, vidi, vici
Donor
Respected User
Mar 7, 2019
1,318
1,120
Now I am just curious about something. Would it be possible to add a new tab like description etc, when you click on a game that pulls the screen's attachments in it? The ones from OP's post showcase the game. I know is not really needed, but I think for a completionist look, would be ok.
It's planned, I was working on it long ago but didn't get that far. Considering the new rate limits as of last week, it seems even less feasible now.
 
  • Like
Reactions: KaosKally
5.00 star(s) 23 Votes