Tool Others F95Checker [WillyJL]

[WillyJL]

So I figured I would try to test the Search feature in F95 for the very first time and regret it. I got rate limited the very first time I try to search. I don't know what it is doing but it is not good that is causing a rate limited for using that feature.

View attachment 5091561

since this search uses the latest updates search, f95checker does not use the usual "max 1 request every 2 seconds". so if you get a ratelimit, its the forum giving a ratelimit. out of my control, out of your control. as discussed many times, you probably did this duri high-traffic hours with lots of people using the forum, causing everyone to get random ratelimits.

 

[FaceCrap]

redisearch seems ot have its issues and doesnt like some specific words and symbols. the checker already does what to my knowledge (and from my reverse engineering testing) is the most possible to avoid common issues with the latest updates search, you can see for yourself here

You must be registered to see the links

that it removes many symbols and whitespace.

I did some more testing and what has become absolutely clear is that the LU Search fails if you enter words shorter than 3 characters. So apart from removing symbols and whitespace, it might also benefit from removing those before sending the query.

 

[WillyJL]

I even tried searching just by using the word 'hard' in the checker and it still did not show 'Hard To Find'. Odd. It is kind of funny that 'Hard To Find' is being hard to find.

it did show a lot more relevant results for "hard". thats because it only shows the first 10 results.

 

[WillyJL]

I did some more testing and what has become absolutely clear is that the LU Search fails if you enter words shorter than 3 characters. So apart from removing symbols and whitespace, it might also benefit from removing those before sending the query.

thats actually a very good point, i hadnt noticed that in particular when testing ages ago. will make a patch and new beta with this workaround. also probably gonna add a mention of what term it is actually sending to latest updates, so someone searching just 2 letter words can see the issue.

 

[FaceCrap]

thats actually a very good point, i hadnt noticed that in particular when testing ages ago. will make a patch and new beta with this workaround. also probably gonna add a mention of what term it is actually sending to latest updates, so someone searching just 2 letter words can see the issue.

I must add a slight correction, it seems that this also applies to "The", "And" (probably other common ones too), even though it's 3 characters, it still failed (e.g. "The Red Veil", "Ladys Girls And Lolitas") and contractions like "It's" also fail. (e.g. "It's Just Game"). It even trips on "with" (e.g. "With Rain Comes Flood")... "that" (e.g. "All That's Left")

There's even exceptions it seems. "My" as in "My Bully My Lover" is accepted. Same with "Re" (e.g. "Re Even")

 

[GrammerCop]

yes, all of which we already knew


the point is that latest updates is technically untied from the forum. the latest updates is effectively a thin wrapper around a redis cache, (i presume that) when uploaders change stuff on the forum it gets cached in f95zone's latest updates redis, and when you use latest updates you hit that redis cache. thus, searching in latest updates does not use forum search, it uses redisearch. this is all because the forum is actually very computationally heavy on their servers, so something repetitively intensive like seeing the latest games and filtering them is instead done with redis separately which is designed for these types of workloads and can do them incredibly more efficiently. and redisearch seems ot have its issues and doesnt like some specific words and symbols. the checker already does what to my knowledge (and from my reverse engineering testing) is the most possible to avoid common issues with the latest updates search, you can see for yourself here

You must be registered to see the links

that it removes many symbols and whitespace.

You are correct. I found it using forum search. Sorry for setting your head in a whirl. I'm very tired. I'm been having a little trouble sleeping.

 

[alma001]

Without any apparent reason a game (Anita's Internship) started to cause PARSING_FAILED for me. The game did not get an update, there isn't even any new comment in its thread so it is really strange.

I am not a programmer, could someone help me to understand what is happening and how can I solve it ?

Removing the game solves it, I am able to Refresh! if this game is removed from F95checked but I would like to resolve it without the removal of the game in question.

I put the log in SPOILER since it is long.

Thanks in advance!

Spoiler: PARSING_FAILED

You don't have permission to view the spoiler content. Log in or register now.

 

[TheSidewinder]

Is this not happening for anyone else? I'm baffled why it's happening, since I didn't change that setting and it did work on the previous version (11.0.3 iirc)

OK, is this "just me"? I've installed 11.1 beta 1647.

But on startup it is not refreshing, though I definitely have it set to do so.

View attachment 5089452
It does refresh if I click the "Refresh" box in upper right.

 

[Blither]

Without any apparent reason a game (Anita's Internship) started to cause PARSING_FAILED for me. The game did not get an update, there isn't even any new comment in its thread so it is really strange.

I am not a programmer, could someone help me to understand what is happening and how can I solve it ?

Removing the game solves it, I am able to Refresh! if this game is removed from F95checked but I would like to resolve it without the removal of the game in question.

I put the log in SPOILER since it is long.

Thanks in advance!

Spoiler: PARSING_FAILED

You don't have permission to view the spoiler content. Log in or register now.

And Wifey's Dilemma Revisited, Milfy City Xmas 2018 Episode, Love Mansion Demo

 

[qwer2340]

Hi everyone, am I the only who who is gettting "PARSING_FAILED" error for the game thread "Anita's Internship" ?

 

[xeris89]

Hi everyone, am I the only who who is gettting "PARSING_FAILED" error for the game thread "Anita's Internship" ?

Scroll up 3 posts from yours

 

[WhiteVanDaycare]

WillyJL This parsing error does break refreshing .

EDIT: as a workaround I have removed the affected games for now, this allows it to complete.

 

[alma001]

WillyJL This parsing error does break refreshing .

EDIT: as a workaround I have removed the affected games for now, this allows it to complete.

Just for your info, it seems that the issue is gone, so you can readd those games.

 

[GrammerCop]

I added the game without error/ v11.0.3

 

[FaceCrap]

The forum seems to be suffering from major issues with attachment images, it's been getting progressively worse since about a week or so.

I'm not sure in how far this might affect the checker, but I'm experiencing pages not stopping loading until they time out (Using Edge with vertical tabs, the rotor keeps playing on the tab icon).

While I haven't had any PARSING_FAILED error yet, not even on "Anita's Internship", I wouldn't be surprised if and when the cache server needs to go out and retrieve a full thread, it too is encountering issues.

 

[WillyJL]

Without any apparent reason a game (Anita's Internship) started to cause PARSING_FAILED for me. The game did not get an update, there isn't even any new comment in its thread so it is really strange.

I am not a programmer, could someone help me to understand what is happening and how can I solve it ?

Removing the game solves it, I am able to Refresh! if this game is removed from F95checked but I would like to resolve it without the removal of the game in question.

I put the log in SPOILER since it is long.

Thanks in advance!

Spoiler: PARSING_FAILED

You don't have permission to view the spoiler content. Log in or register now.

You must be registered to see the links

just checked logs on the cache api, there ware a handful of parsing errors yesterday night due to getting an empty response. parsing errors reset themselves after 6 hours, and looks like the empty responses were a temporary issue with f95zone. issue should have resolved itself on its own already, and doesnt require any additional fix to prevent in the future. thanks for letting me know tho!

 

[WillyJL]

OK, is this "just me"? I've installed 11.1 beta 1647.

But on startup it is not refreshing, though I definitely have it set to do so.

View attachment 5089452
It does refresh if I click the "Refresh" box in upper right.

sorry, i wanted to reply yesterday then forgot. youre right, seems liek refresh at start is currently broken. seems liek the issue is here:

You must be registered to see the links

some tiem ago i changed a bit how the GUI starts up. it draws the first frame while hidden, to prevent a flashbang with a fulyl white window (the first frame is not drawn yet), and also changed how "self.hidden" works to ask glfw whether the window is hidden, not whether the program is supposed to be in background mode or not. so techncially, it is always "hidden" when starting the main loop, because the first frame is being drawn while hidden. makes sense to just remove that check and do it anyway, even if starting in background mode. will be fixed in next beta in a few hours.

EDIT: actually i remember why i had done it like that. it was to prevent it from refreshing at boot, as soon as system turns on, because maybe there is no internet or user is not logged in yet. i will move it starting the refresh to after showing the first frame.

 

[WillyJL]

just pushed a new build with search working better (workaround by removing redis stopwords from search query) and the refresh at start setting fixed

 

[FaceCrap]

Gawd, whatever is the issue with the attachment server. it's also affecting the checker. Takes ages before tags get highlighted according to how you've set them.

 

[TheSidewinder]

I can confirm the new build is doing the refresh properly on program startup.
Thanks, WillyJL!