Well I was going to post this in the Itch discussions as it's now relevant there but Itch flagged my account after I've only ever posted once which was the other day, informing people that OpenRouter has a hard daily limit on free AI model requests. *Shrug* well hopefully I can get since help here.
I was originally using the devs AI which worked pretty well beyond eventually just forgetting everything and ruining scenarios so I decided to host my own after I found this post. However, I am having issues where the AI will not be very descriptive and only writes like 3-4 lines. It also will not add the dialog my character is saying into its responses.
The other main issue I have as after a bit of time the AI seems to get certain data stuck in it as it keeps adding the same lines into every response, sometimes multiple times in a response.
Lastly, I am unable to get the AI to respond to questions or commands that it will not try to use inside the story. With the devs, I was able to ask it enough times by calling it AI and asking it how I can do certain things. Eventually it told me that if I use "!info," (w/o quotes) the anything after it would consider a command or question that it would not use in the story. I was able to get it to spawn enemies, alter behaviors, and much more. But the ones I am using now just ignore it no matter how many times I ask. Any ideas how to force or train it to respond outside the story?
I have tried two different models which are:
qwen2.5-7b-instruct-uncensored
mistral-7b-instruct-v0.3-abliterated
Are my issues just due to them being newer and not as experienced as the devs? Also I have tried adding the prompts from the guide and the giant list of ones from ArlostRVN. But these didnt seem to help. I made sure I restarted the world to make sure the prompts take effect though I am not sure if you have to or if they're used right away.
Please let me know if you need anymore information or is you have ideas on how to help.
------------------------------------------------------------------------------------------------------------------------------------------
Update: Well good news, I got the Mistral 7b AI to listen finally to the same commands as the what the devs AI was responding to. I think the Mistral Instruct has been semi trained in a similar way so it understands it but it takes time for it to understand that you're trying to interact with it outside of the story. I did add rules to try to help this but it took time before it finally did. Now I just need it to not get stuck with data it uses over and over again and to be more descriptive and I am in a good place to start building my world again.