Others Multiic [v0.3.67] [Stvoler]

[Denkader]

10 minutes, not seconds? and pls tell me what model?

Definitely minutes. I've had this problem as well. In sandbox mode with Laura in my case (haven't tried the other models yet) using Gemini.

What happens is that it starts fine, but the longer you play and the slower the responses get. I didn't actually time it, but I could easily get up, go pour myself a drink, maybe go to the restroom, and when I'd come back there still wouldn't be an answer.

Another thing that happens a lot is that you'll wait those ten minutes and then you get a blank answer. You click and it prompts you for your input, as if it totally ignored what you wrote. I usually copy-paste it back in. Often it'll do the same thing though, wait 6-10 minutes, empty response, ask for your input. After 2-3 times of this, I'll save, shut down the game, restart, load, and it'll work again fine until it starts getting stuck again. It's a bit of a pain.

And by the way...

saving and loading only work in story mode and with hardcoded text; unfortunately, anything generated by the neural networks isn't saved yet.
for sandbox mode (character selection from the main screen) and long dialogue sessions within the story, this feature is still in development. the main challenge is to preserve the storyline within the context window without overloading it, this depends on the model, as some have very small context, which makes it hard to keep the whole story without summarizing or omitting details

This surprised me as I've been saving my sandbox progress with Laura and so far she does seem to remember all that's happened before. Happy about that too as it'd be annoying having to start over from scratch heh.

 

[Darkwarriorcb]

10 minutes, not seconds? and pls tell me what model?

I have tried this model: Janeway FSD 6.7B
I wish it had been seconds but it was minutes. Therefore I assumed that a setting was still missing.
I will try again with the new beta later, I hope it works without problems for me.
Keep up your great work


EDIT:
I have now tested the new beta and have to say that it works well and quickly so far.
but unfortunately the answers of the module I tested are not exactly accurate.
I asked how Fiona is doing.
I got the following answer.

Maria?
I want to watch TV!
But that tastes good.
I love pizza.

I think I'll try another module.
mistral-7b-instruct-v0.1.Q5_K_M
unfortunately didn't work for me.

 

[Klony]

y, there are issues with the minigame on android (
I'll try to add jumping, improve performance, fix the controls, and fix weapon selection within the next 1-2 updates.
the idea is to make the minigame somewhat souls-like; the reward is small, but giving it without completing the minigame would be unfair

pls let me know the specific moments where you couldn't progress. the skip dialog button currently only works in the sexualized long segments. I have already fixed the issue with the "⏩" trigger in an upcoming update and will double-check it

stream mode allows u to receive responses in real-time—the bot's reply is transmitted in chunks of text as it is being generated, rather than all at once after the request processing is complete

thank u )

I killed every available enemy on the map and escorted the princess to the start position, but the game didn't end. How do you win this?

 

[aleksandr unconditional]

I killed every available enemy on the map and escorted the princess to the start position, but the game didn't end. How do you win this?

u need to approach the large trex statue

 

[craigman1211]

Really cool concept, works great, I would like to talk to you about the Local LLM topic for a moment and try to make a case for it. What you have created here is a novel approach to a concept that I think is in very high demand right now, KoboldCPP, LlamaCPP, Ollama, TheBlokeAI, Silly Tavern, Chub.ai, and many others... all of these discrords are about locally run models and they number in the 10's of thousands of active memebers. Silly tavern and Kobold are both highly focused on offering an experience similar to what you are offering, but given the currated nature of your game I belive you are offering something supirior to what they are building. Although the scope is narrow, if you can proof of concept a game like this, and make it accessible to people who dont want to spend hundreds of dollars on generating tokens I think you have something that will be very popular. I understand that it isnt as simple as just adding support and that it could take some extra effort and programming, but if you intend to make anything in the future along this same line then a local llm will be super attractive to many of the enthusiasts out there. As for the kind of computer that you need for a local llm, I have a computer running a 980ti and I am able to get a 7b model working very well with kobold cpp, I would say the bottom threshold for a local llm is around 4-6 gb of vram, although you could run it off of cpu, but that is slower. The issue is not really power, its time, when you have a low powered system you must be patient cause responses could take a minute or 2 to generate depending on the context length. Just please give it some thought, I really think it will add tremendous value to your game, and it likely will not be as difficult to integrate as you might think.

 

[aleksandr unconditional]

Really cool concept, works great, I would like to talk to you about the Local LLM topic for a moment and try to make a case for it. What you have created here is a novel approach to a concept that I think is in very high demand right now, KoboldCPP, LlamaCPP, Ollama, TheBlokeAI, Silly Tavern, Chub.ai, and many others... all of these discrords are about locally run models and they number in the 10's of thousands of active memebers. Silly tavern and Kobold are both highly focused on offering an experience similar to what you are offering, but given the currated nature of your game I belive you are offering something supirior to what they are building. Although the scope is narrow, if you can proof of concept a game like this, and make it accessible to people who dont want to spend hundreds of dollars on generating tokens I think you have something that will be very popular. I understand that it isnt as simple as just adding support and that it could take some extra effort and programming, but if you intend to make anything in the future along this same line then a local llm will be super attractive to many of the enthusiasts out there. As for the kind of computer that you need for a local llm, I have a computer running a 980ti and I am able to get a 7b model working very well with kobold cpp, I would say the bottom threshold for a local llm is around 4-6 gb of vram, although you could run it off of cpu, but that is slower. The issue is not really power, its time, when you have a low powered system you must be patient cause responses could take a minute or 2 to generate depending on the context length. Just please give it some thought, I really think it will add tremendous value to your game, and it likely will not be as difficult to integrate as you might think.

thank u ) the local models with koboldcpp are under development. this week, I’ll implement streaming output and proper chat mode behavior. I expect that in 2–3 weeks, the functionality for local models will approach that of the standard models in the game and move out of beta

 

[craigman1211]

thank u ) the local models with koboldcpp are under development. this week, I’ll implement streaming output and proper chat mode behavior. I expect that in 2–3 weeks, the functionality for local models will approach that of the standard models in the game and move out of beta

Thats great to hear! I think thats an amazing decision. Can't wait to try it out.

 

[Smallfrie]

Hmmm...
interesting game
al be it the generated images are
like cross between ET and human girls... for example neck length vs head 1 to 2 instead of 1 to 3... they also have a long face... so no mercy

 

[Pif paf]

I am against the war unleashed by the dictator putin. I hate him. because of him, I have been an emigrant for two years and cannot return to my country.
I wish for Ukraine's victory.
this game, besides the obvious entertainment content, is also my attempt to reflect on the tragedy that is happening now.

You're the MAN!

 

[Pif paf]

Is it normal for a developer in Developer Notes to speak so hateful about the country, the president and its citizens? I understand nerves, but why get involved in politics?
View attachment 4211998

it depends on how many miles/km u're sitting from the barbarian army

 

[Smallfrie]

Is it normal for a developer in Developer Notes to speak so hateful about the country, the president and its citizens? I understand nerves, but why get involved in politics?
View attachment 4211998

Well... if some day you have to flee your country... that is a grudge no mater how you see it.
The only reason that you are safe cause multiple defensive alliances are in place... it is also true if you live in one of the agresive state... cause not gona end up in a meat grinder. Bellive or not we still live in an unprecedented peace full era.
Ps: he hates a person not a country... If you think any person is a country... consult with doctor.
Sorry for the off topic.

 

[Gakko_dev]

This genre is still young, but if it's implemented right, it's gonna be disruptive

 

[bigdaddymaks]

Well... if some day you have to flee your country... that is a grudge no mater how you see it.
The only reason that you are safe cause multiple defensive alliances are in place... it is also true if you live in one of the agresive state... cause not gona end up in a meat grinder. Bellive or not we still live in an unprecedented peace full era.
Ps: he hates a person not a country... If you think any person is a country... consult with doctor.
Sorry for the off topic.

You need to know the context of why he fled the country, politics is not a simple thing, like: these are good people and these are evil people

 

[Dyhart]

yes, it's planned, in development, but there is a difficulty with this so far: not everyone has a powerful laptop/PC. in search of a solution that could work even on weak machines

Yeah until people adapt the standard of at least 5 years ago and get 64bit, it's going to be a long while. It amazes me beyond measure when I see posts like "Where's the 32 bit option?"

 

[craigman1211]

Just checked out your update, very happy to see you added Kobold support, but I cannot seem to enable it or direct the path to anything, the Koboldcpp local and koboldai local fields are locked.

You must be registered to see the links

This is a llama 3 model that I use in silly tavern, it is nsfw and performs very well. It also supports over 12k context. Also uses Imatrix

 

[Smallfrie]

You need to know the context of why he fled the country, politics is not a simple thing, like: these are good people and these are evil people

No you are wrong there is only people good or bad is just point of view--->for ppl who can see different point of view its simple
most ppl can not--->so laws and culture environment are the guide lines

 

[Junkbom]

Just checked out your update, very happy to see you added Kobold support, but I cannot seem to enable it or direct the path to anything, the Koboldcpp local and koboldai local fields are locked.

You must be registered to see the links

This is a llama 3 model that I use in silly tavern, it is nsfw and performs very well. It also supports over 12k context. Also uses Imatrix

just commenting to say i have the same issue. kobold works fine in my other uses, but the game does not seem to recognize it, options are grayed out.

 

[wolf1983]

Well of course the AI isnt there yet - but honestly, thats the way to go. The first one who is able to turn something like this in a working game is going to be rich.

 

[aleksandr unconditional]

Just checked out your update, very happy to see you added Kobold support, but I cannot seem to enable it or direct the path to anything, the Koboldcpp local and koboldai local fields are locked.

You must be registered to see the links

This is a llama 3 model that I use in silly tavern, it is nsfw and performs very well. It also supports over 12k context. Also uses Imatrix

just commenting to say i have the same issue. kobold works fine in my other uses, but the game does not seem to recognize it, options are grayed out.

the kobold functionality in the game is still quite rough, currently in beta status and only available to subscribers. I plan to make it available in 2–3 weeks

 

[Junkbom]

the kobold functionality in the game is still quite rough, currently in beta status and only available to subscribers. I plan to make it available in 2–3 weeks

oh, i didn't see anywhere it was mentioned that the feature was only subscriber. i will wait then. thanks for response