Me too, they are incomparable.I haven't played a single F95 game since discovering chatbots a few months ago.
Thx for recommendation! I’ve just started playing around with AI chatbots on Chub. Isn’t mercury the lower subscription tier on chub? If you have a mars subscription wouldn’t it be better to also use a mars preset or will Mixtral/Asha perform better with a mercury preset?I'll say it again:
Chub AI -> Mars Tier -> Mixtral 7B (or Asha 70B) -> "A decent Mercury" preset
...is a god-tier setup. (...)
All the built-in Chub models (Mars, Mercury, Asha) are similar enough that any of the presets should be interchangeable. I spent a long time looking for the best preset, and that was the one that I got the best results with, by far. It was much better than the top-rated popular Mars and Asha presets.Thx for recommendation! I’ve just started playing around with AI chatbots on Chub. Isn’t mercury the lower subscription tier on chub? If you have a mars subscription wouldn’t it be better to also use a mars preset or will Mixtral/Asha perform better with a mercury preset?
All the built-in Chub models (Mars, Mercury, Asha) are similar enough that any of the presets should be interchangeable. (...)
I'm doing the same but I got a 70B to work, pretty amazing.I've gotten into these recently, so I'll share my findings. I prefer to run everything offline, so my experience is entirely based on models you can actually run offline (so no 70B models. Most PCs aren't even remotely close to being able to run those).
SillyTavern with koboldcpp backend using NemoMix-Unleashed 12B Q8 has given me the best experience so far. The model doesn't have that annoying positivity bias that the llama trained models seem to have, it can be fairly creative at times without going too far off the rails and it's also completely uncensored. Using koboldcpp allows me to actually run it with somewhat acceptable speeds at around 2.5 T/s (compared to oogabooga which just gives up and shits itself). And sillytavern is a vastly superior frontend compared to the koboldcpp default when it comes to 1 on 1 character RP, allowing for a whole range of things including static character sprites, ai voice, vn-like ui, backgrounds, image generation, etc all built into it. Using these three combined with WebUI and Alltalk for image and voice respectively gave an experience that really put chatbots on the map for me. They're like visual novels juiced up with the most potent seroids imaginable.
If you're planning on trying out local models, I highly HIGHLY reccomend NemoMix. It understands context really well and seems to be good at both NSFW and SFW roleplay. I've tested out a couple of other 12Bs and 8Bs, but NemoMix is the model that is most consistent in my opinion. If you can't run that, some of the 8Bs are fine too. My favorites are Stheno3.2 8B, Niitama 8B, and Celeste 8B. All of them will start to repeat themselves after a while though. The main draw to these is that they can run on a lot more computers, but there's a tradeoff in quality. So if you're struggling with the larger 12B, try one of these. They're pretty good but once you try a 12B you're not going to want to go back to the 8Bs lol.
Yeah agreed on that. Though one of my biggest problems with NovelAI was its lack of details. It doesn't really describe what is going on in a room, and it is also unclear exactly where it wants you to go. That probably stems from the fact that it don't want you to do anything necessarily, but it can mean some pretty slow play which could've been better.I took the most expensive NovelAI (25$ per month) for a spin and was really impressed. On a scale of 0-10 where 0 is role playing with an orange and 10 is your favorite porn author is role playing with you and helps you relive your nastiest fantasies, I'd rate NovelAI's chatbot an impressive 7.
It does have its typical AI glitches (like forgetting stuff) but it never tried to block my sessions (nasty as they were) or steer me towards a SFW scenario. Additionally, from time to time it actually surprised me with good "plot initiatives" although I'd estimate that I still have to edit/delete about 20%-30% of its output. So: a 7/10 which amazing IMHO, especially since I'd rate its earlier incarnations from less than a year ago no more 4-5 out of 10, very frustrating affairs.
I do miss the old text adventure commands Look (describe the scene to me) and Examine (describe a specific object/person to me), but that's beside the point.
Would you mind helping me? I don't understand how to run nemomix with koboldcpp, I thought only specific ggml models worked on it, like wizardlm. I also don't understand how to load the nemomix model with koboldcpp, as it seems to have come in 5 parts?I've gotten into these recently, so I'll share my findings. I prefer to run everything offline, so my experience is entirely based on models you can actually run offline (so no 70B models. Most PCs aren't even remotely close to being able to run those).
SillyTavern with koboldcpp backend using NemoMix-Unleashed 12B Q8 has given me the best experience so far. The model doesn't have that annoying positivity bias that the llama trained models seem to have, it can be fairly creative at times without going too far off the rails and it's also completely uncensored. Using koboldcpp allows me to actually run it with somewhat acceptable speeds at around 2.5 T/s (compared to oogabooga which just gives up and shits itself). And sillytavern is a vastly superior frontend compared to the koboldcpp default when it comes to 1 on 1 character RP, allowing for a whole range of things including static character sprites, ai voice, vn-like ui, backgrounds, image generation, etc all built into it. Using these three combined with WebUI and Alltalk for image and voice respectively gave an experience that really put chatbots on the map for me. They're like visual novels juiced up with the most potent seroids imaginable.
If you're planning on trying out local models, I highly HIGHLY reccomend NemoMix. It understands context really well and seems to be good at both NSFW and SFW roleplay. I've tested out a couple of other 12Bs and 8Bs, but NemoMix is the model that is most consistent in my opinion. If you can't run that, some of the 8Bs are fine too. My favorites are Stheno3.2 8B, Niitama 8B, and Celeste 8B. All of them will start to repeat themselves after a while though. The main draw to these is that they can run on a lot more computers, but there's a tradeoff in quality. So if you're struggling with the larger 12B, try one of these. They're pretty good but once you try a 12B you're not going to want to go back to the 8Bs lol.
Nevermind! I downloaded the wrong one I think.Would you mind helping me? I don't understand how to run nemomix with koboldcpp, I thought only specific ggml models worked on it, like wizardlm. I also don't understand how to load the nemomix model with koboldcpp, as it seems to have come in 5 parts?
I haven't used it for a long time, but Spicy Chat AI was solid enough as a free version, you just have to wait for your turn.Has anyone gotten a subscriptions for Spicy Chat AI? Is it worth it? I lowkey wanna do it