myxlmynx

New Member
Oct 26, 2017
9
9
Is this game set up for Vulkan/AMD on Linux? Tried doing local kobold instead of web tunneling to try and get faster responses but the log is all messed up and it just loads forever. Maybe I did the setup wrong but I Launched Kobold with my model, confirmed everything was working in the web ui, launched multiic, went to settings and picked local and looked up my model from the menu on the left, set a context value, then started the game. Then when I get to the bedroom description the log looks like this, tries to run CPU only with 4k context instead of using my GPU.
As I understand it, "Koboldcpp local" will try to use the built-in Koboldcpp server, which is a CUDA binary (no Vulkan acceleration). To use your own local server, launch it as usual first, then choose "Koboldcpp remote" with your local URL, typically "http://localhost:5001" (I'm also on Vulkan + AMD + Linux, and that's exactly how I set up Multiic here). You'll see the game requests on your Koboldcpp server logs.
 
3.90 star(s) 16 Votes