Hey there ! Great stuff !
I'm having a hard time connecting to a local running KoboldAI, what should the API endpoint and model name look like ?
Because my local install seems to only have one route for generation (localhost:5000/api/v1/generate) that does not look like yours (in /chat/completions)
If I try the one I mentioned, I get a 422, which is a Validation error according to KoboldAI API, which makes sense if the route you are trying to reach is not the same...
Any idea ?