Colab/Localtunnel/Official - instance's public IP required to access webpage when routing through Localtunnel. #335 opened on May 18 by AluminumAlman. 4. MosaicML's MPT-7B models. #334 opened on May 17 by Yukkun. 1. docker-cuda.sh issues. #333 opened on May 15 by jason-brian-anderson.Connect TavernAI with KoboldAI: Click on the burger menu to the top-right corner of the Tavern screen. Choose Settings, and input your KoboldAI URL inside the box. Add a /api at the end of it. Then you can hit connect.⚡ You can find both colab links on my post and don't forget to read Tips if you want to enjoy Kobold API, check here 👉 https://beedai.com/janitor-ai-with-ko...You have to purchase a URL through CloudFlared, then set it up, make a tunnel, run Kobold, add it to your tunnel and then you can link it. It's not super easy or intuitive. I've actually done all that stuff and it still doesn't want to work right. Retarded_bred • 2 mo. ago. After a bit of attempts, this is very confusing and idk what to do.place the file in your koboldAI directory and run it. that's the one with the play.bat, aiserver.py, etc files. the default name of the directory would be "KoboldAI-Client-main", though you might have renamed it. run the command play.bat; follow the instructions until you hit an error; post screenshot of the errorKoboldAI is originally a program for AI story writing, text adventures and chatting but we decided to create an API for our software so other software developers had an easy solution for their UI's and websites. VenusAI was one of these websites and anything based on it such as JanitorAI can use our software as well. Version : Provider : use_google_drive : TPU Edition Model Descriptions GPU Edition Model Descriptions Tips to get the most out of Google Colab Google will occationally show a Captcha, typically...Is there a rest api i can use? and what model/prompt should i use for a fantasy text adventure thing. After you get koboldai to run in local or collab, just add /api to the kobolofai url, then you can see a swagger doc about available url. I think the one you need is /generate, which accepts a prompts and some other settings. If KoboldAI does not possess an open file handle to the configuration file, this function opens the file in w+b mode if the clear parameter is a truthy value, otherwise the file is opened in r+b mode. These are mostly the same – the file is opened in binary read-write mode and then seeked to the start of the file – except the former mode ...The KoboldAI API URL setup process is much like setting up the OpenAI API key. The following steps should guide you: Accessing the KoboldAI API URL: First, get access to the KoboldAI API URL by signing up on the KoboldAI platform and navigating to the API section. API URL Verification: After acquiring the URL, paste it into the Janitor AI ...KoboldAI has a REST API that can be accessed by adding /api to the URL that Kobold provides you (For example http://127.0.0.1:5000/api). When accessing this link in a browser you will be taken to the interactive documentation. Jun 30, 2023 · Generating an OpenAI Key. Once you’ve created an account and logged in, click on your profile image in the top-right corner of the page. Select “View API Keys” from the dropdown menu. Choose the “Create New Secret Key” option, enter a name for the key, and click “Create Secret Key.”. Make sure to save the key in a secure location. Contribute to KoboldAI/KoboldAI-Client development by creating an account on GitHub.I can successfully connect the API to the URL and I have a model loaded into Kobold. But when I type messages into SillyTavern, I get no responses. Other APIs work such as Moe and KoboldAI Horde, but KoboldAI isn't working. The whole reason I went for KoboldAI is because apparently it can be used offline. ⚡ You can find both colab links on my post and don't forget to read Tips if you want to enjoy Kobold API, check here 👉 https://beedai.com/janitor-ai-with-ko...En esta guía vas a aprender cómo instalar y configurar Kobold AI y utilizarlo en tu navegador web. También aprenderás a usar la URL en Janitor AI o en Venus AI para chatear con los personajes. Este tutorial no necesita ningún conocimiento técnico para llevarse a cabo. Usted puede configurar esto muy fácilmente y en cuestión de minutos ... Generating an OpenAI Key. Once you’ve created an account and logged in, click on your profile image in the top-right corner of the page. Select “View API Keys” from the dropdown menu. Choose the “Create New Secret Key” option, enter a name for the key, and click “Create Secret Key.”. Make sure to save the key in a secure location.Your KoboldAI IP address with /api behind it. Example: 127.0.0.1:5001/api Make sure you load a model in the normal KoboldAI interface first before using the api link. This does not work for VenusAI, needs to be a proper trycloudflare link since their service isn't private and uses their own servers to connect.Now with the URL, go to JanitorAI, click on the KoboldAI API option, paste the previous URL into the text box, and you should be good to go! to make sure you got the right thing, click "Check Kobold URL" just to be on the safe side. Now you're free to go and Romance all of the AI's you're strange little goblin heart desires!Jul 18, 2023 · Enter your inputs and settings in the fields. Click on the Execute button. You will see the output of the API in the Response body section. Use the API in your own applications, games or any experiments. You can send HTTP requests to the KoboldAI API URL using your preferred programming language or tool. WindowAI/OpenRouter. this browser extension allows you to connect to the abovementioned cloud LLMs. use your own ChatGPT/Claude API key with WindowAI. use OpenRouter to pay to use their API keys instead. useful if you don't want to create individual accounts on each service. website and website.Enter your inputs and settings in the fields. Click on the Execute button. You will see the output of the API in the Response body section. Use the API in your own applications, games or any experiments. You can send HTTP requests to the KoboldAI API URL using your preferred programming language or tool.En esta guía vas a aprender cómo instalar y configurar Kobold AI y utilizarlo en tu navegador web. También aprenderás a usar la URL en Janitor AI o en Venus AI para chatear con los personajes. Este tutorial no necesita ningún conocimiento técnico para llevarse a cabo. Usted puede configurar esto muy fácilmente y en cuestión de minutos ...Getting your Kobold AI API key involves a simple process after setting up an account on the Kobold AI platform: Log in to your Kobold AI account. Navigate to the ‘API’ section. Click on ‘Generate New API Key’. A new API key will be generated by the system. Remember to store this key securely, as it’s crucial for all future ...What is Kobold AI API URL? Kobold AI API URL generally follows a standard format that includes the domain name or IP address of the server, along with a specific endpoint for the desired API resource. Also Read: How to Fix "Invalid Or Expired Token' on Silly Tavern AIpose season 3
KoboldCpp is an easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info ...If you host it on google colab you can play on mobile too. 1. Intelligent_Fun3701 • 1 mo. ago. Yes but the api url for kolbold ai? 1. Vallen_H • 1 mo. ago. You get it from google colab output. 1. Noep12 • 1 mo. ago.KoboldAI is a powerful and easy way to use a variety of AI based text generation experiences. You can use it to write stories, blog posts, play a text adventure game, use it like a chatbot and more! In some cases it might even help you with an assignment or programming task (But always make sure the information the AI mentions is correct, it ...So connecting to https://localhost:5000 or https://127.0.0.1:5000 will not work unlike other solutions that let you connect to your KoboldAI instance privately. If you installed KoboldAI on your own computer we have a mode called Remote Mode, you can find this as an icon in your startmenu if you opted for Start Menu icons in our offline installer. Feb 27, 2023 · Connect TavernAI with KoboldAI: Click on the burger menu to the top-right corner of the Tavern screen. Choose Settings, and input your KoboldAI URL inside the box. Add a /api at the end of it. Then you can hit connect. WindowAI/OpenRouter. this browser extension allows you to connect to the abovementioned cloud LLMs. use your own ChatGPT/Claude API key with WindowAI. use OpenRouter to pay to use their API keys instead. useful if you don't want to create individual accounts on each service. website and website.Colab/Localtunnel/Official - instance's public IP required to access webpage when routing through Localtunnel. #335 opened on May 18 by AluminumAlman. 4. MosaicML's MPT-7B models. #334 opened on May 17 by Yukkun. 1. docker-cuda.sh issues. #333 opened on May 15 by jason-brian-anderson. KoboldAI is originally a program for AI story writing, text adventures and chatting but we decided to create an API for our software so other software developers had an easy solution for their UI's and websites. VenusAI was one of these websites and anything based on it such as JanitorAI can use our software as well. Using KoboldAI to run Pygmalion 6B is perfectly capable though, as long as you have a GPU capable of running it, or are OK with loading a colab to run it in the cloud with limited time and a slow load up. The choice ultimately comes down to whether you want to run everything locally, or if you are OK using an API controlled by OpenAI or Quora.Is there a rest api i can use? and what model/prompt should i use for a fantasy text adventure thing. After you get koboldai to run in local or collab, just add /api to the kobolofai url, then you can see a swagger doc about available url. I think the one you need is /generate, which accepts a prompts and some other settings.rapidtables
deccan2008 • 2 mo. ago. Yes, it's supposed to be your own IP address that the wider Internet can see. But that's probably not going to work either unless you really know how to configure your router's ports to open them to the public Internet and that comes with the usual security risks. What you are really supposed to do is to use a service ...Jun 25, 2023 · Select “Kobold” in the API Section. Scroll down to the “API” section within the Janitor AI settings. Here, you will find different options for integrating AI capabilities into your chatbot. Choose the “Kobold” option to enable Kobold AI. Paste the Kobold AI URL. Once you have selected Kobold AI, you will see an “API URL” field. Copy the provided link and append “/api” to the end. For example, if the link is “ http://127.0.0.1:5000/ “, the corresponding KoboldAI API URL would be “ http://127.0.0.1:5000/api “. Open the KoboldAI API URL in your browser to access the interactive documentation, which displays available endpoints, parameters, and more.The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support ...Jun 12, 2023 · The KoboldAI API URL setup process is much like setting up the OpenAI API key. The following steps should guide you: Accessing the KoboldAI API URL: First, get access to the KoboldAI API URL by signing up on the KoboldAI platform and navigating to the API section. API URL Verification: After acquiring the URL, paste it into the Janitor AI ... An API url is called an endpoint (it can mean other things too). In the horde API, the generations are not available at the “/check/“ url. Instead, once done = True, you can perform a further request (also called a fetch or a get) to the url containing “/status/“ to get the generation result." deccan2008 • 2 mo. ago. Yes, it's supposed to be your own IP address that the wider Internet can see. But that's probably not going to work either unless you really know how to configure your router's ports to open them to the public Internet and that comes with the usual security risks. What you are really supposed to do is to use a service ...Go to the KoboldAI tab on your browser and delete the "#" on the url, press enter so the site reloads (remember that on TavernAI it should not have the "#" either). You may want to refresh and reconnect TavernAI as well. I saw that this worked for most people. *Also it seems that you need to have play.bat open while using KoboldAI locally.KoboldAI is originally a program for AI story writing, text adventures and chatting but we decided to create an API for our software so other software developers had an easy solution for their UI's and websites. VenusAI was one of these websites and anything based on it such as JanitorAI can use our software as well.WindowAI/OpenRouter. this browser extension allows you to connect to the abovementioned cloud LLMs. use your own ChatGPT/Claude API key with WindowAI. use OpenRouter to pay to use their API keys instead. useful if you don't want to create individual accounts on each service. website and website. I can successfully connect the API to the URL and I have a model loaded into Kobold. But when I type messages into SillyTavern, I get no responses. Other APIs work such as Moe and KoboldAI Horde, but KoboldAI isn't working. The whole reason I went for KoboldAI is because apparently it can be used offline.shelby high school
11. Wait 2-5 min. After all initialization is completed, we see the url. Open it; 12. We get into KoboldAI interface. Write "1" in the text pole and send it. 13. After we received the generated text, we copy KoboldAI url; 14. Go to TavernAI and open right menu; 15. Click "Settings" 16. Add copied KoboldAI url here and click "Connect" 17.URL: 127.0.0.1:5000. Click Save tunnel. Google Colab. Click in the given order. Chub Venus setup. Remember to run Chub Venus in already disabled CORS browser. Go to API Settings (click hambuger dropdown button) At API, select KoboldAI; KoboldAI API URL set to your public hostname; Click Check KoboldAI then click Save Settings; KoboldAI still ...I've never once had a good experience with it in writing, Im not gonna lie. some people like it, and I'm a novella writer, so maybe someone who prefers shorter writing and chatting would like it more! it's completely free and very easy to use, as well. #sillytavern #koboldai #openai. Sep 16, 2023 · Once the setup is finished, you will see the API URLs as shown below. If you look at the generated URL, you will find the Kobold AI page where you can generate images or create an interesting story. Configure the Kobold AI API URL in ProgramMatek AI. Enter the API URL and click “Check Kobold URL.” Save the settings. Jun 14, 2023 · If Kobold AI has an API, its URL might look something like “ https://api.koboldai.com/ {endpoint} “, where “ {endpoint}” would be replaced by the specific resource you’re trying to access, such as “/v1/generate” for a text generation endpoint. Is there a rest api i can use? and what model/prompt should i use for a fantasy text adventure thing. After you get koboldai to run in local or collab, just add /api to the kobolofai url, then you can see a swagger doc about available url. I think the one you need is /generate, which accepts a prompts and some other settings.With the colab link it runs inside the browser on one of google's computers. The links in the model descriptions are only there if people do want to run it offline, select the one you want in the dropdown menu and then click play. You will get assigned a random computer and a TPU to power the AI and our colab notebook will automatically set ...Select “Kobold” in the API Section. Scroll down to the “API” section within the Janitor AI settings. Here, you will find different options for integrating AI capabilities into your chatbot. Choose the “Kobold” option to enable Kobold AI. Paste the Kobold AI URL. Once you have selected Kobold AI, you will see an “API URL” field.If you host it on google colab you can play on mobile too. 1. Intelligent_Fun3701 • 1 mo. ago. Yes but the api url for kolbold ai? 1. Vallen_H • 1 mo. ago. You get it from google colab output. 1. Noep12 • 1 mo. ago. Is there a rest api i can use? and what model/prompt should i use for a fantasy text adventure thing. After you get koboldai to run in local or collab, just add /api to the kobolofai url, then you can see a swagger doc about available url. I think the one you need is /generate, which accepts a prompts and some other settings. Download the Kobold AI client from here. Install it somewhere with at least 20 GB of space free. Go to the install location and run the file named play.bat and see if after a while a browser window opens. If it does you have installed the Kobold AI client successfully. If it doesn't, try to run install_requirements.bat that should fix it. KoboldAI is originally a program for AI story writing, text adventures and chatting but we decided to create an API for our software so other software developers had an easy solution for their UI's and websites. VenusAI was one of these websites and anything based on it such as JanitorAI can use our software as well.Installing KoboldAI Github release on Windows 10 or higher using the KoboldAI Runtime Installer. Extract the .zip to a location you wish to install KoboldAI, you will need roughly 20GB of free space for the installation (this does not include the models). Open install_requirements.bat as administrator.⚡ You can find both colab links on my post and don't forget to read Tips if you want to enjoy Kobold API, check here 👉 https://beedai.com/janitor-ai-with-ko...Wow, this is very exciting and it was implemented so fast! If this information is useful to anyone else, you can actually avoid having to download/upload the whole model tar by selecting "share" on the remote google drive file of the model, sharing it to your own googlecoffee county schools
For now it shows all the text-based clients connected to the horde and shows most of the information contained in the API. I left out some stuff that i thought was useless. I’ll probalbly add more things and change some stuff, like showing the kudos better or colorizing all the properties, that’s for 1.0. image-based workers are coming soon.Each row represents one sequence, each column one token.</p>","<h1 id=\"kobold.generated_cols\">kobold.generated_cols</h1>","<pre class=\" language-lua\"><code class=\"prism language-lua\">field KoboldLib<span class=\"token punctuation\">.</span>generated_cols<span class=\"token punctuation\">:</span> integer","</code></pre>","<p><em><strong ... Download the Kobold AI client from here. Install it somewhere with at least 20 GB of space free. Go to the install location and run the file named play.bat and see if after a while a browser window opens. If it does you have installed the Kobold AI client successfully. If it doesn't, try to run install_requirements.bat that should fix it.Now with the URL, go to JanitorAI, click on the KoboldAI API option, paste the previous URL into the text box, and you should be good to go! to make sure you got the right thing, click "Check Kobold URL" just to be on the safe side. Now you're free to go and Romance all of the AI's you're strange little goblin heart desires!You can check if KoboldAI possesses an open file handle to the configuration file by using <code>kobold.is_config_file_open</code>.</p> <div class=\"highlight highlight-source-lua notranslate position-relative overflow-auto\" dir=\"auto\" data-snippet-clipboard-copy-content=\"local example_config = "return 'Hello World'" local cfg do -- If ...⚡ You can find both colab links on my post and don't forget to read Tips if you want to enjoy Kobold API, check here 👉 https://beedai.com/janitor-ai-with-ko...Follow the steps below to get your Kobold API URL for Janitor AI or Venus Chub AI (both platforms): Step 1: Visit the Colab link and choose the appropriate option: TPU or GPU. I recommend starting with the GPU link. Step 2: Scroll down and tap the play button next to “← Tap this if you play on mobile.”. This will reveal an audio player.KoboldAI is originally a program for AI story writing, text adventures and chatting but we decided to create an API for our software so other software developers had an easy solution for their UI's and websites. VenusAI was one of these websites and anything based on it such as JanitorAI can use our software as well. Last Update: 2022-12-01. Download. Summary. Files. Reviews. Support. Discussion. This is a browser-based front-end for AI-assisted writing with multiple local & remote AI models. It offers the standard array of tools, including Memory, Author's Note, World Info, Save & Load, adjustable AI settings, formatting options, and the ability to import ...Added url parameter scenario hotlink shortcut to a premade scenario (Credit: @mikeX) https://lite.koboldai.net comments sorted by Best Top New Controversial Q&A Add a CommentJun 14, 2023 · If Kobold AI has an API, its URL might look something like “ https://api.koboldai.com/ {endpoint} “, where “ {endpoint}” would be replaced by the specific resource you’re trying to access, such as “/v1/generate” for a text generation endpoint. The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support ...So connecting to https://localhost:5000 or https://127.0.0.1:5000 will not work unlike other solutions that let you connect to your KoboldAI instance privately. If you installed KoboldAI on your own computer we have a mode called Remote Mode, you can find this as an icon in your startmenu if you opted for Start Menu icons in our offline installer.fighting with my familyKoboldAI is a program you install and run on a local computer with an Nvidia graphics card, or on a local with a recent CPU and a large amount of RAM with koboldcpp. You can also rent access to systems with the requisite hardware on runpod.io or vast.ai, and set KoboldAI up on those platforms. Those cost roughly $0.50/hr or so to use. En esta guía vas a aprender cómo instalar y configurar Kobold AI y utilizarlo en tu navegador web. También aprenderás a usar la URL en Janitor AI o en Venus AI para chatear con los personajes. Este tutorial no necesita ningún conocimiento técnico para llevarse a cabo. Usted puede configurar esto muy fácilmente y en cuestión de minutos ... For now it shows all the text-based clients connected to the horde and shows most of the information contained in the API. I left out some stuff that i thought was useless. I’ll probalbly add more things and change some stuff, like showing the kudos better or colorizing all the properties, that’s for 1.0. image-based workers are coming soon.Of course that uses the horde servers. so You will need to put your colab into the horde and then call your model from the horde with the API key. If you were savy enough to notice the "url" link you might get it call directly from the colab. idk, give it shot. I shall investigate further. May the light reach your soul and warm your spirit! Hi, trying to get Kobold AI to run on Silly Tavern. I downloaded both programs and got Silly Tavern working, but I have no idea what to do to generate the proper API URL. I have a string that's probably part of it, but I don't know what to add to make it valid. I'm on Windows 10 if that's relevant. Jun 14, 2023 · 6. Understanding Kobold API Requests and Responses 6.1. API Request. When making an API request to the Kobold AI model, you typically send a POST request to the API URL with a JSON body. This JSON body should contain the context field, which holds the context based on which the model should generate a response. Example: KoboldAI API URL is the gateway to a treasure trove of powerful features and interactive documentation that can revolutionize your writing experience. In this article, we will delve deep into the process of obtaining the KoboldAI API URL, guiding you through every step with clarity and precision. So, fasten your seatbelts as we embark on this ...Installing KoboldAI Github release on Windows 10 or higher using the KoboldAI Runtime Installer. Extract the .zip to a location you wish to install KoboldAI, you will need roughly 20GB of free space for the installation (this does not include the models). Open install_requirements.bat as administrator. Neelanjan-chakraborty / KOBOLD-AI-CHAT-SCRAPER-AND-CONSOLE. 🤖💬 Communicate with the Kobold AI website using the Kobold AI Chat Scraper and Console! 🚀 Open-source and easy to configure, this app lets you chat with Kobold AI's server locally or on Colab version. 🌐 Set up the bot, copy the URL, and you're good to go! 🤩 Plus, stay ...KoboldAI is originally a program for AI story writing, text adventures and chatting but we decided to create an API for our software so other software developers had an easy solution for their UI's and websites. VenusAI was one of these websites and anything based on it such as JanitorAI can use our software as well.hi i have a problem with the kobold AI API. i generated it using the Google Colab (…After obtaining the necessary API keys and Kobold AI URL, you will need to access the settings of your Janitor AI website. Follow these steps: Log in to your Janitor AI account and navigate to the website settings. Look for the “Integrations” or “API” section within the settings menu. The exact location may vary depending on your ...Version : Provider : use_google_drive : TPU Edition Model Descriptions GPU Edition Model Descriptions Tips to get the most out of Google Colab Google will occationally show a Captcha, typically...WindowAI/OpenRouter. this browser extension allows you to connect to the abovementioned cloud LLMs. use your own ChatGPT/Claude API key with WindowAI. use OpenRouter to pay to use their API keys instead. useful if you don't want to create individual accounts on each service. website and website.tkat stock
deccan2008 • 2 mo. ago. Yes, it's supposed to be your own IP address that the wider Internet can see. But that's probably not going to work either unless you really know how to configure your router's ports to open them to the public Internet and that comes with the usual security risks. What you are really supposed to do is to use a service ... How to Get & Use Janitor AI API Key - OpenAI API Key, Open AI Reverse Proxy, KoboldAI API URLHow to Get & Use Janitor AI API Key - OpenAI API Key, Open AI Re...Go to the KoboldAI tab on your browser and delete the "#" on the url, press enter so the site reloads (remember that on TavernAI it should not have the "#" either). You may want to refresh and reconnect TavernAI as well. I saw that this worked for most people. *Also it seems that you need to have play.bat open while using KoboldAI locally. The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support ...Download the Kobold AI client from here. Install it somewhere with at least 20 GB of space free. Go to the install location and run the file named play.bat and see if after a while a browser window opens. If it does you have installed the Kobold AI client successfully. If it doesn't, try to run install_requirements.bat that should fix it.En esta guía vas a aprender cómo instalar y configurar Kobold AI y utilizarlo en tu navegador web. También aprenderás a usar la URL en Janitor AI o en Venus AI para chatear con los personajes. Este tutorial no necesita ningún conocimiento técnico para llevarse a cabo. Usted puede configurar esto muy fácilmente y en cuestión de minutos ... hi i have a problem with the kobold AI API. i generated it using the Google Colab (… Jun 14, 2023 · 6. Understanding Kobold API Requests and Responses 6.1. API Request. When making an API request to the Kobold AI model, you typically send a POST request to the API URL with a JSON body. This JSON body should contain the context field, which holds the context based on which the model should generate a response. Example: Jun 25, 2023 · Select “Kobold” in the API Section. Scroll down to the “API” section within the Janitor AI settings. Here, you will find different options for integrating AI capabilities into your chatbot. Choose the “Kobold” option to enable Kobold AI. Paste the Kobold AI URL. Once you have selected Kobold AI, you will see an “API URL” field. An API url is called an endpoint (it can mean other things too). In the horde API, the generations are not available at the “/check/“ url. Instead, once done = True, you can perform a further request (also called a fetch or a get) to the url containing “/status/“ to get the generation result."amc woodbridge 5
Welcome to KoboldAI Lite! There are 26 total volunteer (s) in the KoboldAI Horde, and 42 request (s) in queues. A total of 38331 tokens were generated in the last minute. Please select an AI model to use! Enter SendsNeither KoboldCPP or KoboldAI have an API key, you simply use the localhost url like you've already mentioned. the api key is only if you sign up for the KoboldAI Horde site to use other people's hosted models or to host your own for people to use your pc.An API url is called an endpoint (it can mean other things too). In the horde API, the generations are not available at the “/check/“ url. Instead, once done = True, you can perform a further request (also called a fetch or a get) to the url containing “/status/“ to get the generation result." Installing KoboldAI Github release on Windows 10 or higher using the KoboldAI Runtime Installer. Extract the .zip to a location you wish to install KoboldAI, you will need roughly 20GB of free space for the installation (this does not include the models). Open install_requirements.bat as administrator.