<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Llm :: Category :: Documentation for AI Services</title><link>https://docs.ai.gwdg.de/en/categories/llm/index.html</link><description/><generator>Hugo</generator><language>en</language><atom:link href="https://docs.ai.gwdg.de/en/categories/llm/index.xml" rel="self" type="application/rss+xml"/><item><title>Code Completion</title><link>https://docs.ai.gwdg.de/en/user/ai-services/coco-ai/code_completion/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/coco-ai/code_completion/index.html</guid><description>Many code editors feature LLM integration these days. Code completion tools provide inline suggestions as you type, helping you write code faster by predicting the next line. They help by completing function signatures and suggesting entire code blocks based on context. They also offer a chat interface for explaining, generating, and editing code directly in your editor.
Info To use the internal models hosted on our platform with the below mentioned tools, you need a SAIA API key. If you don’t have one yet, refer to SAIA API keys to request one. The external models are not available via the API.</description></item><item><title>Agentic coding</title><link>https://docs.ai.gwdg.de/en/user/ai-services/coco-ai/agentic_coding/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/coco-ai/agentic_coding/index.html</guid><description>Agentic coding goes beyond chat and inline suggestions. These tools leverage the model’s ability to autonomously complete multi-step tasks. It’s able to read your codebase, edit files, and run terminal commands.
Info Comparison with commercial models: The Commercial Models - Agentic coding page covers agentic coding workflows using external providers such as Codex and Claude Code. OpenCode and Claude Code support both commercial-provider API keys and a SAIA API key; the sections below describe the SAIA setup for both. The tools described below provide comparable agentic coding capabilities using your SAIA API key and models hosted on GWDG’s HPC infrastructure. This allows users to benefit from modern coding assistants while keeping data processing within the institute’s infrastructure, helping to meet data protection, compliance, and confidentiality requirements. For many research and administrative use cases, this provides a practical alternative to external AI services without sacrificing core agentic coding functionality.</description></item><item><title>Available Models</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/models/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/models/index.html</guid><description>Chat AI provides a large assortment of state-of-the-art open-weight Large Language Models (LLMs) which are hosted on our platform with the highest standards of data protection. The data sent to these models, including the prompts and message contents, are never stored at any location on our systems. Additionally, Chat AI offers models hosted externally such as Anthropic Claude and OpenAI GPT-5.
Available models are regularly upgraded as newer, more capable ones are released. We select models to include in our services based on user demand, cost, and performance across various benchmarks, such as HumanEval, MATH, HellaSwag, MMLU, etc. Certain models are more capable at specific tasks and with specific settings, which are described below to the best of our knowledge.</description></item><item><title>Chat AI FAQ</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/faq/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/faq/index.html</guid><description>Data Privacy Are my conversations or usage data used for AI training or similar purposes? No, whether you use internal or external models, your conversations and data are not used to train any AI models.
When using internal models, are my messages and conversations stored on your servers at any stage? No, user messages and AI responses are not stored at any stage on our servers. Once your message is sent and you receive the response, the conversation is only available in your browser.</description></item><item><title>Personas</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/personas/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/personas/index.html</guid><description>Chat AI supports loading preset personas from configurations in the form of JSON files. Each JSON file includes the system prompt, settings, and conversations, allowing you to easily load a persona into Chat AI. While these files can be imported using the import function, Chat AI also supports directly importing public JSON files from the web, by specifying it in the URL.
Example personas If all you need is a quick link to load a specific persona, this is your chapter. These are some of the interesting and useful personas the AI community came up with:</description></item><item><title>AI Transparency Statement</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/transparency/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/transparency/index.html</guid><description>Goal Typical LLMs have the advantage, but also the problem, of having been trained on an incredible amount of data. This means that they know a lot, but are often unable to answer very specific questions. In these cases, LLMs are very prone to hallucination, which means that they basically make things up. One way to improve the performance of LLMs for very specific questions is to use Retrieval-Augmented-Generation (RAG). Here, users provide custom documents that contain the knowledge base they want to ask questions about later. Before an LLM responds to a user’s query, the most relevant documents previously provided by the user are retrieved and provided to the LLM as additional context.</description></item><item><title>Request</title><link>https://docs.ai.gwdg.de/en/user/basics/request/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/basics/request/index.html</guid><description>How a request is checked Every request passes three gates before it reaches a model: the API key it was made with, the user account that key belongs to, and the organisation that account belongs to. Each gate holds its own set of limits, split into the two kinds above: a request rate, counted in requests, and a budget, counted in euros. The request is measured against every limit that is set at that level, and it is rejected the moment any one of them is out of allowance, without the later gates being consulted. Only when all three gates pass does the request reach a model, and its cost is then written back to the budgets of all three levels at once.</description></item><item><title>Usage Requirements</title><link>https://docs.ai.gwdg.de/en/user/terms-and-conditions/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/terms-and-conditions/index.html</guid><description>General Terms The following general terms apply to the use of GWDG services:
GWDG Terms of Use GWDG General Terms and Conditions (GTC) GWDG Data Protection Notice Special Terms In addition to the general terms, the following supplementary conditions apply specifically to the use of AI services:</description></item><item><title>Terms of Use - AI Services</title><link>https://docs.ai.gwdg.de/en/user/terms-and-conditions/terms-of-use/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/terms-and-conditions/terms-of-use/index.html</guid><description>Part A: General Terms (Applicable to all AI Services)
§1 General Terms The GWDG General Terms and Conditions (GTC) apply.
§2 Registration and Access Access to this service requires an Academic Cloud ID. Using an Academic Cloud ID is subject to acceptance of the Academic Cloud’s Terms of Use.</description></item><item><title>Data Privacy Notice - GWDG AI Services</title><link>https://docs.ai.gwdg.de/en/user/terms-and-conditions/data-privacy/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/terms-and-conditions/data-privacy/index.html</guid><description>1. General Information (Applicable to all services)
Data Processor (GWDG Contact) The data controller responsible for data processing in accordance with Article 4(7) of the GDPR and other national data protection laws of EU member states, as well as other data protection regulations, is:</description></item><item><title>Migration Guide</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/migration-guide/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/migration-guide/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
With the introduction of our new RAG Manager, we have improved the UI and indexing process. Due to architectural changes, the new interface is only partially backward compatible, particularly in terms of file storage and indexing.
This guide explains:
What still works between the old and new interface What does not work How to migrate your existing Arcanas from the old manager to the new System Details The old version is still accessible during the transition period and will be removed within the next months. You can continue to use it here</description></item><item><title>RAG Service</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/rag-service/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/rag-service/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
RAG (Retrieval-Augmented Generation) is an advanced AI technique designed to improve the accuracy, reliability, and contextual relevance of AI-generated responses. Traditional AI models, such as large language models (LLMs), rely solely on pre-trained data to generate answers. While these models can provide insightful responses, they are limited by the information they were trained on, which may become outdated or may not cover specific topics in detail.</description></item><item><title>Agentic Coding</title><link>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/index.html</guid><description>This section documents agentic coding tools that can be used with the GWDG commercial model offering.
For Codex and Claude Code, you need commercial access details from support@gwdg.de. For OpenCode, both setups are possible:
with a SAIA API key
with keys for commercial models
Codex
Claude Code
OpenCode {class=“children children-type-tree children-sort-”}</description></item><item><title>Codex</title><link>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/codex/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/codex/index.html</guid><description>Codex can be used with the GWDG commercial model offering via Azure OpenAI.
Choose a setup: VS Code CLI What You Need for VS Code a commercial endpoint and API key from support@gwdg.de the deployment name that should be used with your resource Visual Studio Code with the OpenAI extension Codex For Visual Studio Code 1. Install the VS Code extension In the VS Code Marketplace, install openai.chatgpt. Documentation: Codex IDE extension 2. Azure OpenAI configuration During onboarding, you may receive ready-to-use config.toml and .env files from GWDG. If not, create the files manually with the same structure shown below.</description></item><item><title>Setting up an Arcana</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/getting-started/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/getting-started/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
Table of contents:
First Login Creating an Arcana Uploading Files Viewing your Access Link Updating files in an Arcana The process screenshots contain blank blocks. These are in the positions that will be replaced with the username.
First Login Go to the main Arcana page and click on register. You will need to log in with your Academic Cloud account first.</description></item><item><title>AI Services</title><link>https://docs.ai.gwdg.de/en/user/ai-services/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/index.html</guid><description>The AI services offered by GWDG provide a versatile platform for practical AI applications. Our portfolio ranges from a chatbot with advanced capabilities (e.g. retrieval augmented generation, tool integration, MCP) to speech transcription and image processing. All services can be conveniently used via a web interface or seamlessly integrated into existing systems via an OpenAI-compatible API. Developed as part of the KISSKI project (AI Service Centre for Sensitive and Critical Infrastructures), the services meet high data protection requirements and are therefore particularly suitable for sensitive application scenarios.</description></item><item><title>Claude Code</title><link>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/claude-code/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/claude-code/index.html</guid><description>Claude Code can be used with the GWDG commercial model offering via Microsoft Foundry.
Info Claude Code can also be pointed at the models hosted on GWDG’s HPC infrastructure using only a SAIA API key, without an Anthropic account or a commercial endpoint. See CoCo AI - Claude Code for that setup.
Choose a setup: VS Code CLI What You Need for VS Code a commercial endpoint or resource name and API key from support@gwdg.de the Claude deployment name that should be used by default Visual Studio Code 1.98 or newer the Claude Code extension from the VS Code Marketplace Claude For Visual Studio Code 1. Install the VS Code extension In the VS Code Marketplace, install Claude Code by Anthropic. Requirement: VS Code 1.98 or newer. Extension docs: Claude Code in VS Code 2. Configure Foundry access in Claude Code During onboarding, you may receive a prepared settings.json from GWDG. If not, create the file manually with the same structure shown below.</description></item><item><title>How to use Arcana</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/how-to-use/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/how-to-use/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. This also applies to the documentation.
Warning Previously, RAG/Arcanas only worked with specific models. This is no longer the case, and Arcanas now work with every model. The previous method of using Arcanas with models that have ‘RAG’ in their name (or the little book icon) will not be supported in future. Please use the GWDG Tools as described below!</description></item><item><title>Procurement</title><link>https://docs.ai.gwdg.de/en/procurement/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/index.html</guid><description>Available AI Products Within the Academic Cloud The Academic Cloud is a modular service portal available nationwide for universities, colleges, and research institutions. As a shared platform, it enables the provision, development, and use of digital services across institutional boundaries and supports cross-institutional collaboration.</description></item><item><title>OpenCode</title><link>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/opencode/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/agentic-coding/opencode/index.html</guid><description>OpenCode can be used in more than one way in the GWDG environment.
Currently, the following setups are possible:
with a SAIA API key for locally hosted models with external commercial keys for commercial model access If you need locally hosted models, use SAIA. If you need external commercial models, use your commercial access details.
Further Documentation OpenCode providers OpenCode models OpenCode introduction SAIA documentation</description></item><item><title>SAIA Platform</title><link>https://docs.ai.gwdg.de/en/technical/saia-platform/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/technical/saia-platform/index.html</guid><description>SAIA is the Scalable Artificial Intelligence (AI) Accelerator that hosts our AI services. Such services include Chat AI and CoCo AI, with more to be added soon. SAIA API (application programming interface) keys can be requested and used to access the services from within your code.
API keys are not necessary to use the Chat AI web interface.
The SAIA API is suitable for interactive inference scenarios. If you have a large amount (eg. thousands of LLM queries) of requests that you can process asynchronously, the batch paradigm of our HPC cluster is the better choice. Your batch will be completed more predictably, in less time, and with lower cost. Check out how to get started with our HPC cluster and then running LLMs to learn how you can setup up a batch inference job on the cluster. vLLM is another popular choice for LLM inference.</description></item><item><title>Chat AI Free</title><link>https://docs.ai.gwdg.de/en/procurement/chatai_free/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/chatai_free/index.html</guid><description>Chat AI Free Chat AI Free provides access to the open-weight models hosted by GWDG in Göttingen for testing and evaluation purposes. All users must have an Academic ID and a valid email address. The service is free of charge and can be accessed on an individual basis.
Limitations for Chat AI Free Minimal cluster resources are allocated for the free variant. Reduced list of available open-weight AI models. Access only to Chat AI service, Arcana/RAG, and CoCo AI. No access to Image AI, Voice AI, or Protein AI. Only one API key per user. Provided on a best-effort basis: No guaranteed availability. No guaranteed response times. Reduced request rate limits. Contractual Terms There is no additional contract required for “Chat AI Free.” Users must accept our Terms of Use by agreeing to the terms provided in the links above.</description></item><item><title>Chat AI Prepaid</title><link>https://docs.ai.gwdg.de/en/procurement/chatai_prepaid/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/chatai_prepaid/index.html</guid><description>Chat AI Prepaid Chat AI Prepaid provides access to the open-weight models hosted by GWDG in Göttingen.
It is designed for organizations that desire fixed budgets and annual payment plans while maintaining some budget flexibility during the ongoing contract cycle. The contract is valid for 12 months and can be extended upon request. The organization must also sign an Academic Cloud Basic contract.
Using the AI models via our web interface or API is optional.</description></item><item><title>Chat AI Flexible</title><link>https://docs.ai.gwdg.de/en/procurement/chatai_flexible/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/chatai_flexible/index.html</guid><description>Chat AI Flexible Chat AI Flexible provides access to the open-weight models hosted by GWDG in Göttingen.
It is designed for organizations that require monthly billing plans for flexible usage of AI models. Typical use cases include publicly accessible applications. The contract is valid for 12 months and can be extended upon request. The organization must also sign an Academic Cloud Basic contract.
Using the AI models via our web interface or API is optional.</description></item><item><title>Chat AI External Models Prepaid</title><link>https://docs.ai.gwdg.de/en/procurement/chatai_external_prepaid/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/chatai_external_prepaid/index.html</guid><description>Chat AI External Models Prepaid Chat AI External Models Prepaid provides access to the externally hosted AI models.
It is designed for organizations that desire fixed budgets and annual payment plans while maintaining some budget flexibility during the ongoing contract cycle. The contract is valid for 12 months and can be extended upon request. The organization must also sign an Academic Cloud Basic contract.
Using the AI models via our web interface or API is optional.</description></item><item><title>Chat AI External Models Flexible</title><link>https://docs.ai.gwdg.de/en/procurement/chatai_external_flexible/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/chatai_external_flexible/index.html</guid><description>Chat AI External Models Flexible Chat AI External Models Flexible provides access to externally hosted AI models.
It is designed for organizations that require monthly billing plans for flexible usage of AI models. Typical use cases include publicly accessible applications and internal tools with variable usage patterns. The contract is valid for 12 months and can be extended upon request. The organization must also sign an Academic Cloud Basic contract.
Using the AI models via our web interface or API is optional.</description></item><item><title>Token Price</title><link>https://docs.ai.gwdg.de/en/procurement/token-price/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/procurement/token-price/index.html</guid><description>Open Weight Modelle in SAIA Price per 1 Millionen Token Info The pricing table shows only illustrative prices and is non-binding. We are currently finalizing performance tests for the various models and will announce the valid prices here shortly.</description></item><item><title>Budget Limits</title><link>https://docs.ai.gwdg.de/en/technical/saia-platform/limits_budget/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/technical/saia-platform/limits_budget/index.html</guid><description>From a contract to a budget An organisation’s budgets come from what it has bought:
Step Calculation Example Annual budget by contract 72,000 € Monthly budget annual ÷ 12 6,000 € Daily budget monthly ÷ 15 400 € The daily figure is divided by 15, not 30, and that is deliberate. At ÷ 30 you could never use more than an even day’s share, and a deadline or a teaching week would hit the wall. Dividing by 15 gives roughly twice the even daily rate as burst allowance: heavy days are possible, and sustaining that pace all month is not.</description></item><item><title>Rate Limits</title><link>https://docs.ai.gwdg.de/en/technical/saia-platform/limits_rate/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/technical/saia-platform/limits_rate/index.html</guid><description>How did we calculate rate and budget limits for each organization? Two separate questions, with different answers. An organisation’s limits are derived from its contract, so that what it bought and what it may spend per day agree.
The unit that connects euros to requests A budget is measured in euros and a rate limit in requests, so translating one into the other needs a conversion factor. Derived from real usage statistics at GWDG: An average request consist of roughly 10,000 tokens, which at around 1 € per million tokens comes to about 0.01 € per request.</description></item><item><title>Token cost calculation</title><link>https://docs.ai.gwdg.de/en/technical/saia-platform/token_cost_cal/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/technical/saia-platform/token_cost_cal/index.html</guid><description>Info The GPU rates and per-token prices below are the figures used to derive the the given examples here. The authoritative and up-to-date prices for each model are published in our current pricing list.
What is our cost? Everything you spend is billed token-exact: the input and output tokens of each request are counted and priced according to the model that served it.</description></item><item><title>API Usage</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/api-usage/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/api-usage/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
The Arcana Manager exposes and api endpoint for you to use. With the api endpoint you can perform all the actions that the frontend Arcana Manager is capable of.
To use the API, you’ll first need an API key, which you can request on our website. This key works across all our services. If you’re already using the LLMs via the api, you can use the same key. Otherwise you can request your key following this documentation.</description></item><item><title>Arcana/RAG</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/index.html</guid><description>Arcana is a Retrieval-Augmented Generation (RAG) service that enables you to interact with Documents - such as research papers, manuals, or study materials - using natural language.
The Arcana service works together with our Chat AI Service.
LLMs benefit from RAG (Retrieval-Augmented Generation) by using the relevant information provided in a Document Collection (Arcana) for generating more accurate, reliable, and contextually grounded responses.
In order to use it, you need to activate your account for the Arcana page and set up an Arcana following the Getting Started Guide. Once this is done, you can share it with colleagues or the public. Details about this process can be found in the usage examples.</description></item><item><title>Chat AI</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/index.html</guid><description>Chat AI is a web service that provides access to a wide range of large language models (LLMs) through a feature-rich, user-friendly interface. It offers a curated selection of popular open-weights models running in our own data center, alongside anonymized access to external models from commercial providers.
The web interface is hosted on GWDG’s cloud infrastructure and securely forwards your requests through our scalable SAIA backend to the selected model, routing either to local HPC hardware or, for models marked as external, to the commercial vendor’s service endpoint. Our AI team updates the list of supported models regularly and is continuously developing new features.</description></item><item><title>CoCo AI (Coding Assistant)</title><link>https://docs.ai.gwdg.de/en/user/ai-services/coco-ai/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/coco-ai/index.html</guid><description>CoCo AI is our AI-assisted coding service, utilizing Chat AI and is accessible via your SAIA API key. It brings large language models directly into your development environment for code suggestions, chat-based assistance, and autonomous multi-step coding tasks.
Getting Started Before configuring any tool, you need:
A SAIA API key. If you don’t have one yet, request one here. A supported editor or terminal. See the sections below. A model to use. Browse the available models. We recommend starting with qwen3-coder-30b-a3b-instruct or devstral-2-123b-instruct-2512 for coding tasks. Info Only models hosted on GWDG’s HPC infrastructure (internal models) are available via the API. External models (e.g., GPT-4, Claude) are accessible through the Chat AI web interface only and cannot be used with CoCo AI.</description></item><item><title>Commercial Models</title><link>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/commercial-models/index.html</guid><description>GWDG offers access to selected commercial foundation models (e.g. OpenAI GPT, Anthropic Claude) via Microsoft Azure or directly via Anthropic Enterprise Licenses. For AI model access via SAIA, including locally hosted and external models, see SAIA. This section documents access to the commercial offering and related Agentic Coding Tools.
Warning Commercial models are external cloud services. Do not assume the same data locality guarantees as for locally hosted services such as SAIA. AI systems can hallucinate, and sensitive or confidential data should only be processed if that is permitted for your use case.</description></item><item><title>Docling process</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/docling-process/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/docling-process/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
The RAG Service provides users with an efficient way to upload and process PDF documents using Docling. The system converts uploaded PDFs into Markdown format while also automatically annotating them. This enhanced Markdown output, referred to as Markdown Plus, includes metadata and structural annotations for improved document parsing and customization.</description></item><item><title>Features</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/index.html</guid><description>This section collects all functionality that extends and customizes Chat AI beyond basic text generation. Features let you shape the assistant’s personality, integrate external knowledge, and configure model behavior for different use cases. The Version history is also tracked here, showing which features were added or updated in each release.
Available Features Memory Memories are pieces of information that the chatbot can learn from conversation to behave in a more personalized way. Personas Define roles and tones for the assistant (e.g., interviewer, tutor, casual style). Personas make it easy to quickly switch the model’s behavior. Arcana / Retrieval-Augmented Generation (RAG) Connect your own data sources (documents, notes, datasets) to ground responses in factual context. Tools Chat AI models are given access to a variety of tools to accomplish non text-based tasks or improve responses. Web search Image Generation Image Modification Text to speech (tts) MCP Support You can add custom public Model Context Protocol (MCP) servers to Chat AI.</description></item><item><title>Model Context Protocol (MCP)</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/mcp/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/mcp/index.html</guid><description>Chat AI supports adding public Model Context Protocol (MCP) servers as tool providers to your Chat AI experience.
This tool requires a model context protocol server URL, which should be a simple HTTPS address. In general this allows Chat AI to interact with additional tools, data sources, or further processing capabilities beyond what is built into Chat AI. Any data from your Chat AI context may be sent to the server you entered.</description></item><item><title>Public Arcana links</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/public-arcanas/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/public-arcanas/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
Here is a list of public links for Arcanas. These are sorted in categories and contain public material. Please refer to the How to use section of you need help working with these.
GWDG Services Contains knowledge about the GWDG Services and Documentation. Example question: Welche Dienste könnte ich als Forscher bei der GWDG nutzen? Institute for Computer Science Contain knowledge about the computer science study track. Example question: Wie funktioniert der Studiengang angewandte Informatik? In case you find a broken link, please let us know via our support contacts.</description></item><item><title>Support and FAQ</title><link>https://docs.ai.gwdg.de/en/user/ai-services/arcana/support/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/arcana/support/index.html</guid><description>Warning This service is currently in beta phase and is updated regularly. The same applies to the documentation.
If you run into problem using this service please contact our KISSKI support
We also need your help providing publicly available Arcana links. If you have one that you think is relevant to a larger group of users, please also reach out to us so we can publish it.</description></item><item><title>Tools</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/tools/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/tools/index.html</guid><description>Overview This document describes a custom multimodal tool server hosted on GWDG infrastructure. It provides core AI capabilities: image generation, image editing, text-to-speech (TTS), and web search, accessible directly through the Chat AI UI. These tools are designed to enrich user interaction by enabling dynamic media creation and transformation within conversational workflows.
Prerequisites To use the tool server, the following conditions must be met:</description></item><item><title>Versions</title><link>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/versions/index.html</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://docs.ai.gwdg.de/en/user/ai-services/chat-ai/features/versions/index.html</guid><description>This page lists all Chat AI releases, starting with the newest. Each entry describes new features, improvements, and fixes, with short explanations for how to use them.
v0.9.0 — September 2025 New Features Redesigned UI A fresh interface with collapsible left and right sidebars for maximum chatting space. Optimized for handling arbitrarily large conversations and attachments smoothly.</description></item></channel></rss>