AI Relay
The AI Relay can be used as a secure way for handling messages between a client (such as a game using EasyTalk) and an LLM server, such as OpenAI or Llama CPP Server.
Arguments
-chat-mode -full (default) -stream -settings
Settings
| Setting Name | Description |
|---|---|
| apiKey | |
| serverType | OPENAI or LLAMA |
| serviceURL | |
| model | |
| userStartToken | |
| userEndToken | |
| autoAppendUserTokens | |
| assistantStartToken | |
| assistantEndToken | |
| autoAppendAssistantTokens | |
| systemStartToken | |
| systemEndToken | |
| autoAppendSystemTokens | |
| stripTokensFromResponses | |
| autoRequestWhenIncomplete | |
| maxAutoCompletionRequests | |
| maxRequestsPerUserPerMinute | |
| maxTokensPerUserPerMinute | |
| estimatedCharactersPerToken | |
Messages Client Messages Server Messages AI Messages