pulsatrix 1.1.0
Loading...
Searching...
No Matches
pulsatrix::orch::OpenAiCompatibleOptions Struct Reference

Settings for an OpenAI-compatible chat-completions server (llama-server, vLLM, Ollama). More...

#include <provider.hpp>

Collaboration diagram for pulsatrix::orch::OpenAiCompatibleOptions:

Public Attributes

std::string base_url = "http://127.0.0.1:8080/v1"
 The URL before /chat/completions, for example llama-server's http://127.0.0.1:8080/v1 or Ollama's http://127.0.0.1:11434/v1.
 
std::optional< Secret > api_key
 Sent as Authorization: Bearer, if the server needs one.
 
RetryPolicy retry
 
std::chrono::milliseconds read_timeout {600'000}
 

Detailed Description

Settings for an OpenAI-compatible chat-completions server (llama-server, vLLM, Ollama).

Member Data Documentation

◆ api_key

std::optional<Secret> pulsatrix::orch::OpenAiCompatibleOptions::api_key

Sent as Authorization: Bearer, if the server needs one.

◆ base_url

std::string pulsatrix::orch::OpenAiCompatibleOptions::base_url = "http://127.0.0.1:8080/v1"

The URL before /chat/completions, for example llama-server's http://127.0.0.1:8080/v1 or Ollama's http://127.0.0.1:11434/v1.

◆ read_timeout

std::chrono::milliseconds pulsatrix::orch::OpenAiCompatibleOptions::read_timeout {600'000}

◆ retry

RetryPolicy pulsatrix::orch::OpenAiCompatibleOptions::retry

The documentation for this struct was generated from the following file: