pulsatrix 1.1.0
Loading...
Searching...
No Matches
provider.hpp File Reference

LLM providers: the Anthropic API and OpenAI-compatible servers, behind one interface. More...

#include <chrono>
#include <cstdint>
#include <functional>
#include <memory>
#include <optional>
#include <stdexcept>
#include <string>
#include <string_view>
#include <utility>
#include <vector>
#include "pulsatrix/orch/http.hpp"
#include "pulsatrix/orch/message.hpp"
#include "pulsatrix/orch/secret.hpp"
Include dependency graph for provider.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

struct  pulsatrix::orch::StreamCallbacks
 Called as a streamed answer arrives. Either may be empty. More...
 
class  pulsatrix::orch::ProviderError
 The provider answered with an error, or failed after its retries. More...
 
struct  pulsatrix::orch::RetryPolicy
 When and how long to retry. More...
 
class  pulsatrix::orch::Provider
 A model behind an API. More...
 
struct  pulsatrix::orch::AnthropicOptions
 Settings for the Anthropic Messages API. More...
 
struct  pulsatrix::orch::OpenAiCompatibleOptions
 Settings for an OpenAI-compatible chat-completions server (llama-server, vLLM, Ollama). More...
 

Namespaces

namespace  pulsatrix
 
namespace  pulsatrix::orch
 

Functions

std::unique_ptr< Provider > pulsatrix::orch::MakeAnthropicProvider (AnthropicOptions options, std::shared_ptr< HttpTransport > transport=nullptr)
 The Anthropic provider. transport defaults to MakeHttpTransport().
 
std::unique_ptr< Provider > pulsatrix::orch::MakeOpenAiCompatibleProvider (OpenAiCompatibleOptions options, std::shared_ptr< HttpTransport > transport=nullptr)
 The OpenAI-compatible provider. transport defaults to MakeHttpTransport().
 

Detailed Description

LLM providers: the Anthropic API and OpenAI-compatible servers, behind one interface.