Skip to main content
Large language models give agents the ability to make autonomous decisions. The Autonomy Computer provides a Model Gateway that gives your apps access to a wide range of models from different providers, each optimized for different use cases and cost profiles. You specify which model an agent should use by passing the model argument to Agent.start():
images/main/main.py
You can easily switch models by changing the model name in your Model() constructor.

Supported Models

Autonomy supports a curated set of models from leading providers. All models are accessed through the Model Gateway, which handles routing, load balancing, and failover automatically.

Chat Models

Models for conversational AI and text generation, sorted by price from highest to lowest.

Embedding Models

For text embeddings and semantic search.

Realtime Models

For real-time voice conversations.

Audio Models

For text-to-speech and speech-to-text.

Parameters

The Model() constructor accepts additional parameters that control the model’s behavior.
  • temperature: The sampling temperature to use, between 0 and 2. Higher values like 0.8 produce more random outputs, while lower values like 0.2 make outputs more focused and deterministic.
  • top_p: An alternative to sampling with temperature. It instructs the model to consider the results of the tokens with top_p probability. For example, 0.1 means only the tokens comprising the top 10% probability mass are considered.
images/main/main.py

Invoke Models Directly

For simple use cases, you can also invoke models directly. This is useful when you need to make one-off completions without the full features of an agent.
images/main/main.py

Streaming Responses

You can also stream responses from models by setting stream=True:
images/main/main.py

Embeddings

Generate embeddings for semantic search and similarity:
images/main/main.py