Use LithosAI with omp

omp connects directly to LithosAI through its OpenAI Chat Completions transport. You do not need a local proxy or protocol adapter.

Before you begin

Install omp, create a key on the API Keys page, and confirm the model ID and token limits on the Models page.

Export your LithosAI key

Export the key in the shell where you start omp.

export LITHOSAI_API_KEY="your-key"

Add LithosAI as a custom provider

Merge the following provider into ~/.omp/agent/models.yml.

~/.omp/agent/models.yml

providers:
  lithosai:
    baseUrl: https://api.lithosai.cloud/v1
    api: openai-completions
    apiKey: LITHOSAI_API_KEY
    models:
      - id: moonshotai/Kimi-K3
        name: Kimi K3 on LithosAI
        contextWindow: 262144
        maxTokens: 32768

apiKey names the environment variable that contains the credential. Replace the model ID, context window, and output limit with the values shown in the LithosAI console.

Confirm and select the model

Confirm that omp loaded the provider, then start a session and select the model.

omp models find lithosai
omp

Inside the session, open the model picker and choose lithosai/moonshotai/Kimi-K3.

omp evolves quickly. If models.yml fails validation, compare your installed version with the current provider schema.

Verify the connection

From a project that contains a README.md, ask omp:

Read README.md and reply with only its first Markdown heading.

omp should read the local file and return its heading. This verifies both the model response and a basic local tool call.

Troubleshooting

Symptom	Cause
The LithosAI model is not selectable	`LITHOSAI_API_KEY` is unset, the provider is disabled, or `models.yml` is invalid.
`omp models` skips the custom provider	The provider is missing `baseUrl`, `api`, `apiKey`, or a valid model entry.
Authentication fails	`apiKey` must be the environment variable name `LITHOSAI_API_KEY`, not the key itself, and that variable must be exported.

Issues common to every agent are listed under Common issues.

Getting Started

Inference APIs

Account

Use LithosAI with omp

Before you begin

Verify the connection

Troubleshooting

Resources

​Before you begin

​Verify the connection

​Troubleshooting

​Resources

Before you begin

Verify the connection

Troubleshooting

Resources