Artificial Analysis integration
Artificial Analysis integration for AI agents.
Artificial Analysis integration for AI agents with secure authentication and server-side credential injection. Open Connector runs the OAuth, seals the token in an encrypted vault, and serves Artificial Analysis tools to your agent over MCP or a typed API — credentials injected server-side, every call audited, nothing leaving your infrastructure. Open source (AGPL-3.0) and self-hostable.
What your agents can do
Real Artificial Analysis actions, managed and audited.
Your user connects Artificial Analysis once; your agent can then artificial Analysis is an independent AI benchmarking & analysis company — scoped to the OAuth permissions you grant and the tool allowlist you configure. Every action is least-privilege and written to a tamper-evident audit trail.
- 1
Your user grants Artificial Analysis access once (OAuth) — the token lands in the vault.
- 2
Your agent calls a tool over MCP or the typed API; Open Connector injects the credential server-side.
- 3
Every routed call appends a hash-chained audit record — nothing leaves your infra.
Tools & triggers
Supported Artificial Analysis tools.
31 tools are generated from the published Artificial Analysis catalog. Descriptions are plain text; each action remains subject to its configured authentication and tool allowlist.
Showing 31 tools. All published catalog entries are included in this page's server-rendered HTML.
- Submit code for CritPt evaluation
- Submit generated code solutions for grading against CritPt benchmark problems. This endpoint differs from the rest of the API. It is a **code evaluation service**, not a data retrieval endpoint. It accepts one or more code submissions and returns grading results from the CritPt evaluation server. Rate limited to **10 requests per day** per user. Only successful gradings (`200`) count toward the limit — grader error responses (`400`/`422`/`503`/`5xx`) and grader timeouts are refunded. Rate limit information is returned via `X-RateLimit-*` response headers.
- CritPt Evaluation
- Get image-editing arena rankings
- Returns arena Elo rankings for image-editing models. Free tier returns model identity plus Elo and CI only; Pro adds rank, samples, pricing, release date, open_weights_url, and optional category breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/image-editing/models/free`](#getImageEditingArenaFree) instead. Only models that hold a leaderboard rank are returned: current, first-party foundational models with at least 1,000 arena appearances. Models below the threshold, superseded versions, and third-party models are omitted rather than returned with a null rank.
- Media - Image Arena
- Get image-editing arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/image-editing/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL. Only models that hold a leaderboard rank are returned: current, first-party foundational models with at least 1,000 arena appearances. Models below the threshold, superseded versions, and third-party models are omitted rather than returned with a null rank.
- Media - Image Arena
- Get image-to-video arena rankings
- Returns arena Elo rankings for image-to-video models. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/image-to-video/models/free`](#getImageToVideoArenaFree) instead. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get image-to-video arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/image-to-video/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get image-to-video with audio arena rankings
- Returns arena Elo rankings for image-to-video models that generate video with audio output. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/image-to-video-audio/models/free`](#getImageToVideoAudioArenaFree) instead. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get image-to-video with audio arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/image-to-video-audio/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get a single language model by slug
- Returns data for a single language model identified by its slug. Includes all pro tier list fields plus detail-only fields: evaluation token counts and omniscience/openness breakdowns. Pro and Commercial only. Free tier requests return a `403` subscription error. The per-provider breakdown (`providers` array) is **Commercial only** and omitted from Pro responses. [Contact us](https://artificialanalysis.ai/data-api#contact) to discuss Commercial access.
- Language Models
- Get performance over time for a single model
- Returns a time series of performance metrics for the specified model, broken down by API provider. Each provider that offers this model will have its own series of data points within the requested window. The four metrics tracked per data point are: - **Output speed** — median tokens generated per second (`median_output_tokens_per_second`) - **Time to first token** — median latency before the first token is returned (`median_time_to_first_token_seconds`) - **Time to first answer token** — median time until the first answer token is available (`median_time_to_first_answer_token_seconds`) - **End-to-end response time** — median end-to-end response time in seconds (`median_end_to_end_response_time_seconds`) Use `window` to control how far back the data goes and `interval` to control the granularity (e.g. `window=90d&interval=weekly` returns ~13 weekly data points per provider). **Commercial only.** Free and Pro tier requests return a `403` subscription error. [Contact us](https://artificialanalysis.ai/data-api#contact) to discuss Commercial access.
- Language Models
- Get all language models
- Returns language model data including evaluations, pricing, and performance metrics. Detail-only fields (evaluation token counts, omniscience/openness breakdowns, providers) are available on `/api/v2/language/models/{slug}`. **Pro+ only.** Free integrations should use [`/api/v2/language/models/free`](#getLanguageModelsFree) instead.
- Language Models
- Get language models (Free tier)
- Free-tier sibling of `/api/v2/language/models`. Returns the Free-shape language model response: the public subset of fields. Includes headline indices, median performance, and input/output pricing. Excludes Pro-only fields such as the full evaluation set, token counts, blended pricing, performance percentiles, context window, parameters, modalities, licensing, and provider detail. Accepts any valid API key (Free, Pro, or Commercial). Pro and Commercial keys also receive the Free-shape body when calling this URL; the `tier` field reflects the caller's actual tier.
- Language Models
- Get a single language model provider by slug
- Returns data for a single API provider identified by its slug. Includes all fields from the providers list plus full performance percentile and quartile data for each model. **Commercial only.** Free and Pro tier requests return a `403` subscription error. [Contact us](https://artificialanalysis.ai/data-api#contact) to discuss Commercial access.
- Language Model Providers
- Get raw measurements for a provider
- Returns individual measurement records for the specified provider, including per-request output speed, time to first token, time to first answer token, estimated end-to-end response time, and success status. Results are grouped by model within the provider. **Commercial tier only.** Your API key must have explicit grants for the requested provider. If you are interested in accessing this endpoint, please [contact us](https://artificialanalysis.ai/data-api#contact) to discuss Commercial access.
- Language Model Measurements
- Get performance over time for a single provider
- Returns performance time series for each model offered by the specified provider, looking back from today by the specified window. This is the inverse of the model performance endpoint — here you pick a provider and see how each of their models has performed over time. **Commercial only.** Free and Pro tier requests return a `403` subscription error. [Contact us](https://artificialanalysis.ai/data-api#contact) to discuss Commercial access.
- Language Model Providers
- Get all language model API providers
- Returns data for all API providers including the models they offer, pricing, and median performance metrics. **Commercial only.** Free and Pro tier requests return a `403` subscription error. [Contact us](https://artificialanalysis.ai/data-api#contact) to discuss Commercial access.
- Language Model Providers
- Get instrumental music arena rankings
- Returns arena Elo rankings for instrumental music generation models. Free tier returns model identity plus Elo and CI only; Pro adds samples and optional genre breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/music/instrumental/models/free`](#getMusicInstrumentalArenaFree) instead.
- Media - Music
- Get instrumental music arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/music/instrumental/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL.
- Media - Music
- Get with-vocals music arena rankings
- Returns arena Elo rankings for music generation models with vocals. Free tier returns model identity plus Elo and CI only; Pro adds samples and optional genre breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/music/with-vocals/models/free`](#getMusicWithVocalsArenaFree) instead.
- Media - Music
- Get with-vocals music arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/music/with-vocals/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL.
- Media - Music
- Get speech-to-speech model data
- Returns data for speech-to-speech models including quality metrics (BBA and FDB scores). Pro tier also includes per-provider pricing and performance data. **Pro+ only.** Free integrations should use [`/api/v2/media/speech-to-speech/models/free`](#getSpeechToSpeechFree) instead.
- Media - Speech
- Get speech-to-speech model data (Free tier)
- Free-tier sibling of `/api/v2/media/speech-to-speech/models`. Returns the Free-shape response — model identity plus BBA and FDB scores, with Pro-only per-provider pricing and performance data omitted. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL.
- Media - Speech
- Get speech-to-text models
- Returns speech-to-text model data including quality metrics (word error rates). Free tier returns model identity and overall WER index only. Pro tier adds benchmark-specific WER breakdowns, open weights status, and per-provider data. **Pro+ only.** Free integrations should use [`/api/v2/media/speech-to-text/models/free`](#getSpeechToTextModelsFree) instead.
- Media - Speech
- Get speech-to-text models (Free tier)
- Free-tier sibling of `/api/v2/media/speech-to-text/models`. Returns the Free-shape response — model identity plus the overall WER index, with Pro-only benchmark breakdowns, open-weights status, and per-provider data omitted. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL.
- Media - Speech
- Get text-to-image arena rankings
- Returns arena Elo rankings for text-to-image models. Free tier returns model identity plus Elo and CI only; Pro adds rank, samples, pricing, release date, open_weights_url, and optional category breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/text-to-image/models/free`](#getTextToImageArenaFree) instead. Only models that hold a leaderboard rank are returned: current, first-party foundational models with at least 1,000 arena appearances. Models below the threshold, superseded versions, and third-party models are omitted rather than returned with a null rank.
- Media - Image Arena
- Get text-to-image arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/text-to-image/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL. Only models that hold a leaderboard rank are returned: current, first-party foundational models with at least 1,000 arena appearances. Models below the threshold, superseded versions, and third-party models are omitted rather than returned with a null rank.
- Media - Image Arena
- Get text-to-speech arena rankings
- Returns arena Elo rankings for text-to-speech models. Free tier returns model identity plus Elo and CI only; Pro adds samples, release date, and pricing. **Pro+ only.** Free integrations should use [`/api/v2/media/text-to-speech/models/free`](#getTextToSpeechArenaFree) instead.
- Media - Speech
- Get text-to-speech arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/text-to-speech/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL.
- Media - Speech
- Get text-to-video arena rankings
- Returns arena Elo rankings for text-to-video models. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/text-to-video/models/free`](#getTextToVideoArenaFree) instead. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get text-to-video arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/text-to-video/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get text-to-video with audio arena rankings
- Returns arena Elo rankings for text-to-video models that generate video with audio output. Free tier returns model identity plus Elo and CI only; Pro and Commercial add rank, samples, pricing, release date, open_weights_url, and optional category breakdowns. **Pro+ only.** Free integrations should use [`/api/v2/media/text-to-video-audio/models/free`](#getTextToVideoAudioArenaFree) instead. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
- Get text-to-video with audio arena rankings (Free tier)
- Free-tier sibling of `/api/v2/media/text-to-video-audio/models`. Returns the Free-shape arena response — model identity plus Elo and CI only. Accepts any valid API key (Free, Pro, or Commercial); Pro and Commercial keys also receive the Free-shape body (Pro-only fields omitted; the `tier` field reflects the caller's actual tier) when calling this URL. Only models that hold a leaderboard rank are returned: current models with at least 1,000 arena appearances. Models below the threshold and superseded versions are omitted rather than returned with a null rank.
- Media - Video Arena
FAQ
Artificial Analysis integration, answered
- How do AI agents use Artificial Analysis through Open Connector?
- Your user connects Artificial Analysis once with one of its cataloged authentication methods. Open Connector stores the credential in an encrypted vault and exposes Artificial Analysis tools to your agent over MCP or a typed API, with credentials injected server-side on each call.
- Is this a Artificial Analysis MCP server?
- Yes. Open Connector can serve Artificial Analysis as a named MCP server with a scoped allowlist and a per-user connection URL, so any MCP client can call Artificial Analysis actions with credentials injected server-side.
- Where do Artificial Analysis credentials live?
- In your own infrastructure. Open Connector keeps credentials in its own vault and injects them at call time, so they never leave your environment.
Give your agents Artificial Analysis — keep the keys.
Open source, self-hostable, with Artificial Analysis credentials that never leave your infrastructure. Run it from source today.