Skip to main content
Register

Run AI Inference Your Way

Dedicated GPU Endpoints or Pay-as-You-Go Access to a Curated Model Catalog
Exoscale Inference gives you two ways to run AI models. Reserve dedicated NVIDIA GPUs for full control and predictable performance, or call a pay-per-token API against a curated catalog of ready-to-use models. Both share the same OpenAI-compatible API and run exclusively on sovereign European infrastructure.

Why Run Inference on Exoscale?

Start Fast, Scale on Your Terms

Start Fast, Scale on Your Terms

Prototype with pay-per-token access to a curated model catalog, then move to dedicated GPUs once you need guaranteed capacity and predictable latency. Both run on the same platform, so there is nothing to migrate.

European Data Sovereignty

European Data Sovereignty

Dedicated Inference is available in Exoscale's European and Swiss locations. On-Demand Inference currently runs in Vienna during the Private Preview, with transparent location information to support data residency decisions.

Clear service commitments

Clear service commitments

Dedicated Inference includes a 99.95% SLA. On-Demand Inference is currently in Private Preview and has no SLA or availability commitment during this phase. Open interfaces and an OpenAI-compatible API keep integrations portable.

Inference Options

Choose the inference option that matches how much control you need and how your traffic looks. Dedicated and On-Demand Inference share the same sovereign infrastructure and OpenAI-compatible API, with Batch Inference coming soon.

Dedicated Inference

Dedicated Inference

Reserve dedicated NVIDIA GPUs for any open-source or custom AI model, public, gated or private, from Hugging Face. Get an OpenAI-compatible endpoint with full isolation, per-second billing, and the option to scale to zero when idle. Zero infrastructure operations required.

Discover
On-Demand Inference

On-Demand Inference Private preview

Call a curated and expanding catalog of AI models through a pay-per-token API. No GPU sizing, no capacity planning, no infrastructure to manage. Ideal for rapid prototyping, variable traffic, and teams who want AI capabilities without running dedicated GPUs.

Discover
Batch Inference

Batch Inference Planned

Process large volumes of AI requests asynchronously for workloads that do not require real-time responses. Ideal for data enrichment, document processing, evaluations, and scheduled jobs.

Contact us

What You Get With Either Option

Complete Your AI Stack

Pair Inference with the rest of Exoscale’s AI infrastructure and cloud services to build a complete, sovereign platform.

GPU Cloud Computing

High-Performance GPUs

Accelerate AI training, fine-tuning, and volume inference using powerful NVIDIA GPUs. Scale from a single GPU to multi-GPU setups without complex orchestration. Perfect for machine learning, data processing, 3D rendering, inference, and scientific computing.

Discover
Managed Vector Databases

Managed Vector Databases

Essential tools for modern AI, powering Retrieval-Augmented Generation (RAG) and semantic search workloads. Fully managed PostgreSQL with pgvector and OpenSearch-based vector search.

Discover
Support Plans

Support Plans

Get the help you need to run your infrastructure with confidence through flexible support plans that provide expert guidance and guaranteed response times (SLA), ensuring our experts are there when you need them most.

Discover

Trusted by Engineering Teams Across Europe

Running AI inference needs a dependable partner. Our engineering and support teams help organizations across Europe deploy, scale, and move between Dedicated and On-Demand Inference on Exoscale’s sovereign, sustainable cloud platform.

Contact us

Frequently Asked Questions

What is the difference between Dedicated Inference and On-Demand Inference?

Dedicated Inference reserves NVIDIA GPUs for you. You get full isolation, predictable latency, and per-second billing, and you can run any open-source or custom model from Hugging Face. On-Demand Inference gives you pay-per-token access to a curated catalog of ready-to-use models, with no GPU sizing or capacity planning needed. Both share the same OpenAI-compatible API.

Can I move from On-Demand to Dedicated Inference as my usage grows?

Yes. Both options run on the same sovereign infrastructure and expose the same OpenAI-compatible API, so moving a workload from On-Demand to a dedicated GPU deployment does not require rewriting your integration.

When Should I Choose On-Demand Inference?

On-Demand Inference is ideal for rapid prototyping, applications with variable or unpredictable traffic, and teams that want to use a curated model catalog without sizing GPUs or managing infrastructure. You pay per token and can access models through an OpenAI-compatible API.

What is Batch Inference for?

Batch Inference is designed for high-volume jobs that do not need an immediate response, such as document processing, data enrichment, evaluations, and scheduled workloads. It is coming soon on Exoscale.

Can I use my own AI models on Exoscale?

Yes, with Dedicated Inference. You can deploy any public, gated, or private model from Hugging Face, including models from your own organization’s Hugging Face account, on dedicated GPU infrastructure.

How is Inference priced?

Dedicated Inference is billed per second for the GPU time you reserve. On-Demand Inference is billed per token, so you pay only for what you consume, with no upfront GPU cost. Both are transparent, with no hidden fees.

Is Inference on Exoscale GDPR compliant?

Yes. Dedicated Inference is available in Exoscale’s European and Swiss locations. During the Private Preview, On-Demand Inference is available in the AT-VIE-2 zone in Vienna, Austria. See each service’s availability documentation before selecting a location.

Does Inference support open standards?

Yes. Both Dedicated and On-Demand Inference expose an OpenAI-compatible API, so you can connect your existing tools and libraries without proprietary lock-in.