Skip to content

Posts tagged "Inference"

5 posts found

LLM Inference: What businesses need to know
8 min read

LLM Inference: What businesses need to know

Learn what LLM inference is, how it works, how it differs from training, and which hardware and frameworks support it. Read our article now!
AI LLM inference
Read More →
Build a Sovereign Coding Agent with Goose and Exoscale Dedicated Inference
7 min read

Build a Sovereign Coding Agent with Goose and Exoscale Dedicated Inference

Deploying a simple AI coding agent using Goose and Exoscale Dedicated Inference
AI LLM inference
Read More →
GPU Partitioning with MIG on Exoscale SKS
9 min read

GPU Partitioning with MIG on Exoscale SKS

GPUs are massively used in the age of AI, but depending on the workload we need to run, a single GPU can sometimes be over-dimensioned. Imagine deploy...
AI LLM vLLM
Read More →
Inside an LLM: From Prompt to Tokens
8 min read

Inside an LLM: From Prompt to Tokens

Learn how LLM inference transforms a prompt into tokens through prefill and decode, hidden states, attention, MLP, KV cache, and transformer layers.
AI LLM inference
Read More →
From Commercial API to Sovereign Infrastructure: A Practical Guide to LLM Workload Migration
27 min read

From Commercial API to Sovereign Infrastructure: A Practical Guide to LLM Workload Migration

In January 2026, a software company received a routine notification from their cloud AI provider: the model powering their production pipeline was bei...
AI LLM sovereignty
Read More →
← Back to all posts