Skip to content
InfratoApp
Layers / Inference / Serving / Inference APIs

Inference APIs

COMPARE TWO OF THESE →

5 of 47 inference APIs listings publish a rate we can read. On H200-SXM-141GB, the one most of them price, rates run from $2.09/GPU·hr to $5.49/GPU·hr across 4 providers — a spread of 2.6×, median $4.02/GPU·hr. Each rate is read from the provider's own pricing page.

Hosted inference sold per token or per request, where somebody else operates the hardware. Software you run yourself to serve the same weights is an inference engine, and a single endpoint spreading requests across several of these providers is a gateway or router. The price is the product here, which is why this category is priced and most are not.

47 in this category
5 PRICED · SORT AND VIEW BELOW

NARROW BY WHAT THIS CATEGORY ASKS

LICENCE · 34 NOT READ

STREAMING · 37 NOT READ

DATA RESIDENCY · 38 NOT READ

CHEAPEST · H200-SXM-141GB

$2.09/GPU·hr

MEDIAN

$4.02/GPU·hr

SPREAD

2.6×

PROVIDERS

4 of 47

Above: one card, H200-SXM-141GB, across the 4 providers selling it — the only like-for-like comparison here. Below: each provider’s own cheapest rate, on whatever card that is. They are different questions and the second one is not a ranking.

NO RATE ON RECORD · 42

We have not read a published rate for these. A dash in a price column reads as cheap; this reads as what it is. Some publish nothing, some quote on request, and some we have simply not reached.

BentoMLHugging Face TGIpowerinferbentomlKServeloraxparallaxtrussfastapi-ml-skeletonflamaAlibaba Model StudioAmazon BedrockArcee AIAssemblyAIBaidu QianfanBlack Forest LabsCartesiaCerebras InferenceChutesDeepgramElevenLabsFeatherless AIFireworks AIFish AudioGladiaGroqInference.netLepton AIMicrosoft FoundryModelScopeNanoGPTNovita AIPerplexityRecraftRev AIRunwaySiliconFlowSnowflake CortexSonioxTopaz LabsVenice AIVolcengine Ark

ONE RATE PER PROVIDER — ITS CHEAPEST, WITH THE SKU IT IS FOR · A MEDIAN NEEDS EVERY OTHER SELLER’S PRICES, WHICH IS WHY NO VENDOR PUBLISHES ONE · EVERY RATE CARRIES THE PAGE IT WAS READ FROM AND THE DATE

SORTED BY ONE STATED COLUMN · USED BY = LISTED PRODUCTS DEPENDING ON IT, IN THIS DIRECTORY — NOT A POPULARITY FIGURE · NO OVERALL SCORE AND NO RANK COLUMN, BECAUSE BLENDING ADOPTION, STARS AND DOWNLOADS NEEDS WEIGHTS, AND WEIGHTS ARE AN OPINION PRESENTED AS ARITHMETIC

Cite this page

The count and its date sit inside the citation, because “Inference APIs” without a date is a claim that quietly goes wrong as the category fills.

infratoapp, “Inference APIs — Inference / Serving”, read 28 October 2026. 47 listed products. https://www.infratoapp.com/layers/inference/inference-api

No overall score, and no rank column

Blending adoption, stars and downloads needs weights, and weights are an opinion presented as arithmetic — so this table sorts by one stated column at a time and shows which. This view holds no billing column and joins no billing table: a sponsor cannot appear higher, and the signals meter is a row’s own confidence, never a score you can sort on.

Frequently asked

What is in the Inference APIs category?
47 products in the Inference / Serving layer of the AI stack. Hosted inference sold per token or per request, where somebody else operates the hardware. Software you run yourself to serve the same weights is an inference engine, and a single endpoint spreading requests across several of these providers is a gateway or router. The price is the product here, which is why this category is priced and most are not. Listed members include BentoML, Hugging Face TGI and powerinfer. Every fact on each listing carries the page it was read from and the date it was read.
How are Inference APIs compared here?
By the 9 attributes this category declares, asked of every member and answered only where a source states it. A product with no answer on record shows a gap rather than a guess, and no blended score is published — weights would be an opinion presented as arithmetic.
BentoML or Hugging Face TGI?
Both are listed under Inference APIs. We publish no verdict between them — we hold no benchmark that would support one. What we do hold is the same attribute sheet for each, side by side with the source behind every value, at /compare/hugging-face-tgi-vs-openllm.
What does a blank mean on a inference apis row?
That nobody has told us, not that the answer is no. A hollow ring is "no answer on record", which is a different state from a recorded no — and the two look different on purpose. A listing with a blank has not failed the question; it has not been read for it.
How often are inference apis figures re-read?
Every value carries the date it was read and a link to the page it came from. Prices move fastest and are re-read most often; an attribute read weeks ago says so rather than presenting itself as current. Anything past 21 days is hidden rather than shown stale.
Is this every inference api there is?
No. This is 47 we have read and can cite. A directory that claimed completeness would be making a promise it cannot keep, so the page states its own count instead and says when a category is too thin to shortlist from.
Can a vendor pay to rank higher here?
No. Nothing on this page can be bought: a sponsor cannot enter a table, reorder a row or change a mark, and there is no ranked position for sale. How the site is paid for, and the line each source of money does not cross, is set out under money and independence at /our-data#sec5.