Spaces:

---

huggingface

/

HuggingDiscussions

like 90

Running

Love that I can call DeepSeek R1 directly from the Hub 🔥

from huggingface_hub import InferenceClient

client = InferenceClient(
    provider="together",
    api_key="xxxxxxxxxxxxxxxxxxxxxxxx"
)

messages = [
    {
        "role": "user",
        "content": "What is the capital of France?"
    }
]

completion = client.chat.completions.create(
    model="deepseek-ai/DeepSeek-R1", 
    messages=messages, 
    max_tokens=500
)

print(completion.choices[0].message)

Is it possible to set a monthly payment budget or rate limits for all the external providers? I don't see such options in billings tab. In case a key is or session token is stolen, it can be quite dangerous to my thin wallet:(

@benhaotang you already get spending notifications when crossing important thresholds ($10, $100, $1,000) but we'll add spending limits in the future

@benhaotang you already get spending notifications when crossing important thresholds ($10, $100, $1,000) but we'll add spending limits in the future

Thanks for your quick reply, good to know!

Would be great if you could add Nebius AI Studio to the list :) New inference provider on the market, with the absolute cheapest prices and the highest rate limits...

Could be good to add featherless.ai

TitanML !!

Hey @julien-c we'd like to register as an inference provider and do some co-marketing too; please let me know way forward. We have already done the technical readiness work on our end; www.univars.space targeting to be the first inference provider partner from Africa.

Hi Hugging Face team,

We would like to register Xpersona as a Hugging Face Inference Provider.

Provider

• Provider name: Xpersona
• Hugging Face organization: xpersona-co
• Website: https://xpersona.co
• Docs: https://xpersona.co/docs
• Hosted model card: https://huggingface.co/xpersona-co/xpersona-frieren-coder
• OpenAI-compatible API base: https://www.xpersona.co/v1
• Chat completions endpoint: https://www.xpersona.co/v1/chat/completions
• Public model catalog: https://www.xpersona.co/v1/models
• Public pricing endpoint: https://www.xpersona.co/v1/pricing
• Auth: Authorization: Bearer <XPERSONA_API_KEY>

Initial Model Mapping

[
  {
    "hfModel": "xpersona-co/xpersona-frieren-coder",
    "providerModel": "xpersona-frieren-coder",
    "task": "conversational"
  }
]

Model Details

• Display name: Xpersona Frieren Coder
• Provider model id: xpersona-frieren-coder
• Type: hosted proprietary/API model, no open weights
• Inputs: text and image
• Output: text
• Context window: 400,000 tokens
• Max output: 128,000 tokens
• Tool calling: supported
• Structured output: supported
• OpenAI-compatible chat completions: supported

Pricing

• Input: $1.50 / 1M tokens
• Cached input: $0.15 / 1M tokens
• Output: $6.00 / 1M tokens
• Minimum successful request charge: $0.001

Notes

Xpersona is already listed in Models.dev/OpenCode as provider id xpersona, with OpenCode model id xpersona/xpersona-frieren-coder. We can provide any additional endpoint details, billing endpoint shape, JS/Python client implementation, or validation credentials needed for review.

Hi @Wauplin @SBrandeis @julien-c @hanouticelina — opening the registration for UomiRouter as a new inference provider.

UomiRouter is an OpenAI-compatible inference network. Traffic is served by accredited operator nodes that are part of the UOMI network — each operator runs the engine on their own GPU hardware (datacenter or homelab) after a hardware + reliability vetting. Throughput and quality SLAs are guaranteed across the listed catalog. Operators commit to a strict privacy policy (no prompt logging, no training-data collection), payload obfuscation in transit and at rest, and OPoC (Off-chain Proof of Computation): every response is signed by the operator's wallet key and carries a SHA256 of the output (returned as x-wallet-signature / x-wallet-pubkey headers), and a sampled fraction is cross-dispatched to an independent operator for re-verification. The on-chain anchoring layer on UOMI L1 is the next milestone and is not live yet.

The differentiator vs centralized APIs (closed box) and naive decentralized GPU markets (no proof of computation at all) is verifiability today: clients can check off-chain that the operator they were billed for actually produced the tokens they got.

3 PRs already open per the new-provider checklist

• huggingface.js: https://github.com/huggingface/huggingface.js/pull/2193
• huggingface_hub: https://github.com/huggingface/huggingface_hub/pull/4256
• hub-docs (page + sidebar + table + logos): https://github.com/huggingface/hub-docs/pull/2499

Integration details

• Endpoint: https://gateway.uomi.ai (OpenAI Chat Completions spec; streaming, tool calling, structured output, vision via Qwen3.6-VL all supported)
• Billing endpoint live: POST /partner/hf/billing returns {requests:[{requestId, costNanoUsd}]} per spec, batched up to 10k. Auth token ready to share via DM.
• Per-request Inference-Id header: UUID4 emitted on every response.
• Org: uomi-network — Team plan active, ready for the server-side partner-flag flip so we can call /api/partners/uomirouter/models for the staging mappings.

Initial catalog (3 conversational models)

FP8 served internally for the two Qwen models, FP8-Dynamic for Gemma:

Contact

info@uomi.ai

Happy to jump on a call or set up a Slack channel for the integration review.

This is a great idea for Wan model inference. By the way, if you ever need to share HTML previews of your AI video outputs, the HTML to URL Converter is super handy for quick sharing without any signup.

Hi @julien-c @Wauplin @SBrandeis @hanouticelina,

We're the team behind Phala and we'd like to formally express our interest in joining the Hugging Face Inference Providers program.

About Phala

Phala (phala.com) is a confidential AI cloud that delivers private LLM inference on hardware-protected GPU infrastructure. Phala runs LLMs on dedicated GPU clusters with hardware-level isolation, providing runtime attestation so users can cryptographically verify that their prompts and outputs were never exposed. Our OpenAI-compatible API gateway at https://api.redpill.ai/v1 gives developers a drop-in replacement for the OpenAI SDK with verifiable privacy guarantees.

We are already a verified inference provider on OpenRouter (openrouter.ai/provider/phala), where we have processed over 2.9 billion tokens across 14 models as of April 2026 — demonstrating production-grade reliability and scale.

Why We're a Strong Fit

Unique Differentiation — Confidential Inference: Phala is the only inference provider in the current HF lineup that offers hardware-attested, confidential GPU inference. For users handling sensitive data, regulated workloads, or privacy-critical applications, this is a meaningful capability gap we can fill.

OpenAI-Compatible API: Our API (/v1/chat/completions, /v1/embeddings) is a full drop-in replacement for the OpenAI SDK — making JS and Python client integration straightforward.

Proven Scale on OpenRouter: Our top models by token volume on OpenRouter:

Supported Models & Tasks

We currently serve the following open-weight models on Phala's confidential GPU infrastructure:

Supported Tasks: Chat Completion (LLM), Chat Completion (VLM), Feature Extraction (Embeddings)

Integration Readiness

• Our API is fully OpenAI-compatible, so the JS and Python client integration should be straightforward.
• We have an existing organization on the Hub (huggingface.co/phalanetwork) and are ready to upgrade to a Team/Enterprise plan as required.
• We're prepared to submit the JS client PR, register model mappings via the Model Mapping API, implement the billing endpoint, and follow the full onboarding checklist.
• We can have a working integration ready within 1–2 weeks of receiving guidance.

Contact

• Website: https://phala.com
• API Base URL: https://api.redpill.ai/v1
• OpenRouter Profile: https://openrouter.ai/provider/phala
• Hub Org: https://huggingface.co/phalanetwork

We're happy to provide API access for testing, jump on a call, or align our implementation to any specific requirements. Looking forward to hearing from you!

Best,
The Phala Team

This is a really cool move for UomiRouter! Network reliability is so important for inference. By the way, if you ever need to check your connection stability, you can test packet loss online at packetlosstest.dev. Super handy for ensuring smooth performance.

New Inference Provider — GonkaBroker (gonkabroker)

Hi! We'd like to be listed as an Inference Provider. We route to the Gonka.ai decentralized inference network via an OpenAI-compatible API.

• Org / provider slug: gonkabroker (Team plan active)
• JS client PR: https://github.com/huggingface/huggingface.js/pull/2226 (conversational + text-generation)
• Base URL: https://proxy.gonkabroker.com (/v1/chat/completions, /v1/completions, /v1/models)
• /v1/models exposes per-model pricing (USD/M) + context length for the comparison table / :cheapest.
• Billing API: POST https://app.gonkabroker.com/api/partners/huggingface/billing, Bearer auth, {"requestIds":[...]} → {"requests":[{"requestId","costNanoUsd"}]} (nano-USD).
• Request ID header: Inference-Id on every response.
• Logo (light + dark) ready to send.

Could you enable the org server-side so we can register model mappings? Happy to share the master key for routed traffic over a private channel. Thanks!