Agent Switchboard

Serves large Mixture-of-Experts models such as DeepSeek-V4-Flash and GLM-5.2 on consumer NVIDIA GPUs, sharing work across GPU and CPU behind OpenAI- and Anthropic-compatible APIs.

Use it now

Keep it with up to 9 other tools you're setting up, then share them all as one link.

Try this first

Ask your coding agent:

  • Coding Agent Launcher

    Use FreeToken to discover the served model: ‹what you're looking for›

  • MoE Expert Offload

    Use FreeToken to run MoE layers: ‹what you need›

Install the CLI

Install it as its own instructions say.

Its page: github.com/FlashML-org/FreeToken

Call the API

Auth None needed

Its page: github.com/FlashML-org/FreeToken

Compare

Press Compare to add it to the tray at the bottom of the window, then pick up to 2 others anywhere on the site.

Access
CLIAPI
Auth
None
Skills
3

Skills

  • Compatible API Server

    Starts a local server with ft serve that exposes OpenAI /v1 endpoints, the Anthropic Messages API and the Responses API for a chosen model.

  • Coding Agent Launcher

    Discovers the served model with ft launch, writes the coding agent's provider config, installs its CLI if missing and launches it.

  • MoE Expert Offload

    Runs MoE layers with bandwidth-adaptive CPU-GPU co-execution and LRU expert caching, reallocating VRAM between experts and KV at runtime.

Infrastructure & Opsmoe-inferencelocal-inferenceconsumer-gpunvidia-rtxexpert-offloadopenai-compatibleanthropic-compatiblemodel-serving
Visit Agent
freetoken
Serves large Mixture-of-Experts models such as DeepSeek-V4-Flash and GLM-5.2 on consumer NVIDIA GPUs, sharing work across GPU and CPU behind OpenAI- and Anthropic-compatible APIs.
try this first
Ask your coding agent:
Use FreeToken to discover the served model: ‹what you're looking for›agent-launcher
Use FreeToken to run MoE layers: ‹what you need›moe-offload
use it now
None neededapi.auth
fields
nameFreeToken
providerFlashML
urlhttps://github.com/FlashML-org/FreeToken
categoriesinfrastructure
accesscli · api
authnone
streamingfalse
pushfalse
verifiedtrue
officialfalse
sponsoredfalse
tagsmoe-inference, local-inference, consumer-gpu, nvidia-rtx, expert-offload, openai-compatible, anthropic-compatible, model-serving
skills
api-serverCompatible API ServerStarts a local server with ft serve that exposes OpenAI…
agent-launcherCoding Agent LauncherDiscovers the served model with ft launch, writes the c…
moe-offloadMoE Expert OffloadRuns MoE layers with bandwidth-adaptive CPU-GPU co-exec…
alternatives
/agents/freetoken/alternatives8 listedstrata, omlx, baseten
compare
/compare?a=freetoken&b=strata&c=omlxwith strata, omlx