switchboard
T

TensorFold

by ashhart

Serves local language models from a native Zig binary on Apple Silicon and NVIDIA GPUs with OpenAI- and Anthropic-compatible APIs, for developers running models on their own hardware.

3
Skills
None
Auth
Yes
Streaming
No
Push

Skills

OpenAI and Anthropic Compatible Serving

Serves chat completions, completions, Responses, and Anthropic Messages endpoints from a local /v1 API.

Verified Model Downloads

Downloads qualified checkpoints into the Hugging Face cache with resumable, checksum-verified transfers.

Context Compaction

Compacts overflowing conversations into a memory note while keeping the system prompt and recent turns verbatim.

Infrastructure & Opslocal-inferenceapple-siliconcudaopenai-compatiblezigllm-servingspeculative-decoding
Visit Agent
tensorfold
Serves local language models from a native Zig binary on Apple Silicon and NVIDIA GPUs with OpenAI- and Anthropic-compatible APIs, for developers running models on their own hardware.
fields
nameTensorFold
providerashhart
urlhttps://tensorfold.dev
categoriesinfrastructure
accessapi · cli
authnone
streamingtrue
pushfalse
verifiedtrue
tagslocal-inference, apple-silicon, cuda, openai-compatible, zig, llm-serving, speculative-decoding
skills
compatible-servingOpenAI and Anthropic Compatible ServingServes chat completions, completions, Responses, and An…
model-pullVerified Model DownloadsDownloads qualified checkpoints into the Hugging Face c…
context-compactionContext CompactionCompacts overflowing conversations into a memory note w…