EchoCache
Live API Testing Sandbox

Interactive Cache Playground

Test semantic vector lookups, simulate MISS vs. HIT latency savings, and inspect SDK calls live.

Connected to Local Vector Index
Total Requests0
Cache Hits0
Cache Misses0
Latency Saved0 ms
Cost Saved$0.00

Input Prompt

Test Semantic Matching (Click Step 1 then Step 2):
Preset 1
Preset 2
Preset 3
Result Output
Execute a prompt or click a preset on the left to view the response...
Pipeline Execution Console
Live Logs
4:46:25 PM
EchoCache Engine Ready
Enter an API key or click a preset prompt below to test semantic caching.
SDK Equivalent Code
1import { EchoCache } from "echocache-node";
2
3const cache = new EchoCache("ec_prod_demo_key_98f2b1a0");
4
5// Intercept prompt and return cached completion in <10ms
6const response = await cache.ask("What is the capital of France?", () =>
7 openai.chat.completions.create({
8 model: "gpt-5.6-sol",
9 messages: [{ role: "user", content: "What is the capital of France?" }]
10 })
11);