Introduction

What is Echostash?

Echostash is a prompt management platform for teams that ship AI applications. Store prompts in a versioned library, test them with automated evals, and deploy with confidence through quality gates -- all from a single dashboard.

Whether you are managing ten prompts or ten thousand, Echostash gives you the tools to version, test, compare, and deploy prompt changes without guesswork.

Key Features

• Prompt Library - Store, search, and organize prompts across projects
• Version Control - Commit, diff, tag, and deploy prompt versions to named targets (dev/staging/prod)
• Evals - Define test suites with 16 assertion types, run them against any version, and track pass rates over time
• A/B Testing - Compare two prompt versions with statistical analysis (Z-test, Cohen's h, confidence intervals)
• Quality Gates - Block deploys that fail to meet your pass-rate threshold
• Explore Mode - Quick ad-hoc testing without persisting results
• API + SDKs - Fetch, render, and eval prompts from JavaScript or Python
• Provider Agnostic - Works with OpenAI, Anthropic, Google, and more

How It Fits Together

A typical workflow looks like this:

1. Write or import a prompt in the Playground (with optional Echo DSL for dynamic templating)
2. Create a test suite with assertions that define what “good output” means
3. Run the suite and review results
4. Edit the prompt, re-run, and compare runs to catch regressions
5. When satisfied, deploy the version to production through a quality gate

Getting Started

Ready to ship? Check out the Quick Start to go from signup to your first eval run in under five minutes.