Quick Start

From signup to running your first eval

1. Create an Account

Sign up at echostash.com. No credit card required for the free tier.

2. Create a Prompt

Open your dashboard, click New Prompt, and write your first template. Use {{variable}} syntax for dynamic content.

3. Write Your First Test

Open the Evals tab on your prompt. Create a test suite and add a test:

yaml
suite: "Smoke Tests"
tests:
  - name: "Greeting includes name"
    given:
      name: "Alice"
    expect_render:
      - contains: "Alice"
      - starts_with: "Hello"

4. Run the Eval

Click Run to execute the suite against the current version. You will see each test's pass/fail status, rendered output, and assertion details in the results panel.

5. Get Your API Key

Go to Settings → API Keys and create a new key. Store it securely.

6. Install the SDK

npm install @echostash/sdk
# or
yarn add @echostash/sdk

7. Fetch Your Prompt

import { EchostashClient } from "@echostash/sdk"

const client = new EchostashClient({
  apiKey: process.env.ECHOSTASH_API_KEY
})

const prompt = await client.getPrompt("my-prompt")
console.log(prompt.content)