Eval Suites API

List suites


GET /v1/projects/:slug/suites?page=1&pageSize=20

Returns paginated list of suites for a project.

Response


{
  "data": [
    {
      "id": "uuid",
      "project_id": "uuid",
      "name": "RAG Faithfulness",
      "slug": "rag-faithfulness",
      "description": null,
      "pass_threshold": 0.8,
      "created_at": "2026-04-07T12:00:00.000Z",
      "updated_at": "2026-04-07T12:00:00.000Z"
    }
  ],
  "pagination": { "page": 1, "pageSize": 20, "total": 1, "hasMore": false }
}

Create suite


POST /v1/projects/:slug/suites

Request body

Field	Type	Required	Default	Description
`name`	string	Yes	—	Suite name
`slug`	string	No	auto	URL-safe slug
`description`	string	No	`null`	Description (max 2,000 chars)
`pass_threshold`	number	No	`1.0`	0–1; minimum pass rate for “cleared”


{
  "name": "RAG Faithfulness",
  "pass_threshold": 0.8
}

Create suite from template


POST /v1/projects/:slug/suites/from-template

Creates a suite pre-configured with cases and scorers from a built-in template.

Request body

Field	Type	Required	Description
`template_slug`	string	Yes	Template slug (e.g., `rag-faithfulness`)
`name`	string	No	Override the template’s default name
`slug`	string	No	Override the auto-generated slug


{
  "template_slug": "rag-faithfulness",
  "name": "My RAG Checks"
}

Get suite


GET /v1/projects/:slug/suites/:suiteSlug

Update suite


PATCH /v1/projects/:slug/suites/:suiteSlug

Updatable fields: name, description, pass_threshold.

Delete suite


DELETE /v1/projects/:slug/suites/:suiteSlug

Soft-deletes the suite and all its cases. Returns 204 No Content.