> ## Documentation Index
> Fetch the complete documentation index at: https://docs-platform.crewai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# List an Automation's eval criteria

> Lists the criteria the Automation's runs are graded on: the charts of its Evals tab for the range. That is
every criterion its current eval file declares, graded yet or not, and every criterion with a score in the
range, so a criterion removed from the eval file stays listed while it has scores in the range. Criteria are
ordered as the tab orders its charts: task, agent, flow step, then crew criteria.

To find an Automation by name, list Automations with `filter=name = "…"`. Reading evals needs access to the
Automation's traces: an organization with traces off, or without continuous evals, gets `not_found`.




## OpenAPI

````yaml /openapi/platform-v1.yaml get /api/v1/automations/{automation_id}/evals/criteria
openapi: 3.0.1
info:
  title: CrewAI Platform API
  version: v1
  description: Supported public API for CrewAI Platform.
servers:
  - url: https://app.crewai.com
    description: Current CrewAI Platform host
security:
  - bearerAuth: []
tags:
  - name: Users
    description: Users in the organization.
  - name: Status
    description: Platform health and API availability.
  - name: Automations
    description: >-
      Automations, their source artifacts, their executions, and their
      schedules.
  - name: Teams
    description: Teams in the organization.
  - name: Group Mappings
    description: Identity-provider group mappings to Teams.
  - name: Service Accounts
    description: Service accounts in the organization.
  - name: Webhook Endpoints
    description: Endpoints that receive signed event deliveries.
  - name: Studio Projects
    description: Projects built in Crew Studio.
  - name: Environment Variables
    description: Environment variables in the organization.
  - name: Git Repositories
    description: Git repositories connected to the organization.
  - name: LLM Connections
    description: Connections to LLM providers.
  - name: Tools
    description: Tools in the organization's tool repository.
  - name: Applications
    description: Applications the organization can connect, with their tools and triggers.
  - name: Connections
    description: Application connections the caller can use.
  - name: Evals
    description: How an Automation's runs score on its continuous evals criteria over time.
paths:
  /api/v1/automations/{automation_id}/evals/criteria:
    parameters:
      - name: automation_id
        in: path
        required: true
        schema:
          type: string
          format: uuid
          example: 4f6d0d9a-7b78-4c6a-b64f-2e2e3d2c8f9a
      - name: range
        in: query
        required: false
        schema:
          type: string
          enum:
            - 24h
            - 7d
            - 30d
          default: 24h
          x-crewai-enum-format: freeform
          description: >
            The time range, ending now, as the Evals tab's range picker offers
            it:

            - `24h`: The last 24 hours, in hourly buckets.

            - `7d`: The last 7 days, in daily buckets.

            - `30d`: The last 30 days, in daily buckets.
    get:
      tags:
        - Evals
      summary: List an Automation's eval criteria
      description: >
        Lists the criteria the Automation's runs are graded on: the charts of
        its Evals tab for the range. That is

        every criterion its current eval file declares, graded yet or not, and
        every criterion with a score in the

        range, so a criterion removed from the eval file stays listed while it
        has scores in the range. Criteria are

        ordered as the tab orders its charts: task, agent, flow step, then crew
        criteria.


        To find an Automation by name, list Automations with `filter=name =
        "…"`. Reading evals needs access to the

        Automation's traces: an organization with traces off, or without
        continuous evals, gets `not_found`.
      operationId: listAutomationEvalCriteria
      responses:
        '200':
          description: OK
          content:
            application/json:
              examples:
                success:
                  value:
                    data:
                      - key: task:publish:7d59a677c485
                        scope: task
                        subject: publish
                        text: Posts the link
                        source: user_defined
                        graded: false
                      - key: crew:brief
                        scope: crew
                        subject: null
                        text: A usable JSON brief
                        source: user_defined
                        graded: true
                    meta:
                      bucket: hour
                      start_time: '2026-11-17T15:30:00Z'
                      end_time: '2026-11-18T15:30:00Z'
              schema:
                type: object
                required:
                  - data
                  - meta
                additionalProperties: false
                properties:
                  data:
                    type: array
                    items:
                      type: object
                      required:
                        - key
                        - scope
                        - subject
                        - text
                        - source
                        - graded
                      additionalProperties: false
                      properties:
                        key:
                          type: string
                          example: crew:brief
                          description: >-
                            The criterion's stable key, as crewai-eval computes
                            it. It stays the same when the criterion's text is
                            edited. Pass it to the scores endpoint's `criteria`.
                        scope:
                          type: string
                          enum:
                            - task
                            - agent
                            - flow_step
                            - crew
                            - unknown
                          example: crew
                          description: >
                            What the criterion grades:

                            - `task`: One task of the crew, named by `subject`.

                            - `agent`: One agent of the crew, named by
                            `subject`.

                            - `flow_step`: One step of the flow, named by
                            `subject`.

                            - `crew`: The run as a whole.

                            - `unknown`: A scope the platform does not
                            recognize.
                        subject:
                          type: string
                          example: null
                          nullable: true
                          description: >-
                            The task, agent or flow step the criterion grades,
                            or null for a `crew` criterion.
                        text:
                          type: string
                          example: A usable JSON brief
                          description: >-
                            What the criterion asks, as the eval file or the
                            grader wrote it.
                        source:
                          type: string
                          enum:
                            - user_defined
                            - crew_inferred
                            - unknown
                          example: user_defined
                          description: >
                            Where the criterion comes from:

                            - `user_defined`: The Automation's eval file
                            declares it.

                            - `crew_inferred`: The grader inferred it from the
                            crew, such as a task's expected output.

                            - `unknown`: A source the platform does not
                            recognize.
                        graded:
                          type: boolean
                          example: true
                          description: >-
                            Whether any run in the window was graded on the
                            criterion. A criterion just added to the eval file
                            is listed before anything is graded on it.
                  meta:
                    type: object
                    required:
                      - bucket
                      - start_time
                      - end_time
                    additionalProperties: false
                    description: The window the response covers.
                    properties:
                      bucket:
                        type: string
                        enum:
                          - hour
                          - day
                        example: hour
                        description: >
                          How long each score's time bucket is. Buckets are UTC
                          and start on the hour or at midnight:

                          - `hour`: One hour.

                          - `day`: One UTC day.
                      start_time:
                        type: string
                        format: date-time
                        example: '2026-11-17T15:30:00Z'
                        description: Where the window starts.
                      end_time:
                        type: string
                        format: date-time
                        example: '2026-11-18T15:30:00Z'
                        description: >-
                          Where the window ends: now for a `range`, or the end
                          of the bucket `at` names (exclusive).
        '400':
          description: Bad Request
          content:
            application/json:
              examples:
                bad_request:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/bad_request
                        code: bad_request
                        title: Bad request
                        status: 400
                        detail: range must be one of 24h, 7d, 30d.
                  summary: A range the Evals tab does not offer
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
        '401':
          description: Unauthorized
          content:
            application/json:
              examples:
                unauthorized:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/unauthorized
                        code: unauthorized
                        title: Unauthorized
                        status: 401
                        detail: Missing or invalid bearer token.
                  summary: Missing or invalid bearer token
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
        '404':
          description: Not Found
          content:
            application/json:
              examples:
                not_found:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/not_found
                        code: not_found
                        title: Not found
                        status: 404
                        detail: The requested resource could not be found.
                  summary: >-
                    The organization turned traces off, or the Automation does
                    not exist
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
components:
  schemas:
    ErrorEnvelope:
      type: object
      required:
        - errors
      additionalProperties: false
      properties:
        errors:
          type: array
          minItems: 1
          items:
            $ref: '#/components/schemas/Error'
    Error:
      type: object
      description: Public API error object.
      required:
        - type
        - code
        - title
        - status
        - detail
      additionalProperties: false
      properties:
        type:
          type: string
          format: uri
          enum:
            - https://docs-platform.crewai.com/api/problems/bad_request
            - https://docs-platform.crewai.com/api/problems/clipper_disabled
            - https://docs-platform.crewai.com/api/problems/clipper_disallowed
            - >-
              https://docs-platform.crewai.com/api/problems/clipper_feature_disabled
            - https://docs-platform.crewai.com/api/problems/clipper_not_found
            - https://docs-platform.crewai.com/api/problems/conflict
            - https://docs-platform.crewai.com/api/problems/content_too_large
            - https://docs-platform.crewai.com/api/problems/forbidden
            - https://docs-platform.crewai.com/api/problems/internal_error
            - https://docs-platform.crewai.com/api/problems/not_found
            - https://docs-platform.crewai.com/api/problems/service_unavailable
            - >-
              https://docs-platform.crewai.com/api/problems/tool_execution_failed
            - https://docs-platform.crewai.com/api/problems/unauthorized
            - https://docs-platform.crewai.com/api/problems/validation_error
          example: https://docs-platform.crewai.com/api/problems/bad_request
        code:
          type: string
          enum:
            - bad_request
            - clipper_disabled
            - clipper_disallowed
            - clipper_feature_disabled
            - clipper_not_found
            - conflict
            - content_too_large
            - forbidden
            - internal_error
            - not_found
            - service_unavailable
            - tool_execution_failed
            - unauthorized
            - validation_error
          example: bad_request
        title:
          type: string
          x-crewai-enum-format: freeform
          enum:
            - Bad request
            - Clipper resource disabled
            - Clipper resource disallowed
            - Clipper feature disabled
            - Clipper resource not found
            - Conflict
            - Content too large
            - Forbidden
            - Internal error
            - Not found
            - Service unavailable
            - Tool execution failed
            - Unauthorized
            - Validation error
          example: Bad request
        status:
          type: integer
          enum:
            - 400
            - 401
            - 403
            - 404
            - 409
            - 413
            - 422
            - 500
            - 503
          example: 400
        detail:
          type: string
          example: The request is invalid.
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      bearerFormat: opaque

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.