> ## Documentation Index
> Fetch the complete documentation index at: https://docs-platform.crewai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# List the executions graded on an eval criterion

> Lists the Automation's executions graded on one criterion in the range, newest first: the table under a chart
of its Evals tab. Each row has the execution's score on the criterion, the judge's overall reason, and the
judge's verdict on each of the criterion's checks.

With a token delegated to a member, only the executions that member ran are listed, as with traces.




## OpenAPI

````yaml /openapi/platform-v1.yaml get /api/v1/automations/{automation_id}/evals/executions
openapi: 3.0.1
info:
  title: CrewAI Platform API
  version: v1
  description: Supported public API for CrewAI Platform.
servers:
  - url: https://app.crewai.com
    description: Current CrewAI Platform host
security:
  - bearerAuth: []
tags:
  - name: Users
    description: Users in the organization.
  - name: Status
    description: Platform health and API availability.
  - name: Automations
    description: >-
      Automations, their source artifacts, their executions, and their
      schedules.
  - name: Teams
    description: Teams in the organization.
  - name: Group Mappings
    description: Identity-provider group mappings to Teams.
  - name: Service Accounts
    description: Service accounts in the organization.
  - name: Webhook Endpoints
    description: Endpoints that receive signed event deliveries.
  - name: Studio Projects
    description: Projects built in Crew Studio.
  - name: Environment Variables
    description: Environment variables in the organization.
  - name: Git Repositories
    description: Git repositories connected to the organization.
  - name: LLM Connections
    description: Connections to LLM providers.
  - name: Tools
    description: Tools in the organization's tool repository.
  - name: Applications
    description: Applications the organization can connect, with their tools and triggers.
  - name: Connections
    description: Application connections the caller can use.
  - name: Evals
    description: How an Automation's runs score on its continuous evals criteria over time.
paths:
  /api/v1/automations/{automation_id}/evals/executions:
    parameters:
      - name: automation_id
        in: path
        required: true
        schema:
          type: string
          format: uuid
          example: 4f6d0d9a-7b78-4c6a-b64f-2e2e3d2c8f9a
      - name: criterion
        in: query
        required: true
        description: >-
          The key of the criterion whose graded executions to list, from the
          criteria endpoint. A key the criteria endpoint does not list for the
          same range is `not_found`.
        schema:
          type: string
          example: crew:brief
      - name: range
        in: query
        required: false
        schema:
          type: string
          enum:
            - 24h
            - 7d
            - 30d
          default: 24h
          x-crewai-enum-format: freeform
          description: >
            The time range, ending now, as the Evals tab's range picker offers
            it:

            - `24h`: The last 24 hours, in hourly buckets.

            - `7d`: The last 7 days, in daily buckets.

            - `30d`: The last 30 days, in daily buckets.
    get:
      tags:
        - Evals
      summary: List the executions graded on an eval criterion
      description: >
        Lists the Automation's executions graded on one criterion in the range,
        newest first: the table under a chart

        of its Evals tab. Each row has the execution's score on the criterion,
        the judge's overall reason, and the

        judge's verdict on each of the criterion's checks.


        With a token delegated to a member, only the executions that member ran
        are listed, as with traces.
      operationId: listAutomationEvalExecutions
      parameters:
        - name: order_by
          in: query
          required: false
          description: >-
            Orders results by a comma-separated list of fields. Fields sort
            ascending by default; append ` asc` or ` desc` to set a direction.
            Supported fields: `id`, `executed_at`. Default: `executed_at desc,id
            asc`. Unless `id` is explicitly included, `id asc` is appended as a
            deterministic tie-breaker.
          schema:
            type: string
            example: id,executed_at desc
        - name: page_size
          in: query
          required: false
          description: >-
            Maximum number of records to return. Defaults to 50; values above
            100 are reduced to 100. May change between pages.
          schema:
            type: integer
            minimum: 1
            default: 50
        - name: page_token
          in: query
          required: false
          description: >-
            Continues after the last record of a previous page. Pass
            `meta.next_page_token` from that response and repeat the same
            filtering and ordering arguments. Cannot be combined with a non-zero
            `skip`.
          schema:
            type: string
        - name: skip
          in: query
          required: false
          description: >-
            Number of records to skip from the start of the collection, to jump
            to a position without a `page_token`. The response still returns
            `meta.next_page_token` for continuing from there. Cannot be combined
            with a non-empty `page_token`.
          schema:
            type: integer
            minimum: 0
            default: 0
      responses:
        '200':
          description: OK
          content:
            application/json:
              examples:
                success:
                  value:
                    data:
                      - execution_id: 0b6f5a51-9a52-4a37-8d43-3c5b2e8b8a10
                        executed_at: '2026-11-18T13:30:00Z'
                        deployment_version: 2
                        score: 7.5
                        reason: >-
                          The brief has a title and a summary but cites no
                          source.
                        checks:
                          - id: has_title
                            text: has a title
                            verdict: pass
                          - id: has_summary
                            text: has a summary
                            verdict: pass
                          - id: cites_source
                            text: cites a source
                            verdict: fail
                        executed_by:
                          type: User
                          id: f9630a31-1640-4f02-865b-3f92e4d99335
                    meta:
                      total_size: 1
                      next_page_token: null
              schema:
                type: object
                required:
                  - data
                  - meta
                additionalProperties: false
                properties:
                  data:
                    type: array
                    items:
                      type: object
                      required:
                        - execution_id
                        - executed_at
                        - deployment_version
                        - score
                        - reason
                        - checks
                        - executed_by
                      additionalProperties: false
                      properties:
                        execution_id:
                          type: string
                          format: uuid
                          example: 4f6d0d9a-7b78-4c6a-b64f-2e2e3d2c8f9a
                          description: >-
                            The graded execution's id, as the Automation's
                            executions endpoint lists it.
                        executed_at:
                          type: string
                          format: date-time
                          example: '2026-11-18T13:30:00Z'
                          description: When the execution ran.
                        deployment_version:
                          type: integer
                          minimum: 1
                          example: 2
                          description: >-
                            The deployment version the graded runs ran on: n in
                            the Evals tab's "Deployment #n", counting the
                            Automation's deployments from its first.
                        score:
                          type: number
                          minimum: 0
                          maximum: 10
                          example: 7.5
                          description: >-
                            The execution's score from 0 to 10 on the criterion:
                            the share of its checks that passed, times 10.
                        reason:
                          type: string
                          example: >-
                            The brief has a title and a summary but cites no
                            source.
                          nullable: true
                          description: >-
                            The judge's overall reason for the score. It can
                            quote the execution.
                        checks:
                          type: array
                          description: >-
                            The judge's verdict on each of the criterion's
                            checks.
                          items:
                            type: object
                            required:
                              - id
                              - text
                              - verdict
                            additionalProperties: false
                            properties:
                              id:
                                type: string
                                example: cites_source
                                description: The check's id within the criterion.
                              text:
                                type: string
                                example: cites a source
                                nullable: true
                                description: >-
                                  What the check asks, when the grader recorded
                                  it.
                              verdict:
                                type: string
                                enum:
                                  - pass
                                  - fail
                                  - insufficient_evidence
                                  - not_applicable
                                  - unverified
                                  - error
                                  - unknown
                                example: fail
                                description: >
                                  The judge's verdict on the check. Only `pass`
                                  and `fail` count toward the score:

                                  - `pass`: The run meets the check.

                                  - `fail`: The run does not meet the check.

                                  - `insufficient_evidence`: The trace did not
                                  show enough to judge.

                                  - `not_applicable`: The check does not apply
                                  to this run.

                                  - `unverified`: The judge could not verify its
                                  verdict.

                                  - `error`: The judge failed on this check.

                                  - `unknown`: A verdict the platform does not
                                  recognize.
                        executed_by:
                          type: object
                          required:
                            - type
                            - id
                          additionalProperties: false
                          properties:
                            type:
                              type: string
                              example: User
                              enum:
                                - User
                              x-crewai-enum-format: freeform
                            id:
                              type: string
                              format: uuid
                              example: 4f6d0d9a-7b78-4c6a-b64f-2e2e3d2c8f9a
                          nullable: true
                          description: >-
                            The identity the execution ran as. Null when it did
                            not run as a user.
                  meta:
                    type: object
                    required:
                      - total_size
                      - next_page_token
                    additionalProperties: false
                    properties:
                      total_size:
                        type: integer
                        minimum: 0
                        description: >-
                          Exact number of records in the filtered collection,
                          before `skip` and `page_size`.
                      next_page_token:
                        type: string
                        nullable: true
                        description: Token for the next page, or null on the last page.
        '400':
          description: Bad Request
          content:
            application/json:
              examples:
                bad_request:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/bad_request
                        code: bad_request
                        title: Bad request
                        status: 400
                        detail: criterion is required.
                  summary: No criterion
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
        '401':
          description: Unauthorized
          content:
            application/json:
              examples:
                unauthorized:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/unauthorized
                        code: unauthorized
                        title: Unauthorized
                        status: 401
                        detail: Missing or invalid bearer token.
                  summary: Missing or invalid bearer token
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
        '404':
          description: Not Found
          content:
            application/json:
              examples:
                not_found:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/not_found
                        code: not_found
                        title: Not found
                        status: 404
                        detail: >-
                          No criterion in this range has the key
                          "crew:no-such-criterion".
                  summary: A criterion the range has no chart for
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
        '422':
          description: Unprocessable Content
          content:
            application/json:
              examples:
                invalid_page_token:
                  value:
                    errors:
                      - type: >-
                          https://docs-platform.crewai.com/api/problems/validation_error
                        code: validation_error
                        title: Validation error
                        status: 422
                        detail: page_token is not valid.
                  summary: A page token this endpoint did not issue
              schema:
                $ref: '#/components/schemas/ErrorEnvelope'
components:
  schemas:
    ErrorEnvelope:
      type: object
      required:
        - errors
      additionalProperties: false
      properties:
        errors:
          type: array
          minItems: 1
          items:
            $ref: '#/components/schemas/Error'
    Error:
      type: object
      description: Public API error object.
      required:
        - type
        - code
        - title
        - status
        - detail
      additionalProperties: false
      properties:
        type:
          type: string
          format: uri
          enum:
            - https://docs-platform.crewai.com/api/problems/bad_request
            - https://docs-platform.crewai.com/api/problems/clipper_disabled
            - https://docs-platform.crewai.com/api/problems/clipper_disallowed
            - >-
              https://docs-platform.crewai.com/api/problems/clipper_feature_disabled
            - https://docs-platform.crewai.com/api/problems/clipper_not_found
            - https://docs-platform.crewai.com/api/problems/conflict
            - https://docs-platform.crewai.com/api/problems/content_too_large
            - https://docs-platform.crewai.com/api/problems/forbidden
            - https://docs-platform.crewai.com/api/problems/internal_error
            - https://docs-platform.crewai.com/api/problems/not_found
            - https://docs-platform.crewai.com/api/problems/service_unavailable
            - >-
              https://docs-platform.crewai.com/api/problems/tool_execution_failed
            - https://docs-platform.crewai.com/api/problems/unauthorized
            - https://docs-platform.crewai.com/api/problems/validation_error
          example: https://docs-platform.crewai.com/api/problems/bad_request
        code:
          type: string
          enum:
            - bad_request
            - clipper_disabled
            - clipper_disallowed
            - clipper_feature_disabled
            - clipper_not_found
            - conflict
            - content_too_large
            - forbidden
            - internal_error
            - not_found
            - service_unavailable
            - tool_execution_failed
            - unauthorized
            - validation_error
          example: bad_request
        title:
          type: string
          x-crewai-enum-format: freeform
          enum:
            - Bad request
            - Clipper resource disabled
            - Clipper resource disallowed
            - Clipper feature disabled
            - Clipper resource not found
            - Conflict
            - Content too large
            - Forbidden
            - Internal error
            - Not found
            - Service unavailable
            - Tool execution failed
            - Unauthorized
            - Validation error
          example: Bad request
        status:
          type: integer
          enum:
            - 400
            - 401
            - 403
            - 404
            - 409
            - 413
            - 422
            - 500
            - 503
          example: 400
        detail:
          type: string
          example: The request is invalid.
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      bearerFormat: opaque

````

This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.