Skip to content

Workers AI "json-mode" page falsely lists some models? #27786

@ericsampson

Description

@ericsampson

Existing documentation URL(s)

This page lists the following models as having json-mode support:
https://developers.cloudflare.com/workers-ai/features/json-mode/#supported-models

  • @cf/meta/llama-3.2-11b-vision-instruct
  • @cf/meta/llama-3.1-8b-instruct-fast
  • @cf/meta/llama-3.1-70b-instruct

However, the actual model page does not list response_format property in the input schema nor guided_json, which means they don't support JSON mode:

What changes are you suggesting?

According to my CF LLM API testing so far, the model page is correct (json mode is not supported by this model) and that means the json-mode document is wrong in that it falsely lists this model as supported.

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions