-
Notifications
You must be signed in to change notification settings - Fork 11.7k
Open
Labels
content:editRequest for content editsRequest for content editsdocumentationDocumentation editsDocumentation edits
Description
Existing documentation URL(s)
This page lists the following models as having json-mode support:
https://developers.cloudflare.com/workers-ai/features/json-mode/#supported-models
@cf/meta/llama-3.2-11b-vision-instruct@cf/meta/llama-3.1-8b-instruct-fast@cf/meta/llama-3.1-70b-instruct
However, the actual model page does not list response_format property in the input schema nor guided_json, which means they don't support JSON mode:
- https://developers.cloudflare.com/workers-ai/models/llama-3.2-11b-vision-instruct/#Input
- https://developers.cloudflare.com/workers-ai/models/llama-3.1-8b-instruct-fast/#Input
- https://developers.cloudflare.com/workers-ai/models/llama-3.1-70b-instruct/#Input
What changes are you suggesting?
According to my CF LLM API testing so far, the model page is correct (json mode is not supported by this model) and that means the json-mode document is wrong in that it falsely lists this model as supported.
Additional information
No response
Metadata
Metadata
Assignees
Labels
content:editRequest for content editsRequest for content editsdocumentationDocumentation editsDocumentation edits