Re: [w3ctag/design-reviews] Prompt API (Issue #1093)

reillyeon left a comment (w3ctag/design-reviews#1093)

The team is working on answering many of the points raised here but I want to comment specifically on the feedback on structured output:

This is a feature which deterministically guides the model towards producing an output which matches the specified structure. This feature interacts with the model's output before an output token is chosen and converted to text and so is tightly coupled with the inner processing loop of the model implementation. This is different from prompting the model with the suggestion of a particular output format. When constrained by this method the model is _incapable_ of producing an output which does not follow the prescribed pattern.

It's a fair concern that not all frameworks may support the JavaScript flavor of Regular Expressions and JSON Schemas. However the alternative of exposing to developers whatever constraint system is preferred by a framework seems worse for interoperability than specifying something familiar to web developers and choosing to implement these APIs with models and frameworks which support that.

-- 
Reply to this email directly or view it on GitHub:
https://github.com/w3ctag/design-reviews/issues/1093#issuecomment-3629651604
You are receiving this because you are subscribed to this thread.

Message ID: <w3ctag/design-reviews/issues/1093/3629651604@github.com>