Sending only the new part of a conversation (Effect's
ResponseIdTracker).
Providers with server-side conversation state take the previous response's
id and the messages after it. The tracker remembers which prompt messages
(by identity) were sent with which response; prepare_unsafe gives the
id and the messages after the last assistant message when every earlier
message was sent, and forgets everything otherwise.
Values#
| Attribute | Type | Description |
|---|---|---|
make | Effect[Service] |