GitHub

response_id_tracker

API reference for response_id_tracker.

Sending only the new part of a conversation (Effect's ResponseIdTracker).

Providers with server-side conversation state take the previous response's id and the messages after it. The tracker remembers which prompt messages (by identity) were sent with which response; prepare_unsafe gives the id and the messages after the last assistant message when every earlier message was sent, and forgets everything otherwise.

Values

AttributeTypeDescription
makeEffect[Service]

Classes