Session

Overview

Fm::Session manages a conversation with the on-device model. It holds the conversation history and provides methods for generating responses, streaming, structured output, and transcript management.

Constructors

.new

Fm::Session.new(
  model : Fm::SystemLanguageModel,
  *,
  instructions : String? = nil,
  tools : Array(Fm::Tool)? = nil,
  adapters : Array(Fm::Adapter)? = nil
)

Creates a new session.

.from_transcript

Fm::Session.from_transcript(
  model : Fm::SystemLanguageModel,
  transcript_json : String,
  *,
  instructions : String? = nil,
  tools : Array(Fm::Tool)? = nil
) : Fm::Session

Restores a session from a previously exported transcript JSON string. You can optionally provide instructions and tools to configure the restored session.

Response Methods

#respond

session.respond(
  prompt : String,
  options : Fm::GenerationOptions = Fm::GenerationOptions.default
) : Fm::Response

Sends a prompt and returns the complete response. Blocks until generation is finished.

session.respond(
  prompt : String,
  options : Fm::GenerationOptions = Fm::GenerationOptions.default,
  *,
  timeout : Time::Span
) : Fm::Response

Overload with a timeout. Raises Fm::TimeoutError if the timeout is exceeded.

#stream

session.stream(
  prompt : String,
  options : Fm::GenerationOptions = Fm::GenerationOptions.default,
  &block : String ->
) : Nil

Sends a prompt and streams the response. The block receives each text chunk as it's generated.

#respond_json

session.respond_json(
  prompt : String,
  schema_json : String,
  options : Fm::GenerationOptions = Fm::GenerationOptions.default
) : String

Returns a JSON string conforming to the given schema.

#respond_structured

session.respond_structured(
  type : T.class,
  prompt : String,
  options : Fm::GenerationOptions = Fm::GenerationOptions.default
) : T forall T

Returns a deserialized instance of type T. The type must include both JSON::Serializable and Fm::Generable.

#stream_json

session.stream_json(
  prompt : String,
  schema_json : String,
  options : Fm::GenerationOptions = Fm::GenerationOptions.default,
  &block : String ->
) : Nil

Streams a JSON response matching the given schema. The block receives each chunk.

Session Control

#cancel

session.cancel : Nil

Cancels an ongoing generation (streaming or blocking).

#responding?

session.responding? : Bool

Returns true if the session is currently generating a response.

#prewarm

session.prewarm(prompt_prefix : String? = nil) : Nil

Prewarms the model with an optional prompt prefix. This can reduce latency for the next generation call.

Transcript

#transcript_json

session.transcript_json : String

Exports the full conversation history as a JSON string. Use this to save and later restore sessions with Session.from_transcript.

Response

Fm::Response

A struct wrapping the model's text output.

response = session.respond("Hello")
puts response.content
puts response.to_s  # Same as response.content