Config
Configuration types for controlling model behavior.Config
TheConfig function creates a Zod schema for parsing model configuration. All fields are optional and provider-specific.
Common Fields
number
Controls randomness.
0 is deterministic, higher values are more creative. Range: 0 to 2.number
Maximum number of tokens to generate.
number
Nucleus sampling threshold. Range:
0 to 1.number
Penalize tokens based on frequency. Range:
-2 to 2.number
Penalize tokens based on presence. Range:
-2 to 2.string[]
Stop sequences that halt generation.
number
Random seed for deterministic outputs (provider support varies).
Embedding Config
For embedding models, the config supports:string
The encoding format for embeddings. Common values:
"float", "base64".number
The number of dimensions for the output embeddings.