Skip to main content

Parameters Guide

Fine-tune model behavior with parameters.

temperature (0.0-2.0)

Controls randomness:

  • 0.0 - Deterministic, focused
  • 0.7 - Balanced (default)
  • 1.5 - Creative, varied
{"temperature": 0.7}

max_tokens

Maximum tokens to generate:

{"max_tokens": 1000}

top_p (0.0-1.0)

Nucleus sampling:

  • 0.1 - Very focused
  • 1.0 - Full diversity (default)
{"top_p": 0.9}

Best Practices

Use Casetemperaturetop_pmax_tokens
Code0.20.12000
Facts0.30.5500
Creative1.00.92000
Chat0.71.01000