Generation settings — Temperature, Top-P and Top-K

Created by S G, Modified on Fri, Sep 18 at 6:38 PM by S G

Available on I'm All In and True Supporter.

Temperature — how predictable or creative the AI is. Low values keep it consistent and on-track; high values make it more inventive, and at the extreme, incoherent.

Top-P — how wide a pool of likely words the AI picks from. Higher includes more possibilities.

Top-K — how many candidate words the AI considers for each choice.

How to tune them

Start from the defaults. Adjust Temperature and Top-P in small steps of 0.05–0.1 at a time, and try lowering before raising — most people find consistency serves a story better than wild creativity.

Two things that matter when testing:

Delete the erratic replies first. If you leave them in the conversation, the AI keeps using them as a reference and your new settings won't seem to have helped.

Re-send your prompt rather than regenerating. Regenerating rephrases the same underlying idea. Deleting and re-sending makes the AI generate something genuinely new, which is what you need to judge a settings change.

More detail: Generation Settings

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article