Support/Chatting & How the AI Works

Generation settings — Temperature, Top-P and Top-K

Created by S G, Modified on Fri, Sep 18 at 6:38 PM by S G

Available on I'm All In and True Supporter.

Temperature — how predictable or creative the AI is. Low values keep it consistent and on-track; high values make it more inventive, and at the extreme, incoherent.

Top-P — how wide a pool of likely words the AI picks from. Higher includes more possibilities.

Top-K — how many candidate words the AI considers for each choice.

How to tune them

Start from the defaults. Adjust Temperature and Top-P in small steps of 0.05–0.1 at a time, and try lowering before raising — most people find consistency serves a story better than wild creativity.

Two things that matter when testing:

Delete the erratic replies first. If you leave them in the conversation, the AI keeps using them as a reference and your new settings won't seem to have helped.

Re-send your prompt rather than regenerating. Regenerating rephrases the same underlying idea. Deleting and re-sending makes the AI generate something genuinely new, which is what you need to judge a settings change.

More detail: Generation Settings