1️⃣ Max tokens
☞ The upper limit on the number of tokens that the model can generate.
☞ Example: max = 15 (token count)
☞ Value range: from 1 to infinity
2️⃣ Temperature
☞ Controls the randomness in the response. The higher the temperature, the more creative and diverse the output will be.
☞ Value range: from 0 to 2 (typical range)
☞ Graph labels: Regular Distribution / Temperature-adjusted Distribution
3️⃣ Top_p
☞ Controls which part of the probability distribution is taken into account when sampling tokens.
☞ Example: top_p = 10%
☞ Value range: from 0 to 1
4️⃣ Top_k
☞ Limits the number of the most likely tokens from which the selection is made.
☞ Example: top_k = 2
☞ Value range: from 1 to vocab_size
5️⃣ Frequency penalty
☞ Punishes the repetition of tokens by frequency. Positive values reduce repetitions.
☞ Value range: from -2 to 2
6️⃣ Presence penalty
☞ Encourages the model to use new tokens that have not yet been used in the generation.
☞ Value range: from -2 to 2
7️⃣ Stop
☞ A list of tokens at which the model stops further generation.
☞ Value range: custom list
••••••••••••••••••••••••••••••••••••••••••••••
🤖 Data & ML | @DataXplore