Skip to content
Snippets Groups Projects
Commit d48f1d17 authored by jbreton's avatar jbreton
Browse files

Mixtral results

parent bb2aa2c5
No related branches found
No related tags found
No related merge requests found
...@@ -27,7 +27,7 @@ generate_text = transformers.pipeline( ...@@ -27,7 +27,7 @@ generate_text = transformers.pipeline(
temperature=0.5, # 'randomness' of outputs, 0.0 is the min and 1.0 the max temperature=0.5, # 'randomness' of outputs, 0.0 is the min and 1.0 the max
top_p=0.15, # select from top tokens whose probability add up to 15% top_p=0.15, # select from top tokens whose probability add up to 15%
top_k=0, # select from top 0 tokens (because zero, relies on top_p) top_k=0, # select from top 0 tokens (because zero, relies on top_p)
max_new_tokens=4096, # max number of tokens to generate in the output max_new_tokens=2048, # max number of tokens to generate in the output
repetition_penalty=1.0 # if output begins repeating increase repetition_penalty=1.0 # if output begins repeating increase
) )
......
This diff is collapsed.
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment