Stheno 8B 32K is a creative writing/roleplay model from Sao10kOpens in new tab. It was trained at 8K context, then expanded to 32K context.
Compared to older Stheno version, this model is trained on:
Modalities
Context
32K
Released
Jun 27, 2024
Knowledge Cutoff
Dec 2023
Token volume and request traffic to this model over time.
Stheno 8B 32K is a creative writing/roleplay model from Sao10k. It was trained at 8K context, then expanded to 32K context. Compared to older Stheno version, this model is trained on: - 2x the amount of creative writing samples - Cleaned up roleplaying samples - Fewer low quality samples
Llama 3 Stheno 8B v3.3 32K has a 32,000 token context window.
Llama 3.3 Euryale 70B, Llama 3.1 Euryale 70B v2.2 and Llama 3 8B Lunaris are other text models from Sao10K.
Llama 3 Stheno 8B v3.3 32K was released on June 27, 2024. Its knowledge cutoff is December 31, 2023.