Skip to content
  • Models
  • Rankings
  • Ori
Sign Up
Sign Up
OpenRouterOpenRouter
© 2026 OpenRouter, Inc

Product

  • Chat
  • Rankings
  • Benchmarks
  • Apps
  • Discover
  • Models
  • Collections
  • Providers
  • Pricing
  • Business
  • Enterprise
  • Labs

Company

  • About
  • Blog
  • Careers
    Hiring
  • Privacy
  • Terms of Service
  • Trust Center
  • Support
  • Works With OR
  • Data
  • Brand

Developer

  • Documentation
  • API Reference
  • Developer Platform
  • Status

Connect

  • Discord
  • GitHub
  • LinkedIn
  • X
  • YouTube
Favicon for huggingfaceh4

Zephyr 141B-A35B

huggingfaceh4/zephyr-orpo-141b-a35b

Model weights

Zephyr 141B-A35B is A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters. Fine-tuned on a mix of publicly available, synthetic datasets.

It is an instruct finetune of Mixtral 8x22B.

#moe

Modalities

Context

66K

Released

Apr 12, 2024

Knowledge Cutoff

Jan 2024

ActivityFAQExplore

Activity

Token volume and request traffic to this model over time.

Explore more models

AI Model RankingsRanking

More models from Hugging Face H4

Zephyr 7B

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

Text4K context

Frequently asked questions

Zephyr 141B-A35B is A Mixture of Experts (MoE) model with 141B total parameters and 35B active parameters. Fine-tuned on a mix of publicly available, synthetic datasets. It is an instruct finetune of Mixtral 8x22B. #moe

Zephyr 141B-A35B has a 65,536 token context window.

Zephyr 141B-A35B was released on April 12, 2024. Its knowledge cutoff is January 31, 2024.