Mistral 7B | Mistral AI | Frontier AI in your hands
2023年9月27日 · Mistral AI team is proud to release Mistral 7B, the most powerful language model for its size to date. Mistral 7B in short. Mistral 7B is a 7.3B parameter model that: Outperforms Llama 2 13B on all benchmarks; Outperforms Llama 1 34B on many benchmarks; Approaches CodeLlama 7B performance on code, while remaining good at English tasks
- [PDF]
Mistral 7B
compares the performance of Mistral 7B with Llama 2 7B/13B, and Llama 1 34B4 in different categories. Mistral 7B surpasses Llama 2 13B across all metrics, and outperforms Llama 1 34B on most benchmarks. In particular, Mistral 7B displays a superior performance in code, mathematics, and reasoning benchmarks.
Mistral AI | Frontier AI in your hands
We release open-weight models for everyone to customize and deploy where they want it. Our super-efficient model Mistral Nemo is available under Apache 2.0, while Mistral Large 2 is available through both a free non-commercial license, and a commercial license. Download them for deployment in your own environment
Models Overview | Mistral AI Large Language Models
Mistral 7B: ️ Apache2: ️: Our first dense model released September 2023. Learn more on our blog post: 32k: open-mistral-7b: v0.3: 2024/11/25: 2024/11/30: 2025/03/30: ministral-8b-latest: Mixtral 8x7B: ️ Apache2: ️: Our first sparse mixture-of-experts released December 2023. Learn more on our blog post: 32k: open-mixtral-8x7b: v0.1: 2024 ...
Technology | Mistral AI | Frontier AI in your hands
Mistral 7B. The first Mistral model, engineered for superior performance and efficiency. The model leverages grouped-query attention (GQA) for faster inference, coupled with sliding window attention (SWA) to effectively handle sequences of arbitrary length with a reduced inference cost.
La Plateforme | Mistral AI | Frontier AI in your hands
2023年12月11日 · Mistral-small. This endpoint currently serves our newest model, Mixtral 8x7B, described in more detail in our blog post . It masters English/French/Italian/German/Spanish and code and obtains 8.3 on MT-Bench.
Un Ministral, des Ministraux | Mistral AI | Frontier AI in your hands
2024年10月16日 · On the first anniversary of the release of Mistral 7B, the model that revolutionized independent frontier AI innovation for millions, we are proud to introduce two new state-of-the-art models for on-device computing and at-the-edge use cases. We call them les Ministraux: Ministral 3B and Ministral 8B.
Mixtral of experts | Mistral AI | Frontier AI in your hands
2023年12月11日 · We’re currently using Mixtral 8x7B behind our endpoint mistral-small, which is available in beta. Register to get early access to all generative and embedding endpoints. Acknowledgement. We thank CoreWeave and Scaleway teams for technical support as we trained our models.
MathΣtral | Mistral AI | Frontier AI in your hands
2024年7月16日 · Mathstral can achieve significantly better results with more inference-time computation: Mathstral 7B scores 68.37% on MATH with majority voting and 74.59% with a strong reward model among 64 candidates.
Bringing open AI models to the frontier - Mistral
2023年9月27日 · Mistral 7B is only a first step toward building the frontier models on our roadmap. Yet, it can be used to solve many tasks: summarisation, structuration and question answering to name a few. It processes and generates text much faster than large proprietary solutions, and runs at a fraction of their costs.