Qwen text generation model. 479K downloads on HuggingFace.
Tested on 6 benchmarks with 20.8% average. Top scores: GSM8K (34.5%), HellaSwag (31.2%), MMLU (22.7%).
Code editing benchmark from the Aider project. Measures ability to apply targeted code changes while maintaining correctness and style.
Grade school math word problems. 8,500 problems testing multi-step arithmetic reasoning. A foundational math benchmark.
Sentence completion requiring commonsense reasoning about physical and social situations. Tests real-world understanding.
Massive Multitask Language Understanding. 57 subjects from STEM, humanities, and social sciences. The most widely-cited knowledge benchmark.
AI2 Reasoning Challenge. Grade-school science questions requiring multi-step reasoning. Easy and Challenge sets test different difficulty levels.
- Typetext-generation
- ContextN/A
- ReleasedNov 2024
- LicenseOpen Source
- StatusActive