The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model...
Tested on 8 benchmarks with 29.1% average. Top scores: MMLU (81.7%), MATH level 5 (41.6%), Fiction.LiveBench (33.3%).
Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.
Deceptively simple questions that humans find easy but AI models often get wrong. Tests common sense and reasoning gaps.
Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.
Mock AIME (American Invitational Mathematics Exam) problems from OTIS. Tests mathematical competition performance.
- Typetext
- Context66K tokens (~33 books)
- ReleasedDec 2024
- LicenseOpen Source
- StatusActive
- Cost / Message~$0.000