{"test":"tokenizer-tax","license":"CC BY 4.0 · https://creativecommons.org/licenses/by/4.0/","attribution":"BenchGecko Gecko Tests · https://benchgecko.ai/gecko-tests/tokenizer-tax","items":[{"item_id":"de","prompt":"Jeden Morgen öffnet die kleine Bibliothek an der Ecke ihre Türen noch vor der Bäckerei nebenan. Zuerst kommen die Studenten und suchen ruhige Tische am Fenster, danach folgen pensionierte Nachbarn, die die Zeitungen lesen und sich sanft über das Wetter streiten. Gegen Mittag ist der Raum erfüllt von Gesprächen, die im Flüsterton geführt werden. Die Bibliothekarin kennt die meisten Besucher mit Namen und weiß noch, welche Bücher sie im letzten Monat ausgeliehen haben. Als die Stadt vorschlug, das Gebäude zu schließen, um Geld zu sparen, unterschrieben Hunderte von Menschen einen Brief, in dem sie erklärten, was dieser Ort für sie bedeutet. Der Stadtrat hörte zu, und die Bibliothek blieb geöffnet, mit längeren Öffnungszeiten am Wochenende und einem neuen Regal mit Büchern in anderen Sprachen.","answer":null,"meta":{"lang":"de","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"en","prompt":"Every morning the small library on the corner opens its doors before the bakery next to it. Students arrive first, looking for quiet tables near the windows, followed by retired neighbours who read the newspapers and argue gently about the weather. By noon the room is full of conversations kept to a whisper. The librarian knows most visitors by name and remembers which books they borrowed last month. When the city proposed closing the building to save money, hundreds of people signed a letter explaining what the place meant to them. The council listened, and the library stayed open, with longer hours on weekends and a new shelf of books in other languages.","answer":null,"meta":{"lang":"en","words":113,"source":"original"},"version":"v1"},{"item_id":"es","prompt":"Cada mañana, la pequeña biblioteca de la esquina abre sus puertas antes que la panadería de al lado. Los estudiantes llegan primero, en busca de mesas tranquilas junto a las ventanas, seguidos de los vecinos jubilados, que leen los periódicos y discuten con suavidad sobre el tiempo. Hacia el mediodía, la sala está llena de conversaciones que se mantienen en un susurro. La bibliotecaria conoce por su nombre a la mayoría de los visitantes y recuerda qué libros se llevaron prestados el mes anterior. Cuando el ayuntamiento propuso cerrar el edificio para ahorrar dinero, cientos de personas firmaron una carta en la que explicaban lo que significaba ese lugar para ellas. El consejo municipal escuchó, y la biblioteca siguió abierta, con horarios más amplios los fines de semana y una nueva estantería de libros en otros idiomas.","answer":null,"meta":{"lang":"es","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"fr","prompt":"Chaque matin, la petite bibliothèque du coin ouvre ses portes avant la boulangerie voisine. Les étudiants arrivent les premiers, à la recherche de tables calmes près des fenêtres, suivis des voisins retraités qui lisent les journaux et se disputent gentiment à propos de la météo. À midi, la salle est remplie de conversations tenues à voix basse. La bibliothécaire connaît la plupart des visiteurs par leur nom et se souvient des livres qu'ils ont empruntés le mois dernier. Lorsque la ville a proposé de fermer le bâtiment pour faire des économies, des centaines de personnes ont signé une lettre expliquant ce que ce lieu représentait pour elles. Le conseil municipal les a écoutées, et la bibliothèque est restée ouverte, avec des horaires plus longs le week-end et un nouveau rayon de livres en langues étrangères.","answer":null,"meta":{"lang":"fr","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"it","prompt":"Ogni mattina la piccola biblioteca all'angolo apre le sue porte prima del forno accanto. Arrivano per primi gli studenti, in cerca di tavoli tranquilli vicino alle finestre, seguiti dai vicini in pensione che leggono i giornali e discutono pacatamente del tempo. A mezzogiorno la sala è piena di conversazioni sussurrate. La bibliotecaria conosce per nome la maggior parte dei visitatori e ricorda quali libri hanno preso in prestito il mese scorso. Quando il comune propose di chiudere l'edificio per risparmiare, centinaia di persone firmarono una lettera per spiegare che cosa quel luogo significasse per loro. Il consiglio comunale ascoltò e la biblioteca rimase aperta, con orari più lunghi nei fine settimana e un nuovo scaffale di libri in altre lingue.","answer":null,"meta":{"lang":"it","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"ja","prompt":"毎朝、角にある小さな図書館は、隣のパン屋よりも早く扉を開ける。最初に訪れるのは学生たちで、窓際の静かな席を探している。続いて、年金暮らしの近所の人たちがやって来て、新聞を読みながら、天気のことで穏やかに言い合いをする。正午までには、室内はささやき声に抑えられた会話でいっぱいになる。司書はほとんどの利用者の名前を知っていて、先月どんな本を借りたかも覚えている。市が経費削減のために建物を閉鎖することを提案したとき、何百人もの人々が、この場所が自分たちにとってどんな意味を持つのかを綴った手紙に署名した。市議会はその声に耳を傾け、図書館は存続することになり、週末の開館時間が延長され、外国語の本の新しい棚も設けられた。","answer":null,"meta":{"lang":"ja","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"ko","prompt":"매일 아침 길모퉁이의 작은 도서관은 옆에 있는 빵집보다 먼저 문을 엽니다. 가장 먼저 학생들이 창가 근처의 조용한 자리를 찾아 들어오고, 뒤이어 은퇴한 이웃들이 신문을 읽으며 날씨를 두고 가볍게 언쟁을 벌입니다. 정오가 되면 실내는 속삭임으로 이어지는 대화들로 가득 찹니다. 사서는 대부분의 방문객을 이름으로 알고 있고, 그들이 지난달에 어떤 책을 빌렸는지도 기억합니다. 시에서 예산을 아끼기 위해 건물을 폐쇄하자고 제안하자, 수백 명의 사람들이 이 장소가 자신들에게 어떤 의미인지 설명하는 편지에 서명했습니다. 시의회는 그 목소리에 귀를 기울였고, 도서관은 계속 문을 열게 되었으며, 주말 운영 시간이 늘어나고 외국어 도서 코너도 새로 생겼습니다.","answer":null,"meta":{"lang":"ko","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"pt","prompt":"Todas as manhãs, a pequena biblioteca da esquina abre as portas antes da padaria ao lado. Os estudantes chegam primeiro, em busca de mesas silenciosas perto das janelas, seguidos pelos vizinhos aposentados, que leem os jornais e discutem calmamente sobre o tempo. Ao meio-dia, a sala está cheia de conversas mantidas em sussurros. A bibliotecária conhece a maioria dos frequentadores pelo nome e se lembra de quais livros eles pegaram emprestados no mês anterior. Quando a prefeitura propôs fechar o prédio para economizar dinheiro, centenas de pessoas assinaram uma carta explicando o que aquele lugar significava para elas. A câmara municipal ouviu, e a biblioteca continuou aberta, com horário estendido nos fins de semana e uma nova estante de livros em outros idiomas.","answer":null,"meta":{"lang":"pt","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"},{"item_id":"zh","prompt":"每天早晨，街角的小图书馆总是比隔壁的面包店先开门。最先到的是学生，他们在靠窗的位置寻找安静的桌子；随后是退休的街坊邻居，他们看看报纸，轻声细语地为天气争论几句。到了中午，整个房间里满是压低到耳语般的交谈声。馆员认得大多数读者的名字，还记得他们上个月借过哪些书。当市政府提出为节省开支而关闭这座建筑时，数百人联名签署了一封信，诉说这个地方对他们的意义。市议会听取了他们的意见，图书馆得以继续开放，周末的开放时间还延长了，并新增了一个外文书籍书架。","answer":null,"meta":{"lang":"zh","source":"anthropic/claude-sonnet-5.5 translation, frozen in v1"},"version":"v1"}],"runs":[{"id":2,"test":"tokenizer-tax","version":"v1","model_id":"openai/gpt-6-luna","model_slug":"gpt-6-luna","model_name":"GPT-6 Luna","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":56.1,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.42,"fr":1.39,"it":1.52,"ja":2.14,"ko":1.78,"pt":1.37,"zh":1.45},"tokens":{"de":176,"en":124,"es":176,"fr":172,"it":188,"ja":265,"ko":221,"pt":170,"zh":180},"priceInPerM":0.09999999999999999,"usdPer1kWords":{"de":0.00016,"en":0.00011,"es":0.00016,"fr":0.00015,"it":0.00017,"ja":0.00023,"ko":0.0002,"pt":0.00015,"zh":0.00016},"baselineTokens":7},"cost_usd":0.00025,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"176","correct":null},{"item_id":"fr","raw":"","parsed":"172","correct":null},{"item_id":"it","raw":"","parsed":"188","correct":null},{"item_id":"ja","raw":"","parsed":"265","correct":null},{"item_id":"ko","raw":"","parsed":"221","correct":null},{"item_id":"pt","raw":"","parsed":"170","correct":null},{"item_id":"zh","raw":"","parsed":"180","correct":null}]},{"id":57,"test":"tokenizer-tax","version":"v1","model_id":"openai/gpt-6-luna-pro","model_slug":"gpt-6-luna-pro","model_name":"GPT-6 Luna Pro","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":56.5,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.42,"fr":1.39,"it":1.52,"ja":2.14,"ko":1.79,"pt":1.38,"zh":1.46},"tokens":{"de":524,"en":370,"es":526,"fr":515,"it":562,"ja":793,"ko":662,"pt":509,"zh":539},"priceInPerM":0.1,"usdPer1kWords":{"de":0.00046,"en":0.00033,"es":0.00047,"fr":0.00046,"it":0.0005,"ja":0.0007,"ko":0.00059,"pt":0.00045,"zh":0.00048},"baselineTokens":1406},"cost_usd":0.00219,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"524","correct":null},{"item_id":"en","raw":"","parsed":"370","correct":null},{"item_id":"es","raw":"","parsed":"526","correct":null},{"item_id":"fr","raw":"","parsed":"515","correct":null},{"item_id":"it","raw":"","parsed":"562","correct":null},{"item_id":"ja","raw":"","parsed":"793","correct":null},{"item_id":"ko","raw":"","parsed":"662","correct":null},{"item_id":"pt","raw":"","parsed":"509","correct":null},{"item_id":"zh","raw":"","parsed":"539","correct":null}]},{"id":58,"test":"tokenizer-tax","version":"v1","model_id":"openai/gpt-6-sol","model_slug":"gpt-6-sol","model_name":"GPT-6 Sol","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":53.3,"metrics":{"ratios":{"de":1.4,"en":1,"es":1.4,"fr":1.37,"it":1.49,"ja":2.08,"ko":1.74,"pt":1.35,"zh":1.43},"tokens":{"de":183,"en":131,"es":183,"fr":179,"it":195,"ja":272,"ko":228,"pt":177,"zh":187},"priceInPerM":2,"usdPer1kWords":{"de":0.00324,"en":0.00232,"es":0.00324,"fr":0.00317,"it":0.00345,"ja":0.00481,"ko":0.00404,"pt":0.00313,"zh":0.00331},"baselineTokens":0},"cost_usd":0.00489,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"183","correct":null},{"item_id":"en","raw":"","parsed":"131","correct":null},{"item_id":"es","raw":"","parsed":"183","correct":null},{"item_id":"fr","raw":"","parsed":"179","correct":null},{"item_id":"it","raw":"","parsed":"195","correct":null},{"item_id":"ja","raw":"","parsed":"272","correct":null},{"item_id":"ko","raw":"","parsed":"228","correct":null},{"item_id":"pt","raw":"","parsed":"177","correct":null},{"item_id":"zh","raw":"","parsed":"187","correct":null}]},{"id":59,"test":"tokenizer-tax","version":"v1","model_id":"anthropic/claude-sonnet-5.5","model_slug":"claude-sonnet-5-5","model_name":"Claude Sonnet 5.5","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":72.6,"metrics":{"ratios":{"de":2.04,"en":1,"es":1.76,"fr":1.69,"it":1.66,"ja":1.58,"ko":2.11,"pt":1.67,"zh":1.3},"tokens":{"de":382,"en":187,"es":330,"fr":316,"it":310,"ja":296,"ko":395,"pt":313,"zh":243},"priceInPerM":2,"usdPer1kWords":{"de":0.00676,"en":0.00331,"es":0.00584,"fr":0.00559,"it":0.00549,"ja":0.00524,"ko":0.00699,"pt":0.00554,"zh":0.0043},"baselineTokens":9},"cost_usd":0.00731,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"382","correct":null},{"item_id":"en","raw":"","parsed":"187","correct":null},{"item_id":"es","raw":"","parsed":"330","correct":null},{"item_id":"fr","raw":"","parsed":"316","correct":null},{"item_id":"it","raw":"","parsed":"310","correct":null},{"item_id":"ja","raw":"","parsed":"296","correct":null},{"item_id":"ko","raw":"","parsed":"395","correct":null},{"item_id":"pt","raw":"","parsed":"313","correct":null},{"item_id":"zh","raw":"","parsed":"243","correct":null}]},{"id":60,"test":"tokenizer-tax","version":"v1","model_id":"anthropic/claude-opus-5.5","model_slug":"claude-opus-5-5","model_name":"Claude Opus 5.5","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":72.6,"metrics":{"ratios":{"de":2.04,"en":1,"es":1.76,"fr":1.69,"it":1.66,"ja":1.58,"ko":2.11,"pt":1.67,"zh":1.3},"tokens":{"de":382,"en":187,"es":330,"fr":316,"it":310,"ja":296,"ko":395,"pt":313,"zh":243},"priceInPerM":4,"usdPer1kWords":{"de":0.01352,"en":0.00662,"es":0.01168,"fr":0.01119,"it":0.01097,"ja":0.01048,"ko":0.01398,"pt":0.01108,"zh":0.0086},"baselineTokens":9},"cost_usd":0.01461,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"382","correct":null},{"item_id":"en","raw":"","parsed":"187","correct":null},{"item_id":"es","raw":"","parsed":"330","correct":null},{"item_id":"fr","raw":"","parsed":"316","correct":null},{"item_id":"it","raw":"","parsed":"310","correct":null},{"item_id":"ja","raw":"","parsed":"296","correct":null},{"item_id":"ko","raw":"","parsed":"395","correct":null},{"item_id":"pt","raw":"","parsed":"313","correct":null},{"item_id":"zh","raw":"","parsed":"243","correct":null}]},{"id":61,"test":"tokenizer-tax","version":"v1","model_id":"anthropic/claude-fable-5.1","model_slug":"claude-fable-5-1","model_name":"Claude Fable 5.1","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":72.6,"metrics":{"ratios":{"de":2.04,"en":1,"es":1.76,"fr":1.69,"it":1.66,"ja":1.58,"ko":2.11,"pt":1.67,"zh":1.3},"tokens":{"de":382,"en":187,"es":330,"fr":316,"it":310,"ja":296,"ko":395,"pt":313,"zh":243},"priceInPerM":10,"usdPer1kWords":{"de":0.03381,"en":0.01655,"es":0.0292,"fr":0.02796,"it":0.02743,"ja":0.02619,"ko":0.03496,"pt":0.0277,"zh":0.0215},"baselineTokens":9},"cost_usd":0.03653,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"382","correct":null},{"item_id":"en","raw":"","parsed":"187","correct":null},{"item_id":"es","raw":"","parsed":"330","correct":null},{"item_id":"fr","raw":"","parsed":"316","correct":null},{"item_id":"it","raw":"","parsed":"310","correct":null},{"item_id":"ja","raw":"","parsed":"296","correct":null},{"item_id":"ko","raw":"","parsed":"395","correct":null},{"item_id":"pt","raw":"","parsed":"313","correct":null},{"item_id":"zh","raw":"","parsed":"243","correct":null}]},{"id":62,"test":"tokenizer-tax","version":"v1","model_id":"anthropic/claude-opus-5","model_slug":"claude-opus-5","model_name":"Claude Opus 5","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":72.6,"metrics":{"ratios":{"de":2.04,"en":1,"es":1.76,"fr":1.69,"it":1.66,"ja":1.58,"ko":2.11,"pt":1.67,"zh":1.3},"tokens":{"de":382,"en":187,"es":330,"fr":316,"it":310,"ja":296,"ko":395,"pt":313,"zh":243},"priceInPerM":5,"usdPer1kWords":{"de":0.0169,"en":0.00827,"es":0.0146,"fr":0.01398,"it":0.01372,"ja":0.0131,"ko":0.01748,"pt":0.01385,"zh":0.01075},"baselineTokens":7},"cost_usd":0.01817,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"382","correct":null},{"item_id":"en","raw":"","parsed":"187","correct":null},{"item_id":"es","raw":"","parsed":"330","correct":null},{"item_id":"fr","raw":"","parsed":"316","correct":null},{"item_id":"it","raw":"","parsed":"310","correct":null},{"item_id":"ja","raw":"","parsed":"296","correct":null},{"item_id":"ko","raw":"","parsed":"395","correct":null},{"item_id":"pt","raw":"","parsed":"313","correct":null},{"item_id":"zh","raw":"","parsed":"243","correct":null}]},{"id":63,"test":"tokenizer-tax","version":"v1","model_id":"anthropic/claude-opus-5-fast","model_slug":"claude-opus-5-fast","model_name":"Claude Opus 5 (Fast)","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":72.6,"metrics":{"ratios":{"de":2.04,"en":1,"es":1.76,"fr":1.69,"it":1.66,"ja":1.58,"ko":2.11,"pt":1.67,"zh":1.3},"tokens":{"de":382,"en":187,"es":330,"fr":316,"it":310,"ja":296,"ko":395,"pt":313,"zh":243},"priceInPerM":10,"usdPer1kWords":{"de":0.03381,"en":0.01655,"es":0.0292,"fr":0.02796,"it":0.02743,"ja":0.02619,"ko":0.03496,"pt":0.0277,"zh":0.0215},"baselineTokens":7},"cost_usd":0.03633,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"382","correct":null},{"item_id":"en","raw":"","parsed":"187","correct":null},{"item_id":"es","raw":"","parsed":"330","correct":null},{"item_id":"fr","raw":"","parsed":"316","correct":null},{"item_id":"it","raw":"","parsed":"310","correct":null},{"item_id":"ja","raw":"","parsed":"296","correct":null},{"item_id":"ko","raw":"","parsed":"395","correct":null},{"item_id":"pt","raw":"","parsed":"313","correct":null},{"item_id":"zh","raw":"","parsed":"243","correct":null}]},{"id":64,"test":"tokenizer-tax","version":"v1","model_id":"qwen/qwen3.8-max-prime","model_slug":"qwen3-8-max-prime","model_name":"Qwen3.8 Max Prime","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":35.4,"metrics":{"ratios":{"de":1.4,"en":1,"es":1.45,"fr":1.42,"it":1.27,"ja":1.44,"ko":1.41,"pt":1.41,"zh":1.03},"tokens":{"de":173,"en":124,"es":180,"fr":176,"it":157,"ja":178,"ko":175,"pt":175,"zh":128},"priceInPerM":4,"usdPer1kWords":{"de":0.00612,"en":0.00439,"es":0.00637,"fr":0.00623,"it":0.00556,"ja":0.0063,"ko":0.00619,"pt":0.00619,"zh":0.00453},"baselineTokens":50},"cost_usd":0.00975,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"173","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"180","correct":null},{"item_id":"fr","raw":"","parsed":"176","correct":null},{"item_id":"it","raw":"","parsed":"157","correct":null},{"item_id":"ja","raw":"","parsed":"178","correct":null},{"item_id":"ko","raw":"","parsed":"175","correct":null},{"item_id":"pt","raw":"","parsed":"175","correct":null},{"item_id":"zh","raw":"","parsed":"128","correct":null}]},{"id":65,"test":"tokenizer-tax","version":"v1","model_id":"qwen/qwen3.8-max-0902","model_slug":"qwen3-8-max-0902","model_name":"Qwen3.8 Max (0902)","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":35.4,"metrics":{"ratios":{"de":1.4,"en":1,"es":1.45,"fr":1.42,"it":1.27,"ja":1.44,"ko":1.41,"pt":1.41,"zh":1.03},"tokens":{"de":173,"en":124,"es":180,"fr":176,"it":157,"ja":178,"ko":175,"pt":175,"zh":128},"priceInPerM":2,"usdPer1kWords":{"de":0.00306,"en":0.00219,"es":0.00319,"fr":0.00312,"it":0.00278,"ja":0.00315,"ko":0.0031,"pt":0.0031,"zh":0.00227},"baselineTokens":50},"cost_usd":0.00487,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"173","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"180","correct":null},{"item_id":"fr","raw":"","parsed":"176","correct":null},{"item_id":"it","raw":"","parsed":"157","correct":null},{"item_id":"ja","raw":"","parsed":"178","correct":null},{"item_id":"ko","raw":"","parsed":"175","correct":null},{"item_id":"pt","raw":"","parsed":"175","correct":null},{"item_id":"zh","raw":"","parsed":"128","correct":null}]},{"id":66,"test":"tokenizer-tax","version":"v1","model_id":"qwen/qwen3.8-flash","model_slug":"qwen3-8-flash","model_name":"Qwen3.8 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":35.4,"metrics":{"ratios":{"de":1.4,"en":1,"es":1.45,"fr":1.42,"it":1.27,"ja":1.44,"ko":1.41,"pt":1.41,"zh":1.03},"tokens":{"de":173,"en":124,"es":180,"fr":176,"it":157,"ja":178,"ko":175,"pt":175,"zh":128},"priceInPerM":0.15,"usdPer1kWords":{"de":0.00023,"en":0.00016,"es":0.00024,"fr":0.00023,"it":0.00021,"ja":0.00024,"ko":0.00023,"pt":0.00023,"zh":0.00017},"baselineTokens":62},"cost_usd":0.00039,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"173","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"180","correct":null},{"item_id":"fr","raw":"","parsed":"176","correct":null},{"item_id":"it","raw":"","parsed":"157","correct":null},{"item_id":"ja","raw":"","parsed":"178","correct":null},{"item_id":"ko","raw":"","parsed":"175","correct":null},{"item_id":"pt","raw":"","parsed":"175","correct":null},{"item_id":"zh","raw":"","parsed":"128","correct":null}]},{"id":67,"test":"tokenizer-tax","version":"v1","model_id":"qwen/qwen3.8-27b","model_slug":"qwen3-8-27b","model_name":"Qwen3.8 27B","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":40.5,"metrics":{"ratios":{"de":1.4,"en":1,"es":1.45,"fr":1.42,"it":1.27,"ja":1.85,"ko":1.41,"pt":1.41,"zh":1.03},"tokens":{"de":173,"en":124,"es":180,"fr":176,"it":157,"ja":230,"ko":175,"pt":175,"zh":128},"priceInPerM":0.425,"usdPer1kWords":{"de":0.00065,"en":0.00047,"es":0.00068,"fr":0.00066,"it":0.00059,"ja":0.00087,"ko":0.00066,"pt":0.00066,"zh":0.00048},"baselineTokens":41},"cost_usd":0.00063,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"173","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"180","correct":null},{"item_id":"fr","raw":"","parsed":"176","correct":null},{"item_id":"it","raw":"","parsed":"157","correct":null},{"item_id":"ja","raw":"","parsed":"230","correct":null},{"item_id":"ko","raw":"","parsed":"175","correct":null},{"item_id":"pt","raw":"","parsed":"175","correct":null},{"item_id":"zh","raw":"","parsed":"128","correct":null}]},{"id":68,"test":"tokenizer-tax","version":"v1","model_id":"qwen/qwen3.8-2.4t-a95b","model_slug":"qwen3-8-2-4t-a95b","model_name":"Qwen3.8 2.4T A95B","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":38.9,"metrics":{"ratios":{"de":1.47,"en":1,"es":1.52,"fr":1.49,"it":1.27,"ja":1.44,"ko":1.41,"pt":1.41,"zh":1.1},"tokens":{"de":182,"en":124,"es":189,"fr":185,"it":157,"ja":178,"ko":175,"pt":175,"zh":137},"priceInPerM":2,"usdPer1kWords":{"de":0.00322,"en":0.00219,"es":0.00335,"fr":0.00327,"it":0.00278,"ja":0.00315,"ko":0.0031,"pt":0.0031,"zh":0.00242},"baselineTokens":41},"cost_usd":0.00477,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"182","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"189","correct":null},{"item_id":"fr","raw":"","parsed":"185","correct":null},{"item_id":"it","raw":"","parsed":"157","correct":null},{"item_id":"ja","raw":"","parsed":"178","correct":null},{"item_id":"ko","raw":"","parsed":"175","correct":null},{"item_id":"pt","raw":"","parsed":"175","correct":null},{"item_id":"zh","raw":"","parsed":"137","correct":null}]},{"id":69,"test":"tokenizer-tax","version":"v1","model_id":"z-ai/glm-5.3-prime","model_slug":"glm-5-3-prime","model_name":"GLM 5.3 Prime","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":69.6,"metrics":{"ratios":{"de":1.6,"en":1,"es":1.64,"fr":1.67,"it":1.6,"ja":1.89,"ko":2.4,"pt":1.68,"zh":1.09},"tokens":{"de":198,"en":124,"es":203,"fr":207,"it":198,"ja":234,"ko":297,"pt":208,"zh":135},"priceInPerM":2.8,"usdPer1kWords":{"de":0.00491,"en":0.00307,"es":0.00503,"fr":0.00513,"it":0.00491,"ja":0.0058,"ko":0.00736,"pt":0.00515,"zh":0.00335},"baselineTokens":13},"cost_usd":0.0068,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"198","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"203","correct":null},{"item_id":"fr","raw":"","parsed":"207","correct":null},{"item_id":"it","raw":"","parsed":"198","correct":null},{"item_id":"ja","raw":"","parsed":"234","correct":null},{"item_id":"ko","raw":"","parsed":"297","correct":null},{"item_id":"pt","raw":"","parsed":"208","correct":null},{"item_id":"zh","raw":"","parsed":"135","correct":null}]},{"id":70,"test":"tokenizer-tax","version":"v1","model_id":"z-ai/glm-5.3-flashx","model_slug":"glm-5-3-flashx","model_name":"GLM 5.3 FlashX","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":69.6,"metrics":{"ratios":{"de":1.6,"en":1,"es":1.64,"fr":1.67,"it":1.6,"ja":1.89,"ko":2.4,"pt":1.68,"zh":1.09},"tokens":{"de":198,"en":124,"es":203,"fr":207,"it":198,"ja":234,"ko":297,"pt":208,"zh":135},"priceInPerM":0.37,"usdPer1kWords":{"de":0.00065,"en":0.00041,"es":0.00066,"fr":0.00068,"it":0.00065,"ja":0.00077,"ko":0.00097,"pt":0.00068,"zh":0.00044},"baselineTokens":13},"cost_usd":0.00091,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"198","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"203","correct":null},{"item_id":"fr","raw":"","parsed":"207","correct":null},{"item_id":"it","raw":"","parsed":"198","correct":null},{"item_id":"ja","raw":"","parsed":"234","correct":null},{"item_id":"ko","raw":"","parsed":"297","correct":null},{"item_id":"pt","raw":"","parsed":"208","correct":null},{"item_id":"zh","raw":"","parsed":"135","correct":null}]},{"id":71,"test":"tokenizer-tax","version":"v1","model_id":"z-ai/glm-5.3-flash","model_slug":"glm-5-3-flash","model_name":"GLM 5.3 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":69.6,"metrics":{"ratios":{"de":1.6,"en":1,"es":1.64,"fr":1.67,"it":1.6,"ja":1.89,"ko":2.4,"pt":1.68,"zh":1.09},"tokens":{"de":198,"en":124,"es":203,"fr":207,"it":198,"ja":234,"ko":297,"pt":208,"zh":135},"priceInPerM":0.15,"usdPer1kWords":{"de":0.00026,"en":0.00016,"es":0.00027,"fr":0.00027,"it":0.00026,"ja":0.00031,"ko":0.00039,"pt":0.00028,"zh":0.00018},"baselineTokens":13},"cost_usd":0.00024,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"198","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"203","correct":null},{"item_id":"fr","raw":"","parsed":"207","correct":null},{"item_id":"it","raw":"","parsed":"198","correct":null},{"item_id":"ja","raw":"","parsed":"234","correct":null},{"item_id":"ko","raw":"","parsed":"297","correct":null},{"item_id":"pt","raw":"","parsed":"208","correct":null},{"item_id":"zh","raw":"","parsed":"135","correct":null}]},{"id":72,"test":"tokenizer-tax","version":"v1","model_id":"z-ai/glm-5.3","model_slug":"glm-5-3","model_name":"GLM 5.3","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":90.1,"metrics":{"ratios":{"de":1.75,"en":1,"es":1.8,"fr":1.84,"it":2,"ja":2.11,"ko":2.75,"pt":1.85,"zh":1.11},"tokens":{"de":173,"en":99,"es":178,"fr":182,"it":198,"ja":209,"ko":272,"pt":183,"zh":110},"priceInPerM":1.4,"usdPer1kWords":{"de":0.00214,"en":0.00123,"es":0.00221,"fr":0.00225,"it":0.00245,"ja":0.00259,"ko":0.00337,"pt":0.00227,"zh":0.00136},"baselineTokens":38},"cost_usd":0.00293,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"173","correct":null},{"item_id":"en","raw":"","parsed":"99","correct":null},{"item_id":"es","raw":"","parsed":"178","correct":null},{"item_id":"fr","raw":"","parsed":"182","correct":null},{"item_id":"it","raw":"","parsed":"198","correct":null},{"item_id":"ja","raw":"","parsed":"209","correct":null},{"item_id":"ko","raw":"","parsed":"272","correct":null},{"item_id":"pt","raw":"","parsed":"183","correct":null},{"item_id":"zh","raw":"","parsed":"110","correct":null}]},{"id":73,"test":"tokenizer-tax","version":"v1","model_id":"z-ai/glm-5.1","model_slug":"glm-5-1","model_name":"GLM 5.1","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":70.9,"metrics":{"ratios":{"de":1.6,"en":1,"es":1.69,"fr":1.67,"it":1.6,"ja":1.89,"ko":2.4,"pt":1.73,"zh":1.09},"tokens":{"de":198,"en":124,"es":210,"fr":207,"it":198,"ja":234,"ko":297,"pt":215,"zh":135},"priceInPerM":0.966,"usdPer1kWords":{"de":0.00169,"en":0.00106,"es":0.0018,"fr":0.00177,"it":0.00169,"ja":0.002,"ko":0.00254,"pt":0.00184,"zh":0.00115},"baselineTokens":6},"cost_usd":0.00308,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"198","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"210","correct":null},{"item_id":"fr","raw":"","parsed":"207","correct":null},{"item_id":"it","raw":"","parsed":"198","correct":null},{"item_id":"ja","raw":"","parsed":"234","correct":null},{"item_id":"ko","raw":"","parsed":"297","correct":null},{"item_id":"pt","raw":"","parsed":"215","correct":null},{"item_id":"zh","raw":"","parsed":"135","correct":null}]},{"id":74,"test":"tokenizer-tax","version":"v1","model_id":"x-ai/grok-4.7","model_slug":"grok-4-7","model_name":"Grok 4.7","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":50.4,"metrics":{"ratios":{"de":1.48,"en":1,"es":1.49,"fr":1.5,"it":1.42,"ja":1.43,"ko":2,"pt":1.48,"zh":1.23},"tokens":{"de":184,"en":124,"es":185,"fr":186,"it":176,"ja":177,"ko":248,"pt":183,"zh":152},"priceInPerM":2,"usdPer1kWords":{"de":0.00326,"en":0.00219,"es":0.00327,"fr":0.00329,"it":0.00312,"ja":0.00313,"ko":0.00439,"pt":0.00324,"zh":0.00269},"baselineTokens":1243},"cost_usd":0.02484,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"184","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"185","correct":null},{"item_id":"fr","raw":"","parsed":"186","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"177","correct":null},{"item_id":"ko","raw":"","parsed":"248","correct":null},{"item_id":"pt","raw":"","parsed":"183","correct":null},{"item_id":"zh","raw":"","parsed":"152","correct":null}]},{"id":75,"test":"tokenizer-tax","version":"v1","model_id":"x-ai/grok-4.6","model_slug":"grok-4-6","model_name":"Grok 4.6","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":50.4,"metrics":{"ratios":{"de":1.48,"en":1,"es":1.49,"fr":1.5,"it":1.42,"ja":1.43,"ko":2,"pt":1.48,"zh":1.23},"tokens":{"de":184,"en":124,"es":185,"fr":186,"it":176,"ja":177,"ko":248,"pt":183,"zh":152},"priceInPerM":2,"usdPer1kWords":{"de":0.00326,"en":0.00219,"es":0.00327,"fr":0.00329,"it":0.00312,"ja":0.00313,"ko":0.00439,"pt":0.00324,"zh":0.00269},"baselineTokens":207},"cost_usd":0.03758,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"184","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"185","correct":null},{"item_id":"fr","raw":"","parsed":"186","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"177","correct":null},{"item_id":"ko","raw":"","parsed":"248","correct":null},{"item_id":"pt","raw":"","parsed":"183","correct":null},{"item_id":"zh","raw":"","parsed":"152","correct":null}]},{"id":77,"test":"tokenizer-tax","version":"v1","model_id":"x-ai/grok-4.5","model_slug":"grok-4-5","model_name":"Grok 4.5","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":50.4,"metrics":{"ratios":{"de":1.48,"en":1,"es":1.49,"fr":1.5,"it":1.42,"ja":1.43,"ko":2,"pt":1.48,"zh":1.23},"tokens":{"de":184,"en":124,"es":185,"fr":186,"it":176,"ja":177,"ko":248,"pt":183,"zh":152},"priceInPerM":2,"usdPer1kWords":{"de":0.00326,"en":0.00219,"es":0.00327,"fr":0.00329,"it":0.00312,"ja":0.00313,"ko":0.00439,"pt":0.00324,"zh":0.00269},"baselineTokens":207},"cost_usd":0.02798,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"184","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"185","correct":null},{"item_id":"fr","raw":"","parsed":"186","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"177","correct":null},{"item_id":"ko","raw":"","parsed":"248","correct":null},{"item_id":"pt","raw":"","parsed":"183","correct":null},{"item_id":"zh","raw":"","parsed":"152","correct":null}]},{"id":78,"test":"tokenizer-tax","version":"v1","model_id":"x-ai/grok-4.3","model_slug":"grok-4-3","model_name":"Grok 4.3","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.5,"metrics":{"ratios":{"de":1.6,"en":1,"es":1.4,"fr":1.37,"it":1.23,"ja":1.56,"ko":1.77,"pt":1.37,"zh":1.18},"tokens":{"de":198,"en":124,"es":174,"fr":170,"it":152,"ja":194,"ko":219,"pt":170,"zh":146},"priceInPerM":1.25,"usdPer1kWords":{"de":0.00219,"en":0.00137,"es":0.00192,"fr":0.00188,"it":0.00168,"ja":0.00215,"ko":0.00242,"pt":0.00188,"zh":0.00162},"baselineTokens":193},"cost_usd":0.01679,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"198","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"174","correct":null},{"item_id":"fr","raw":"","parsed":"170","correct":null},{"item_id":"it","raw":"","parsed":"152","correct":null},{"item_id":"ja","raw":"","parsed":"194","correct":null},{"item_id":"ko","raw":"","parsed":"219","correct":null},{"item_id":"pt","raw":"","parsed":"170","correct":null},{"item_id":"zh","raw":"","parsed":"146","correct":null}]},{"id":79,"test":"tokenizer-tax","version":"v1","model_id":"x-ai/grok-4.20","model_slug":"grok-4-20","model_name":"Grok 4.20","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.5,"metrics":{"ratios":{"de":1.6,"en":1,"es":1.4,"fr":1.37,"it":1.23,"ja":1.56,"ko":1.77,"pt":1.37,"zh":1.18},"tokens":{"de":198,"en":124,"es":174,"fr":170,"it":152,"ja":194,"ko":219,"pt":170,"zh":146},"priceInPerM":1.25,"usdPer1kWords":{"de":0.00219,"en":0.00137,"es":0.00192,"fr":0.00188,"it":0.00168,"ja":0.00215,"ko":0.00242,"pt":0.00188,"zh":0.00162},"baselineTokens":187},"cost_usd":0.02555,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"198","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"174","correct":null},{"item_id":"fr","raw":"","parsed":"170","correct":null},{"item_id":"it","raw":"","parsed":"152","correct":null},{"item_id":"ja","raw":"","parsed":"194","correct":null},{"item_id":"ko","raw":"","parsed":"219","correct":null},{"item_id":"pt","raw":"","parsed":"170","correct":null},{"item_id":"zh","raw":"","parsed":"146","correct":null}]},{"id":80,"test":"tokenizer-tax","version":"v1","model_id":"deepseek/deepseek-v4.1-flash","model_slug":"deepseek-v4-1-flash","model_name":"DeepSeek V4.1 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":68,"metrics":{"ratios":{"de":1.78,"en":1,"es":1.71,"fr":1.69,"it":1.65,"ja":1.79,"ko":2.07,"pt":1.69,"zh":1.06},"tokens":{"de":221,"en":124,"es":212,"fr":209,"it":204,"ja":222,"ko":257,"pt":209,"zh":131},"priceInPerM":0.15,"usdPer1kWords":{"de":0.00029,"en":0.00016,"es":0.00028,"fr":0.00028,"it":0.00027,"ja":0.00029,"ko":0.00034,"pt":0.00028,"zh":0.00017},"baselineTokens":31},"cost_usd":0.00042,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"221","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"212","correct":null},{"item_id":"fr","raw":"","parsed":"209","correct":null},{"item_id":"it","raw":"","parsed":"204","correct":null},{"item_id":"ja","raw":"","parsed":"222","correct":null},{"item_id":"ko","raw":"","parsed":"257","correct":null},{"item_id":"pt","raw":"","parsed":"209","correct":null},{"item_id":"zh","raw":"","parsed":"131","correct":null}]},{"id":81,"test":"tokenizer-tax","version":"v1","model_id":"deepseek/deepseek-v4-pro-0813","model_slug":"deepseek-v4-pro-0813","model_name":"DeepSeek V4 Pro 0813","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":17.1,"metrics":{"ratios":{"de":1.48,"en":1,"es":1.43,"fr":1.03,"it":1.39,"ja":1.09,"ko":1.27,"pt":1.03,"zh":0.65},"tokens":{"de":300,"en":203,"es":291,"fr":209,"it":283,"ja":222,"ko":257,"pt":209,"zh":131},"priceInPerM":0.85,"usdPer1kWords":{"de":0.00226,"en":0.00153,"es":0.00219,"fr":0.00157,"it":0.00213,"ja":0.00167,"ko":0.00193,"pt":0.00157,"zh":0.00099},"baselineTokens":5},"cost_usd":0.00194,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"300","correct":null},{"item_id":"en","raw":"","parsed":"203","correct":null},{"item_id":"es","raw":"","parsed":"291","correct":null},{"item_id":"fr","raw":"","parsed":"209","correct":null},{"item_id":"it","raw":"","parsed":"283","correct":null},{"item_id":"ja","raw":"","parsed":"222","correct":null},{"item_id":"ko","raw":"","parsed":"257","correct":null},{"item_id":"pt","raw":"","parsed":"209","correct":null},{"item_id":"zh","raw":"","parsed":"131","correct":null}]},{"id":82,"test":"tokenizer-tax","version":"v1","model_id":"deepseek/deepseek-v4-flash-0731","model_slug":"deepseek-v4-flash-0731","model_name":"DeepSeek V4 Flash 0731","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":68,"metrics":{"ratios":{"de":1.78,"en":1,"es":1.71,"fr":1.69,"it":1.65,"ja":1.79,"ko":2.07,"pt":1.69,"zh":1.06},"tokens":{"de":221,"en":124,"es":212,"fr":209,"it":204,"ja":222,"ko":257,"pt":209,"zh":131},"priceInPerM":0.0152,"usdPer1kWords":{"de":0.00003,"en":0.00002,"es":0.00003,"fr":0.00003,"it":0.00003,"ja":0.00003,"ko":0.00003,"pt":0.00003,"zh":0.00002},"baselineTokens":5},"cost_usd":0.00012,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"221","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"212","correct":null},{"item_id":"fr","raw":"","parsed":"209","correct":null},{"item_id":"it","raw":"","parsed":"204","correct":null},{"item_id":"ja","raw":"","parsed":"222","correct":null},{"item_id":"ko","raw":"","parsed":"257","correct":null},{"item_id":"pt","raw":"","parsed":"209","correct":null},{"item_id":"zh","raw":"","parsed":"131","correct":null}]},{"id":83,"test":"tokenizer-tax","version":"v1","model_id":"deepseek/deepseek-v4-flash","model_slug":"deepseek-v4-flash","model_name":"DeepSeek V4 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":7.4,"metrics":{"ratios":{"de":1.09,"en":1,"es":1.04,"fr":1.03,"it":1.39,"ja":1.09,"ko":1.27,"pt":1.03,"zh":0.65},"tokens":{"de":221,"en":203,"es":212,"fr":209,"it":283,"ja":222,"ko":257,"pt":209,"zh":131},"priceInPerM":0.0224,"usdPer1kWords":{"de":0.00004,"en":0.00004,"es":0.00004,"fr":0.00004,"it":0.00006,"ja":0.00004,"ko":0.00005,"pt":0.00004,"zh":0.00003},"baselineTokens":5},"cost_usd":0.00014,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"221","correct":null},{"item_id":"en","raw":"","parsed":"203","correct":null},{"item_id":"es","raw":"","parsed":"212","correct":null},{"item_id":"fr","raw":"","parsed":"209","correct":null},{"item_id":"it","raw":"","parsed":"283","correct":null},{"item_id":"ja","raw":"","parsed":"222","correct":null},{"item_id":"ko","raw":"","parsed":"257","correct":null},{"item_id":"pt","raw":"","parsed":"209","correct":null},{"item_id":"zh","raw":"","parsed":"131","correct":null}]},{"id":84,"test":"tokenizer-tax","version":"v1","model_id":"deepseek/deepseek-v4-pro","model_slug":"deepseek-v4-pro","model_name":"DeepSeek V4 Pro","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":68,"metrics":{"ratios":{"de":1.78,"en":1,"es":1.71,"fr":1.69,"it":1.65,"ja":1.79,"ko":2.07,"pt":1.69,"zh":1.06},"tokens":{"de":221,"en":124,"es":212,"fr":209,"it":204,"ja":222,"ko":257,"pt":209,"zh":131},"priceInPerM":0.2088,"usdPer1kWords":{"de":0.00041,"en":0.00023,"es":0.00039,"fr":0.00039,"it":0.00038,"ja":0.00041,"ko":0.00047,"pt":0.00039,"zh":0.00024},"baselineTokens":5},"cost_usd":0.00084,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"221","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"212","correct":null},{"item_id":"fr","raw":"","parsed":"209","correct":null},{"item_id":"it","raw":"","parsed":"204","correct":null},{"item_id":"ja","raw":"","parsed":"222","correct":null},{"item_id":"ko","raw":"","parsed":"257","correct":null},{"item_id":"pt","raw":"","parsed":"209","correct":null},{"item_id":"zh","raw":"","parsed":"131","correct":null}]},{"id":85,"test":"tokenizer-tax","version":"v1","model_id":"google/gemini-3.8-flash","model_slug":"gemini-3-8-flash","model_name":"Gemini 3.8 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.6,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.41,"fr":1.45,"it":1.38,"ja":1.48,"ko":1.64,"pt":1.43,"zh":1.28},"tokens":{"de":176,"en":124,"es":175,"fr":180,"it":171,"ja":184,"ko":203,"pt":177,"zh":159},"priceInPerM":0.75,"usdPer1kWords":{"de":0.00117,"en":0.00082,"es":0.00116,"fr":0.00119,"it":0.00113,"ja":0.00122,"ko":0.00135,"pt":0.00117,"zh":0.00106},"baselineTokens":1},"cost_usd":0.00161,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"175","correct":null},{"item_id":"fr","raw":"","parsed":"180","correct":null},{"item_id":"it","raw":"","parsed":"171","correct":null},{"item_id":"ja","raw":"","parsed":"184","correct":null},{"item_id":"ko","raw":"","parsed":"203","correct":null},{"item_id":"pt","raw":"","parsed":"177","correct":null},{"item_id":"zh","raw":"","parsed":"159","correct":null}]},{"id":86,"test":"tokenizer-tax","version":"v1","model_id":"google/gemini-3.7-flash","model_slug":"gemini-3-7-flash","model_name":"Gemini 3.7 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.6,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.41,"fr":1.45,"it":1.38,"ja":1.48,"ko":1.64,"pt":1.43,"zh":1.28},"tokens":{"de":176,"en":124,"es":175,"fr":180,"it":171,"ja":183,"ko":203,"pt":177,"zh":159},"priceInPerM":0.75,"usdPer1kWords":{"de":0.00117,"en":0.00082,"es":0.00116,"fr":0.00119,"it":0.00113,"ja":0.00121,"ko":0.00135,"pt":0.00117,"zh":0.00106},"baselineTokens":1},"cost_usd":0.00161,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"175","correct":null},{"item_id":"fr","raw":"","parsed":"180","correct":null},{"item_id":"it","raw":"","parsed":"171","correct":null},{"item_id":"ja","raw":"","parsed":"183","correct":null},{"item_id":"ko","raw":"","parsed":"203","correct":null},{"item_id":"pt","raw":"","parsed":"177","correct":null},{"item_id":"zh","raw":"","parsed":"159","correct":null}]},{"id":87,"test":"tokenizer-tax","version":"v1","model_id":"google/gemini-3.6-flash","model_slug":"gemini-3-6-flash","model_name":"Gemini 3.6 Flash","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.6,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.41,"fr":1.45,"it":1.38,"ja":1.48,"ko":1.64,"pt":1.43,"zh":1.28},"tokens":{"de":176,"en":124,"es":175,"fr":180,"it":171,"ja":183,"ko":203,"pt":177,"zh":159},"priceInPerM":0.75,"usdPer1kWords":{"de":0.00117,"en":0.00082,"es":0.00116,"fr":0.00119,"it":0.00113,"ja":0.00121,"ko":0.00135,"pt":0.00117,"zh":0.00106},"baselineTokens":1},"cost_usd":0.00161,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"175","correct":null},{"item_id":"fr","raw":"","parsed":"180","correct":null},{"item_id":"it","raw":"","parsed":"171","correct":null},{"item_id":"ja","raw":"","parsed":"183","correct":null},{"item_id":"ko","raw":"","parsed":"203","correct":null},{"item_id":"pt","raw":"","parsed":"177","correct":null},{"item_id":"zh","raw":"","parsed":"159","correct":null}]},{"id":88,"test":"tokenizer-tax","version":"v1","model_id":"google/gemini-3.5-flash-lite","model_slug":"gemini-3-5-flash-lite","model_name":"Gemini 3.5 Flash Lite","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.6,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.41,"fr":1.45,"it":1.38,"ja":1.48,"ko":1.64,"pt":1.43,"zh":1.28},"tokens":{"de":176,"en":124,"es":175,"fr":180,"it":171,"ja":183,"ko":203,"pt":177,"zh":159},"priceInPerM":0.3,"usdPer1kWords":{"de":0.00047,"en":0.00033,"es":0.00046,"fr":0.00048,"it":0.00045,"ja":0.00049,"ko":0.00054,"pt":0.00047,"zh":0.00042},"baselineTokens":1},"cost_usd":0.00076,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"175","correct":null},{"item_id":"fr","raw":"","parsed":"180","correct":null},{"item_id":"it","raw":"","parsed":"171","correct":null},{"item_id":"ja","raw":"","parsed":"183","correct":null},{"item_id":"ko","raw":"","parsed":"203","correct":null},{"item_id":"pt","raw":"","parsed":"177","correct":null},{"item_id":"zh","raw":"","parsed":"159","correct":null}]},{"id":89,"test":"tokenizer-tax","version":"v1","model_id":"google/gemma-4-26b-a4b-it","model_slug":"gemma-4-26b-a4b-it","model_name":"Gemma 4 26B A4B ","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":43.6,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.41,"fr":1.45,"it":1.38,"ja":1.48,"ko":1.64,"pt":1.43,"zh":1.28},"tokens":{"de":176,"en":124,"es":175,"fr":180,"it":171,"ja":183,"ko":203,"pt":177,"zh":159},"priceInPerM":0.0675,"usdPer1kWords":{"de":0.00011,"en":0.00007,"es":0.0001,"fr":0.00011,"it":0.0001,"ja":0.00011,"ko":0.00012,"pt":0.00011,"zh":0.00009},"baselineTokens":17},"cost_usd":0.00016,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"175","correct":null},{"item_id":"fr","raw":"","parsed":"180","correct":null},{"item_id":"it","raw":"","parsed":"171","correct":null},{"item_id":"ja","raw":"","parsed":"183","correct":null},{"item_id":"ko","raw":"","parsed":"203","correct":null},{"item_id":"pt","raw":"","parsed":"177","correct":null},{"item_id":"zh","raw":"","parsed":"159","correct":null}]},{"id":90,"test":"tokenizer-tax","version":"v1","model_id":"moonshotai/kimi-k3","model_slug":"kimi-k3","model_name":"Kimi K3","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":93,"metrics":{"ratios":{"de":2.05,"en":1,"es":1.94,"fr":1.94,"it":1.85,"ja":2.15,"ko":2.55,"pt":1.94,"zh":1.02},"tokens":{"de":254,"en":124,"es":240,"fr":241,"it":230,"ja":267,"ko":316,"pt":240,"zh":126},"priceInPerM":0.72,"usdPer1kWords":{"de":0.00162,"en":0.00079,"es":0.00153,"fr":0.00154,"it":0.00147,"ja":0.0017,"ko":0.00201,"pt":0.00153,"zh":0.0008},"baselineTokens":87},"cost_usd":0.00786,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"254","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"240","correct":null},{"item_id":"fr","raw":"","parsed":"241","correct":null},{"item_id":"it","raw":"","parsed":"230","correct":null},{"item_id":"ja","raw":"","parsed":"267","correct":null},{"item_id":"ko","raw":"","parsed":"316","correct":null},{"item_id":"pt","raw":"","parsed":"240","correct":null},{"item_id":"zh","raw":"","parsed":"126","correct":null}]},{"id":91,"test":"tokenizer-tax","version":"v1","model_id":"moonshotai/kimi-k2.6","model_slug":"kimi-k2-6","model_name":"Kimi K2.6","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":92,"metrics":{"ratios":{"de":2.05,"en":1,"es":1.94,"fr":1.94,"it":1.85,"ja":2.13,"ko":2.55,"pt":1.91,"zh":0.99},"tokens":{"de":254,"en":124,"es":240,"fr":241,"it":230,"ja":264,"ko":316,"pt":237,"zh":123},"priceInPerM":0.95,"usdPer1kWords":{"de":0.00214,"en":0.00104,"es":0.00202,"fr":0.00203,"it":0.00193,"ja":0.00222,"ko":0.00266,"pt":0.00199,"zh":0.00103},"baselineTokens":9},"cost_usd":0.00189,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"254","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"240","correct":null},{"item_id":"fr","raw":"","parsed":"241","correct":null},{"item_id":"it","raw":"","parsed":"230","correct":null},{"item_id":"ja","raw":"","parsed":"264","correct":null},{"item_id":"ko","raw":"","parsed":"316","correct":null},{"item_id":"pt","raw":"","parsed":"237","correct":null},{"item_id":"zh","raw":"","parsed":"123","correct":null}]},{"id":92,"test":"tokenizer-tax","version":"v1","model_id":"moonshotai/kimi-k2.5","model_slug":"kimi-k2-5","model_name":"Kimi K2.5","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":99.5,"metrics":{"ratios":{"de":2.2,"en":1,"es":2.09,"fr":1.94,"it":1.85,"ja":2.28,"ko":2.55,"pt":2.06,"zh":0.99},"tokens":{"de":273,"en":124,"es":259,"fr":241,"it":230,"ja":283,"ko":316,"pt":256,"zh":123},"priceInPerM":0.45,"usdPer1kWords":{"de":0.00109,"en":0.00049,"es":0.00103,"fr":0.00096,"it":0.00092,"ja":0.00113,"ko":0.00126,"pt":0.00102,"zh":0.00049},"baselineTokens":9},"cost_usd":0.00477,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"273","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"259","correct":null},{"item_id":"fr","raw":"","parsed":"241","correct":null},{"item_id":"it","raw":"","parsed":"230","correct":null},{"item_id":"ja","raw":"","parsed":"283","correct":null},{"item_id":"ko","raw":"","parsed":"316","correct":null},{"item_id":"pt","raw":"","parsed":"256","correct":null},{"item_id":"zh","raw":"","parsed":"123","correct":null}]},{"id":93,"test":"tokenizer-tax","version":"v1","model_id":"moonshotai/kimi-k2-thinking","model_slug":"kimi-k2-thinking","model_name":"Kimi K2 Thinking","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":92.3,"metrics":{"ratios":{"de":2.05,"en":1,"es":1.94,"fr":1.94,"it":1.85,"ja":2.13,"ko":2.55,"pt":1.9,"zh":1.02},"tokens":{"de":254,"en":124,"es":240,"fr":241,"it":230,"ja":264,"ko":316,"pt":236,"zh":127},"priceInPerM":0.6,"usdPer1kWords":{"de":0.00135,"en":0.00066,"es":0.00127,"fr":0.00128,"it":0.00122,"ja":0.0014,"ko":0.00168,"pt":0.00125,"zh":0.00067},"baselineTokens":9},"cost_usd":0.01506,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"254","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"240","correct":null},{"item_id":"fr","raw":"","parsed":"241","correct":null},{"item_id":"it","raw":"","parsed":"230","correct":null},{"item_id":"ja","raw":"","parsed":"264","correct":null},{"item_id":"ko","raw":"","parsed":"316","correct":null},{"item_id":"pt","raw":"","parsed":"236","correct":null},{"item_id":"zh","raw":"","parsed":"127","correct":null}]},{"id":94,"test":"tokenizer-tax","version":"v1","model_id":"moonshotai/kimi-k2-0905","model_slug":"kimi-k2-0905","model_name":"Kimi K2 0905","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":91.9,"metrics":{"ratios":{"de":2.05,"en":1,"es":1.94,"fr":1.94,"it":1.85,"ja":2.13,"ko":2.55,"pt":1.9,"zh":0.99},"tokens":{"de":254,"en":124,"es":240,"fr":241,"it":230,"ja":264,"ko":316,"pt":235,"zh":123},"priceInPerM":0.6,"usdPer1kWords":{"de":0.00135,"en":0.00066,"es":0.00127,"fr":0.00128,"it":0.00122,"ja":0.0014,"ko":0.00168,"pt":0.00125,"zh":0.00065},"baselineTokens":10},"cost_usd":0.00167,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"254","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"240","correct":null},{"item_id":"fr","raw":"","parsed":"241","correct":null},{"item_id":"it","raw":"","parsed":"230","correct":null},{"item_id":"ja","raw":"","parsed":"264","correct":null},{"item_id":"ko","raw":"","parsed":"316","correct":null},{"item_id":"pt","raw":"","parsed":"235","correct":null},{"item_id":"zh","raw":"","parsed":"123","correct":null}]},{"id":95,"test":"tokenizer-tax","version":"v1","model_id":"minimax/minimax-m2.7","model_slug":"minimax-m2-7","model_name":"MiniMax M2.7","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":34.5,"metrics":{"ratios":{"de":1.64,"en":1,"es":1.3,"fr":1.28,"it":1.56,"ja":1.2,"ko":1.49,"pt":1.28,"zh":1.01},"tokens":{"de":207,"en":126,"es":164,"fr":161,"it":196,"ja":151,"ko":188,"pt":161,"zh":127},"priceInPerM":0.21,"usdPer1kWords":{"de":0.00038,"en":0.00023,"es":0.0003,"fr":0.0003,"it":0.00036,"ja":0.00028,"ko":0.00035,"pt":0.0003,"zh":0.00024},"baselineTokens":42},"cost_usd":0.00064,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"207","correct":null},{"item_id":"en","raw":"","parsed":"126","correct":null},{"item_id":"es","raw":"","parsed":"164","correct":null},{"item_id":"fr","raw":"","parsed":"161","correct":null},{"item_id":"it","raw":"","parsed":"196","correct":null},{"item_id":"ja","raw":"","parsed":"151","correct":null},{"item_id":"ko","raw":"","parsed":"188","correct":null},{"item_id":"pt","raw":"","parsed":"161","correct":null},{"item_id":"zh","raw":"","parsed":"127","correct":null}]},{"id":96,"test":"tokenizer-tax","version":"v1","model_id":"minimax/minimax-m2.5","model_slug":"minimax-m2-5","model_name":"MiniMax M2.5","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":63.9,"metrics":{"ratios":{"de":1.67,"en":1,"es":1.32,"fr":2.39,"it":1.58,"ja":2.29,"ko":1.54,"pt":1.3,"zh":1.02},"tokens":{"de":207,"en":124,"es":164,"fr":296,"it":196,"ja":284,"ko":191,"pt":161,"zh":127},"priceInPerM":0.27,"usdPer1kWords":{"de":0.00049,"en":0.0003,"es":0.00039,"fr":0.00071,"it":0.00047,"ja":0.00068,"ko":0.00046,"pt":0.00038,"zh":0.0003},"baselineTokens":39},"cost_usd":0.00073,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"207","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"164","correct":null},{"item_id":"fr","raw":"","parsed":"296","correct":null},{"item_id":"it","raw":"","parsed":"196","correct":null},{"item_id":"ja","raw":"","parsed":"284","correct":null},{"item_id":"ko","raw":"","parsed":"191","correct":null},{"item_id":"pt","raw":"","parsed":"161","correct":null},{"item_id":"zh","raw":"","parsed":"127","correct":null}]},{"id":97,"test":"tokenizer-tax","version":"v1","model_id":"minimax/minimax-m2-her","model_slug":"minimax-m2-her","model_name":"MiniMax M2-her","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":36.4,"metrics":{"ratios":{"de":1.67,"en":1,"es":1.32,"fr":1.3,"it":1.58,"ja":1.2,"ko":1.52,"pt":1.3,"zh":1.02},"tokens":{"de":207,"en":124,"es":164,"fr":161,"it":196,"ja":149,"ko":188,"pt":161,"zh":127},"priceInPerM":0.3,"usdPer1kWords":{"de":0.00055,"en":0.00033,"es":0.00044,"fr":0.00043,"it":0.00052,"ja":0.0004,"ko":0.0005,"pt":0.00043,"zh":0.00034},"baselineTokens":192},"cost_usd":0.0012,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"207","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"164","correct":null},{"item_id":"fr","raw":"","parsed":"161","correct":null},{"item_id":"it","raw":"","parsed":"196","correct":null},{"item_id":"ja","raw":"","parsed":"149","correct":null},{"item_id":"ko","raw":"","parsed":"188","correct":null},{"item_id":"pt","raw":"","parsed":"161","correct":null},{"item_id":"zh","raw":"","parsed":"127","correct":null}]},{"id":98,"test":"tokenizer-tax","version":"v1","model_id":"minimax/minimax-m2.1","model_slug":"minimax-m2-1","model_name":"MiniMax M2.1","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":36.4,"metrics":{"ratios":{"de":1.67,"en":1,"es":1.32,"fr":1.3,"it":1.58,"ja":1.2,"ko":1.52,"pt":1.3,"zh":1.02},"tokens":{"de":207,"en":124,"es":164,"fr":161,"it":196,"ja":149,"ko":188,"pt":161,"zh":127},"priceInPerM":0.3,"usdPer1kWords":{"de":0.00055,"en":0.00033,"es":0.00044,"fr":0.00043,"it":0.00052,"ja":0.0004,"ko":0.0005,"pt":0.00043,"zh":0.00034},"baselineTokens":42},"cost_usd":0.00084,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"207","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"164","correct":null},{"item_id":"fr","raw":"","parsed":"161","correct":null},{"item_id":"it","raw":"","parsed":"196","correct":null},{"item_id":"ja","raw":"","parsed":"149","correct":null},{"item_id":"ko","raw":"","parsed":"188","correct":null},{"item_id":"pt","raw":"","parsed":"161","correct":null},{"item_id":"zh","raw":"","parsed":"127","correct":null}]},{"id":99,"test":"tokenizer-tax","version":"v1","model_id":"minimax/minimax-m2","model_slug":"minimax-m2","model_name":"MiniMax M2","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":36.4,"metrics":{"ratios":{"de":1.67,"en":1,"es":1.32,"fr":1.3,"it":1.58,"ja":1.2,"ko":1.52,"pt":1.3,"zh":1.02},"tokens":{"de":207,"en":124,"es":164,"fr":161,"it":196,"ja":149,"ko":188,"pt":161,"zh":127},"priceInPerM":0.3,"usdPer1kWords":{"de":0.00055,"en":0.00033,"es":0.00044,"fr":0.00043,"it":0.00052,"ja":0.0004,"ko":0.0005,"pt":0.00043,"zh":0.00034},"baselineTokens":40},"cost_usd":0.00069,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"207","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"164","correct":null},{"item_id":"fr","raw":"","parsed":"161","correct":null},{"item_id":"it","raw":"","parsed":"196","correct":null},{"item_id":"ja","raw":"","parsed":"149","correct":null},{"item_id":"ko","raw":"","parsed":"188","correct":null},{"item_id":"pt","raw":"","parsed":"161","correct":null},{"item_id":"zh","raw":"","parsed":"127","correct":null}]},{"id":100,"test":"tokenizer-tax","version":"v1","model_id":"mistralai/mistral-small-2603","model_slug":"mistral-small-2603","model_name":"Mistral Small 4","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":53.3,"metrics":{"ratios":{"de":1.41,"en":1,"es":1.42,"fr":1.37,"it":1.4,"ja":2.05,"ko":1.47,"pt":1.48,"zh":1.66},"tokens":{"de":178,"en":126,"es":179,"fr":172,"it":176,"ja":258,"ko":185,"pt":187,"zh":209},"priceInPerM":0.15,"usdPer1kWords":{"de":0.00024,"en":0.00017,"es":0.00024,"fr":0.00023,"it":0.00023,"ja":0.00034,"ko":0.00025,"pt":0.00025,"zh":0.00028},"baselineTokens":16},"cost_usd":0.00037,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"178","correct":null},{"item_id":"en","raw":"","parsed":"126","correct":null},{"item_id":"es","raw":"","parsed":"179","correct":null},{"item_id":"fr","raw":"","parsed":"172","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"258","correct":null},{"item_id":"ko","raw":"","parsed":"185","correct":null},{"item_id":"pt","raw":"","parsed":"187","correct":null},{"item_id":"zh","raw":"","parsed":"209","correct":null}]},{"id":105,"test":"tokenizer-tax","version":"v1","model_id":"meta-llama/llama-4-scout","model_slug":"llama-4-scout","model_name":"Llama 4 Scout","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":42.8,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.4,"fr":1.41,"it":1.35,"ja":1.63,"ko":1.51,"pt":1.41,"zh":1.29},"tokens":{"de":178,"en":125,"es":175,"fr":176,"it":169,"ja":204,"ko":189,"pt":176,"zh":161},"priceInPerM":0.1,"usdPer1kWords":{"de":0.00016,"en":0.00011,"es":0.00015,"fr":0.00016,"it":0.00015,"ja":0.00018,"ko":0.00017,"pt":0.00016,"zh":0.00014},"baselineTokens":11},"cost_usd":0.00025,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"178","correct":null},{"item_id":"en","raw":"","parsed":"125","correct":null},{"item_id":"es","raw":"","parsed":"175","correct":null},{"item_id":"fr","raw":"","parsed":"176","correct":null},{"item_id":"it","raw":"","parsed":"169","correct":null},{"item_id":"ja","raw":"","parsed":"204","correct":null},{"item_id":"ko","raw":"","parsed":"189","correct":null},{"item_id":"pt","raw":"","parsed":"176","correct":null},{"item_id":"zh","raw":"","parsed":"161","correct":null}]},{"id":101,"test":"tokenizer-tax","version":"v1","model_id":"mistralai/devstral-2512","model_slug":"devstral-2512","model_name":"Devstral 2 2512","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":53.3,"metrics":{"ratios":{"de":1.41,"en":1,"es":1.42,"fr":1.37,"it":1.4,"ja":2.05,"ko":1.47,"pt":1.48,"zh":1.66},"tokens":{"de":178,"en":126,"es":179,"fr":172,"it":176,"ja":258,"ko":185,"pt":187,"zh":209},"priceInPerM":0.4,"usdPer1kWords":{"de":0.00063,"en":0.00045,"es":0.00063,"fr":0.00061,"it":0.00062,"ja":0.00091,"ko":0.00065,"pt":0.00066,"zh":0.00074},"baselineTokens":16},"cost_usd":0.00104,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"178","correct":null},{"item_id":"en","raw":"","parsed":"126","correct":null},{"item_id":"es","raw":"","parsed":"179","correct":null},{"item_id":"fr","raw":"","parsed":"172","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"258","correct":null},{"item_id":"ko","raw":"","parsed":"185","correct":null},{"item_id":"pt","raw":"","parsed":"187","correct":null},{"item_id":"zh","raw":"","parsed":"209","correct":null}]},{"id":102,"test":"tokenizer-tax","version":"v1","model_id":"mistralai/ministral-14b-2512","model_slug":"ministral-14b-2512","model_name":"Ministral 3 14B 2512","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":53.3,"metrics":{"ratios":{"de":1.41,"en":1,"es":1.42,"fr":1.37,"it":1.4,"ja":2.05,"ko":1.47,"pt":1.48,"zh":1.66},"tokens":{"de":178,"en":126,"es":179,"fr":172,"it":176,"ja":258,"ko":185,"pt":187,"zh":209},"priceInPerM":0.2,"usdPer1kWords":{"de":0.00032,"en":0.00022,"es":0.00032,"fr":0.0003,"it":0.00031,"ja":0.00046,"ko":0.00033,"pt":0.00033,"zh":0.00037},"baselineTokens":4},"cost_usd":0.00037,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"178","correct":null},{"item_id":"en","raw":"","parsed":"126","correct":null},{"item_id":"es","raw":"","parsed":"179","correct":null},{"item_id":"fr","raw":"","parsed":"172","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"258","correct":null},{"item_id":"ko","raw":"","parsed":"185","correct":null},{"item_id":"pt","raw":"","parsed":"187","correct":null},{"item_id":"zh","raw":"","parsed":"209","correct":null}]},{"id":103,"test":"tokenizer-tax","version":"v1","model_id":"mistralai/ministral-3b-2512","model_slug":"ministral-3b-2512","model_name":"Ministral 3 3B 2512","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":53.3,"metrics":{"ratios":{"de":1.41,"en":1,"es":1.42,"fr":1.37,"it":1.4,"ja":2.05,"ko":1.47,"pt":1.48,"zh":1.66},"tokens":{"de":178,"en":126,"es":179,"fr":172,"it":176,"ja":258,"ko":185,"pt":187,"zh":209},"priceInPerM":0.1,"usdPer1kWords":{"de":0.00016,"en":0.00011,"es":0.00016,"fr":0.00015,"it":0.00016,"ja":0.00023,"ko":0.00016,"pt":0.00017,"zh":0.00018},"baselineTokens":4},"cost_usd":0.00019,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"178","correct":null},{"item_id":"en","raw":"","parsed":"126","correct":null},{"item_id":"es","raw":"","parsed":"179","correct":null},{"item_id":"fr","raw":"","parsed":"172","correct":null},{"item_id":"it","raw":"","parsed":"176","correct":null},{"item_id":"ja","raw":"","parsed":"258","correct":null},{"item_id":"ko","raw":"","parsed":"185","correct":null},{"item_id":"pt","raw":"","parsed":"187","correct":null},{"item_id":"zh","raw":"","parsed":"209","correct":null}]},{"id":104,"test":"tokenizer-tax","version":"v1","model_id":"meta-llama/llama-4-maverick","model_slug":"llama-4-maverick","model_name":"Llama 4 Maverick","route":null,"run_date":"2026-10-04","n_items":9,"n_valid":9,"score":44.1,"metrics":{"ratios":{"de":1.42,"en":1,"es":1.39,"fr":1.4,"it":1.38,"ja":1.62,"ko":1.64,"pt":1.4,"zh":1.28},"tokens":{"de":176,"en":124,"es":172,"fr":173,"it":171,"ja":201,"ko":203,"pt":173,"zh":159},"priceInPerM":0.1875,"usdPer1kWords":{"de":0.00029,"en":0.00021,"es":0.00029,"fr":0.00029,"it":0.00028,"ja":0.00033,"ko":0.00034,"pt":0.00029,"zh":0.00026},"baselineTokens":14},"cost_usd":0.00055,"config":{"method":"prompt_tokens(passage) - prompt_tokens(\".\") + 1","maxTokens":16},"answers":[{"item_id":"de","raw":"","parsed":"176","correct":null},{"item_id":"en","raw":"","parsed":"124","correct":null},{"item_id":"es","raw":"","parsed":"172","correct":null},{"item_id":"fr","raw":"","parsed":"173","correct":null},{"item_id":"it","raw":"","parsed":"171","correct":null},{"item_id":"ja","raw":"","parsed":"201","correct":null},{"item_id":"ko","raw":"","parsed":"203","correct":null},{"item_id":"pt","raw":"","parsed":"173","correct":null},{"item_id":"zh","raw":"","parsed":"159","correct":null}]}]}