🌟 WritingBench: A Comprehensive Benchmark for Generative Writing
Evaluating LLMs' writing capabilities across 1,000 real-world queries, spanning 6 primary domains and 100 fine-grained subdomains.
📅 Last Updated: 2025-09-05 | 📈 Scored by: Claude-Sonnet-4
10 | claude-3-7-sonnet-20250219-thinking | Mistral AI | 81.34 |
10 | claude-3-7-sonnet-20250219-thinking | 81.34 | 82.35 | 81.57 | 79.10 | 82.17 | 83.24 | 80.28 |
10 | claude-3-7-sonnet-20250219-thinking | 81.34 | 86.73 | 86.17 | 81.82 | 85.25 | 82.00 | 80.73 | 78.00 | 83.50 | 83.67 | 84.40 | 82.50 | 82.20 | 82.80 | 84.17 | 76.89 | 84.00 | 72.25 | 82.40 | 81.75 | 81.50 | 81.40 | 84.40 | 81.09 | 84.83 | 83.67 | 83.64 | 82.50 | 81.82 | 79.33 | 83.00 | 84.15 | 79.29 | 84.57 | 77.75 | 81.71 | 77.50 | 78.73 | 87.40 | 82.46 | 81.60 | 76.44 | 76.44 | 73.78 | 85.82 | 84.50 | 80.33 | 82.29 | 82.86 | 75.56 | 77.87 | 82.25 | 72.15 | 77.33 | 73.14 | 75.67 | 76.33 | 74.18 | 84.80 | 84.00 | 80.55 | 74.00 | 85.50 | 86.50 | 82.33 | 87.50 | 82.18 | 76.22 | 85.09 | 85.47 | 83.83 | 85.27 | 86.67 | 83.67 | 77.45 | 83.60 | 75.33 | 68.67 | 85.71 | 86.25 | 86.92 | 79.33 | 80.22 | 87.14 | 83.14 | 84.57 | 78.00 | 81.75 | 79.50 | 80.67 | 81.14 | 80.62 | 78.92 | 85.09 | 78.33 | 85.08 | 80.00 | 82.73 | 79.20 | 77.75 | 74.94 |
10 | claude-3-7-sonnet-20250219-thinking | 81.34 | 81.23 | 83.84 | 81.28 | 83.42 | 80.71 | 79.69 |
Requirements: Style / Format / Length
Requirement_R: Includes all queries related to a specific requirement along with their entire set of criteria.
Requirement_C: Includes all queries related to a specific requirement but only the criteria pertinent to that specific requirement.
title={WritingBench: A Comprehensive Benchmark for Generative Writing},
author={Yuning Wu and Jiahao Mei and Ming Yan and Chenliang Li and Shaopeng Lai and Yuran Ren and Zijia Wang and Ji Zhang and Mengyue Wu and Qin Jin and Fei Huang},
year={2025},
url={https://arxiv.org/abs/2503.05244},
}```