🟢Headline Benchmarks
Dataset name: Headlines_OneAI_v1.7
Dataset
Name: Headlines_OneAI_v1.7
Datapoints: 46,643 (tested & reported), 10,000 published
Sources: Various sources for news & blogs from various domains (news, politics, tech, finance, etc.)
Results Overview
| Grade | Model | Rouge1 | RougeL | RougeLsum |
|---|---|---|---|---|
| 🟢A+ | Ours (One-AI-headlines-v1.7) | 0.486 | 0.461 | 0.461 |
| 🟠C | SOTA open-source model | 0.371 | 0.345 | 0.345 |
| Did we miss a model? suggest one and we'll add it |
Note: see our overview on the Rouge metrics
Detailed results
Ours (One-AI-headlines-v1.7)
SOTA open-source model
Updated 8 months ago