Model Evaluation Report
Classification Metrics
| precision | recall | f1-score | support | |
|---|---|---|---|---|
| Academic Writing | 0.7672 | 0.6794 | 0.7206 | 131 |
| Content Listing | 0.6846 | 0.5552 | 0.6132 | 688 |
| Creative Writing | 0.5952 | 0.5263 | 0.5587 | 95 |
| Customer Support Page | 0.4774 | 0.5 | 0.4884 | 148 |
| Discussion Forum / Comment Section | 0.8406 | 0.6806 | 0.7522 | 620 |
| FAQs | 0.6667 | 0.6111 | 0.6377 | 36 |
| Incomplete Content | 0.6078 | 0.4576 | 0.5221 | 271 |
| Knowledge Article | 0.5492 | 0.5806 | 0.5645 | 279 |
| Legal Notices | 0.8108 | 0.6 | 0.6897 | 50 |
| Listicle | 0.6373 | 0.6736 | 0.6549 | 193 |
| News Article | 0.7743 | 0.8439 | 0.8076 | 1313 |
| Nonfiction Writing | 0.4554 | 0.5677 | 0.5054 | 495 |
| Organizational About Page | 0.6705 | 0.6041 | 0.6355 | 293 |
| Organizational Announcement | 0.6402 | 0.6463 | 0.6432 | 523 |
| Personal About Page | 0.7659 | 0.7371 | 0.7512 | 213 |
| Personal Blog | 0.7476 | 0.7593 | 0.7534 | 1666 |
| Product Page | 0.7627 | 0.8159 | 0.7884 | 1765 |
| Q&A Forum | 0.7222 | 0.6933 | 0.7075 | 75 |
| Spam / Ads | 0.6292 | 0.5628 | 0.5942 | 199 |
| Structured Data | 0.6245 | 0.5874 | 0.6054 | 269 |
| Technical Writing | 0.5789 | 0.4783 | 0.5238 | 46 |
| Transcript / Interview | 0.5766 | 0.5614 | 0.5689 | 114 |
| Tutorial / How-To Guide | 0.6257 | 0.6802 | 0.6518 | 344 |
| User Reviews | 0.5776 | 0.5345 | 0.5552 | 174 |
| accuracy | 0.6986 | 0.6986 | 0.6986 | 0.6986 |
| macro avg | 0.6578 | 0.6224 | 0.6372 | 10000 |
| weighted avg | 0.7009 | 0.6986 | 0.6975 | 10000 |
Confusion Matrix
| Pred Academic Writing | Pred Content Listing | Pred Creative Writing | Pred Customer Support Page | Pred Discussion Forum / Comment Section | Pred FAQs | Pred Incomplete Content | Pred Knowledge Article | Pred Legal Notices | Pred Listicle | Pred News Article | Pred Nonfiction Writing | Pred Organizational About Page | Pred Organizational Announcement | Pred Personal About Page | Pred Personal Blog | Pred Product Page | Pred Q&A Forum | Pred Spam / Ads | Pred Structured Data | Pred Technical Writing | Pred Transcript / Interview | Pred Tutorial / How-To Guide | Pred User Reviews | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Actual Academic Writing | 89 | 4 | 1 | 0 | 0 | 0 | 1 | 8 | 0 | 0 | 0 | 6 | 1 | 1 | 0 | 4 | 7 | 0 | 2 | 3 | 1 | 1 | 2 | 0 |
| Actual Content Listing | 4 | 382 | 4 | 7 | 9 | 0 | 13 | 9 | 0 | 11 | 28 | 16 | 11 | 15 | 2 | 51 | 70 | 1 | 15 | 20 | 2 | 3 | 7 | 8 |
| Actual Creative Writing | 1 | 1 | 50 | 0 | 2 | 0 | 1 | 2 | 0 | 0 | 3 | 3 | 1 | 0 | 1 | 24 | 1 | 0 | 0 | 2 | 0 | 1 | 0 | 2 |
| Actual Customer Support Page | 0 | 6 | 0 | 74 | 1 | 3 | 2 | 5 | 3 | 0 | 0 | 0 | 5 | 6 | 0 | 0 | 25 | 0 | 0 | 0 | 1 | 0 | 16 | 1 |
| Actual Discussion Forum / Comment Section | 1 | 2 | 3 | 1 | 422 | 2 | 6 | 3 | 0 | 5 | 24 | 13 | 0 | 6 | 3 | 100 | 6 | 9 | 1 | 1 | 1 | 3 | 2 | 6 |
| Actual FAQs | 0 | 0 | 0 | 7 | 0 | 22 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 2 | 0 |
| Actual Incomplete Content | 1 | 19 | 3 | 2 | 3 | 1 | 124 | 2 | 0 | 2 | 35 | 9 | 1 | 7 | 1 | 28 | 15 | 0 | 7 | 0 | 0 | 10 | 1 | 0 |
| Actual Knowledge Article | 4 | 6 | 2 | 6 | 0 | 0 | 1 | 162 | 2 | 1 | 5 | 20 | 8 | 6 | 1 | 7 | 14 | 1 | 1 | 20 | 1 | 0 | 11 | 0 |
| Actual Legal Notices | 0 | 0 | 0 | 5 | 1 | 0 | 1 | 2 | 30 | 0 | 0 | 1 | 1 | 1 | 1 | 0 | 3 | 1 | 0 | 3 | 0 | 0 | 0 | 0 |
| Actual Listicle | 0 | 8 | 0 | 0 | 1 | 1 | 0 | 4 | 0 | 130 | 5 | 9 | 1 | 0 | 0 | 17 | 7 | 1 | 1 | 0 | 0 | 0 | 8 | 0 |
| Actual News Article | 1 | 14 | 1 | 0 | 3 | 0 | 10 | 3 | 0 | 7 | 1108 | 80 | 0 | 48 | 0 | 19 | 7 | 0 | 1 | 2 | 0 | 6 | 1 | 2 |
| Actual Nonfiction Writing | 2 | 6 | 1 | 0 | 5 | 0 | 2 | 18 | 0 | 7 | 63 | 281 | 4 | 6 | 1 | 50 | 24 | 0 | 2 | 1 | 0 | 8 | 6 | 8 |
| Actual Organizational About Page | 2 | 6 | 0 | 5 | 0 | 0 | 0 | 5 | 2 | 0 | 1 | 4 | 177 | 9 | 9 | 1 | 66 | 0 | 1 | 4 | 0 | 0 | 0 | 1 |
| Actual Organizational Announcement | 0 | 10 | 0 | 4 | 0 | 0 | 9 | 0 | 0 | 2 | 59 | 22 | 4 | 338 | 3 | 30 | 36 | 0 | 0 | 1 | 0 | 2 | 3 | 0 |
| Actual Personal About Page | 0 | 3 | 0 | 0 | 7 | 0 | 1 | 0 | 0 | 0 | 0 | 6 | 5 | 1 | 157 | 8 | 9 | 1 | 2 | 6 | 0 | 3 | 0 | 4 |
| Actual Personal Blog | 2 | 29 | 10 | 1 | 21 | 1 | 7 | 14 | 0 | 20 | 59 | 95 | 1 | 33 | 5 | 1265 | 39 | 0 | 5 | 1 | 0 | 7 | 40 | 11 |
| Actual Product Page | 3 | 39 | 1 | 25 | 4 | 0 | 6 | 25 | 0 | 7 | 17 | 16 | 35 | 38 | 8 | 18 | 1440 | 0 | 19 | 21 | 5 | 0 | 19 | 19 |
| Actual Q&A Forum | 0 | 0 | 0 | 1 | 17 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 52 | 0 | 0 | 0 | 0 | 2 | 0 |
| Actual Spam / Ads | 0 | 2 | 3 | 0 | 2 | 0 | 2 | 7 | 0 | 3 | 3 | 10 | 1 | 2 | 3 | 7 | 32 | 0 | 112 | 3 | 0 | 0 | 6 | 1 |
| Actual Structured Data | 4 | 16 | 2 | 2 | 0 | 1 | 7 | 9 | 0 | 2 | 3 | 5 | 6 | 2 | 7 | 3 | 28 | 0 | 1 | 158 | 3 | 2 | 3 | 5 |
| Actual Technical Writing | 1 | 0 | 0 | 4 | 0 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 4 | 0 | 0 | 5 | 22 | 0 | 7 | 0 |
| Actual Transcript / Interview | 0 | 1 | 0 | 0 | 0 | 0 | 8 | 1 | 0 | 0 | 15 | 7 | 0 | 4 | 1 | 9 | 1 | 2 | 0 | 0 | 0 | 64 | 1 | 0 |
| Actual Tutorial / How-To Guide | 1 | 1 | 1 | 8 | 1 | 2 | 3 | 12 | 0 | 6 | 2 | 4 | 0 | 3 | 0 | 28 | 27 | 2 | 6 | 0 | 2 | 1 | 234 | 0 |
| Actual User Reviews | 0 | 3 | 2 | 3 | 3 | 0 | 0 | 1 | 0 | 0 | 0 | 10 | 1 | 1 | 2 | 21 | 27 | 0 | 2 | 2 | 0 | 0 | 3 | 93 |
Sampled Predictions
| Input | Prediction | Actual |
|---|---|---|
| 11 TV News Sarah Michelle Gellar 'still proud' of 'Buffy the Vampire Slayer' Sarah Michelle Gellar poses for photos at Comic-con 2011 © PA Images / Denis Poroy/AP Sarah Michelle Gellar has said that she has no regrets about starring on Buffy the... | News Article | News Article |
| Home Uncategorized These transfers that collapsed on the last day These transfers that collapsed on the last day It’s the last day of the transfer window. Some transfers will be completed in a hurry, others will fall miserably. Here are some preced... | Listicle | Listicle |
| An Analysis of Edmund Spenser's "The Faerie Queen" Updated on July 31, 2019 Schatzie Speaks profile image A portrait of Queen Elizabeth 1 A portrait of Queen Elizabeth 1 | Source Much is revealed in the way that an author expresses himself; the d... | Nonfiction Writing |
| Skip to main content Coulourful houses on street in Aalborg, Denmark Discover the Port of Aalborg Hotdogs in Aalborg Welcome to Aalborg - the fourth largest city of Denmark with 200,000 inhabitants, and a city of contrasts: From ancient Vikings an... | Product Page | Product Page |
| Margaret Cho queers up “Dancing with the Stars” ABC’s Dancing With the Stars isn’t just back, it’s better — with the addition of queer stand-up comic, actress, singer and songwriter Margaret Cho. Paired with Louis Van Amstel, Cho’s first dance this... | News Article | Transcript / Interview |
| Log in Our Mission: To promote the development and growth of Pickleball in the greater Austin, TX area Upcoming Events: ~Tuesday's Winter League begins January 15th. If you missed out on registration but would still like to play, join the sub li... | Content Listing | Organizational About Page |
| Tuesday, January 21, 2014 TTT: Reading Wish List This week's TTT topic: Things on My Reading Wishlist 1. Friendships I love romance, don't get me wrong. But friendship is an important part of everyone's life too and I love reading stories (such as... | Personal Blog | Discussion Forum / Comment Section |
| Published Sex Stories / erotic-novels UnonimousBotch on Erotic Novels "Peter...PEter, wake up". My eyes slowly began to focus, and the face attached to the voice that was hailing me from my deep slumber came into view. The face, and the surroundin... | Creative Writing | Content Listing |
| Burnett leads Yankees to victory - Taipei Times Thu, Apr 16, 2009 - Page 19 News List Burnett leads Yankees to victory NO-HITTER A.J. Burnett struck out nine and walked one as the Yankees tamed Tampa Bay, while Boston’s Daisuke Matsuzaka lasted j... | News Article | News Article |
| Chromosomal aneusomy in bronchial high-grade lesions is associated with invasive lung cancer Am J Respir Crit Care Med. 2008 Feb 1;177(3):342-7. doi: 10.1164/rccm.200708-1142OC. Epub 2007 Nov 7. Rationale: The development of lung cancer (LC) is ac... | Academic Writing | Academic Writing |