Fine-tune BERT on AG News

README.md

@@ -0,0 +1,67 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: google-bert/bert-base-uncased
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+model-index:
+- name: bert-ag-news-classifier
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# bert-ag-news-classifier
+
+This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.3244
+- Accuracy: 0.903
+- Precision Macro: 0.9042
+- Recall Macro: 0.9038
+- F1 Macro: 0.9030
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 32
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 0.1
+- num_epochs: 3.0
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision Macro | Recall Macro | F1 Macro |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:---------------:|:------------:|:--------:|
+| 0.3543        | 1.0   | 250  | 0.3029          | 0.898    | 0.8989          | 0.8993       | 0.8989   |
+| 0.2168        | 2.0   | 500  | 0.2823          | 0.911    | 0.9117          | 0.9124       | 0.9116   |
+| 0.1242        | 3.0   | 750  | 0.2767          | 0.925    | 0.9256          | 0.9255       | 0.9255   |
+
+
+### Framework versions
+
+- Transformers 5.6.2
+- Pytorch 2.11.0+cu130
+- Datasets 4.8.4
+- Tokenizers 0.22.2

confusion_matrix.csv

@@ -0,0 +1,5 @@
+,pred_World,pred_Sports,pred_Business,pred_Sci/Tech
+true_World,230,6,15,15
+true_Sports,2,243,0,1
+true_Business,3,2,211,30
+true_Sci/Tech,7,0,16,219

error_analysis.csv

@@ -0,0 +1,98 @@
+confidence,gold,predicted,text
+0.9966913461685181,Business,Sports,Special to ESPN.com It #39;s the age old question: quot;What do you give to the man who #39;s been everything? quot;. Only time will tell whether Phil Knight #39;s retirement will be as long-lived as so many players he paid to endorse Nike.
+0.9949215054512024,Sci/Tech,World,"Another homicide in Holland It is a sad day. In what seems to be another politically inspired homicide in Holland, Dutch filmmaker, and controversial columnist Theo van Gogh was brutally murdered in the streets of Amsterdam this morning."
+0.993634819984436,World,Sports,"Men Set for Sizzling Duel in 100 Meters ATHENS, Greece - The preliminaries in the 100 meters were perhaps just a sample of what's to come Sunday, when a talented group of qualifiers - including Americans Shawn Crawford, Justin Gatlin and defending champion Maurice Greene - will try to turn their competition into the fastest show at the Athens Games. Five men broke 10 seconds in qualifying Saturday, led by Crawford's time of 9.89..."
+0.9919122457504272,World,Business,"US economic growth slips to 2.8 Annual US economic growth fell to 2.8 in the second quarter of 2004, marking a slowdown from the 3 estimated a month ago."
+0.9908484220504761,World,Business,Lackluster Jobs Report Pushes Stocks Down NEW YORK - Investors pushed stocks lower Friday as a surprisingly lackluster job creation report deepened Wall Street's pessimism over the health of the economy. A solid earnings report from General Electric Co...
+0.9908419847488403,Business,Sci/Tech,"Google #39;s New PC Search Tool Poses Risks NEW YORK Oct. 18, 2004 - People who use public or workplace computers for e-mail, instant messaging and Web searching have a new privacy risk to worry about: Google #39;s free new tool that indexes a PC #39;s contents for quickly locating data."
+0.9904844760894775,Sci/Tech,Business,"Lockheed Profit Jumps on IT, Jet Demand <p>\</p><p> NEW YORK (Reuters) - No. 1 U.S. defense contractor Lockheed\Martin Corp. <LMT.N> reported a 41 percent rise in quarterly\profit on Tuesday, beating Wall Street forecasts, as demand\soared for its combat aircraft and information technology\services.</p>"
+0.9891707301139832,Business,World,"South Korea planning huge spending to revive economy: report (AFP) AFP - The South Korean government is preparing a huge quot;New Deal quot; spending package in the next few years to revive the country's sagging economy, Yonhap news agency said."
+0.9887511134147644,Business,Sci/Tech,AOL's Viral Marketing America Online will now provide gratis antivirus protection to its subscribers.
+0.9885305762290955,Business,Sci/Tech,"US consumers unaware of spyware The findings come in a report from the newly formed Consumer Spyware Initiative, a joint effort by Dell and the non-profit Internet Education Foundation that aims to increase awareness of spyware."
+0.9880865812301636,Business,Sci/Tech,"MOM 2005 Released to Manufacturing Microsoft on Wednesday announced the release to manufacturing of Microsoft Operations Manager (MOM) 2005 and MOM 2005 Workgroup Edition, a new edition that the company previously called MOM 2005 Express."
+0.9877195358276367,Business,Sports,"Two hurricanes = two deductibles Many homeowners in the Orlando area suffered a double blow when hurricanes Charley and Frances struck in quick succession. Now, they #39;re smarting from a financial one-two punch - two insurance deductibles."
+0.9876984357833862,Sci/Tech,Business,"Amazon.com net sales jump 29; Google reports \$52M in net income OCTOBER 22, 2004 (IDG NEWS SERVICE) - Amazon.com Inc. fell a penny short of analysts #39; per-share earnings expectations, while reporting net sales of \$1."
+0.9876086711883545,World,Sci/Tech,"Mars water tops science honours The discovery that salty, acidic water once flowed across the surface of Mars has topped a list of the 10 key scientific advances of 2004."
+0.9874858260154724,Business,Sci/Tech,Halo 2 scores record sales of \$125 million in first 24 hours Halo 2 broke entertainment retail records in its first 24 hours. Microsoft Game Studios said that the video game sold through 2.4 million stores in the US and Canada raking in \$125 million in sales.
+0.9869062304496765,Sci/Tech,Business,"Zingo keeps Manganese Bronze in red (FT.com) FT.com - Losses from its Zingo mobile phone cab-ordering service kept Manganese Bronze Holdings, maker of London taxis, in the red last year."
+0.9865545034408569,World,Sci/Tech,"Paris Tourists Search for Key to 'Da Vinci Code' (Reuters) Reuters - A funny thing happened on the way to the\Mona Lisa. Visitors to the Louvre museum in Paris, home of the\world's most famous painting, started quizzing tour guides\about Dan Brown's best-selling novel ""The Da Vinci Code."""
+0.9863154292106628,World,Business,"Schwarzenegger Vows to Defend Emissions Law Toyota, General Motors and seven other automakers filed suit to block California's new greenhouse gas regulation, which was approved by the state in September."
+0.9861223101615906,Business,Sci/Tech,"SBC links e-mail, voice messages, fax SBC on Monday announced a new service that integrates voice messages, faxes and e-mails into a single mailbox that can be accessed from anywhere by phone or the Internet."
+0.9858394861221313,World,Sci/Tech,Telescope snaps distant 'planet' The first direct image of a planet circling another star may have been obtained by a US-European team of astronomers.
+0.9856246709823608,Business,Sci/Tech,"Hasbro's No Conehead Its Saturday Night Live version of ""Trivial Pursuit"" is good strategy for staying ahead of age compression."
+0.9849280118942261,World,Sports,US edge out Brazil for gold The United States beat Brazil 2-1 in extra time to win the women's Olympic football tournament.
+0.9848041534423828,World,Business,"Cocoa prices down but Ivorian exports still blocked World cocoa prices were down on Tuesday but off the day #39;s lows as exports remained on hold after mob violence and military clashes in Ivory Coast, the key global supplier, traders said."
+0.9837852716445923,World,Business,"ASEAN moves closer to single market with #39;road map #39;, global trade <b>...</b> JAKARTA : ASEAN finance ministers ended a meeting which saw Southeast Asia edge closer to a Europe-style single market, laying out a quot;road map quot; for integration and opening doors to wider global trade."
+0.9836159348487854,World,Sports,Greek weightlifter awaits verdict Greek weightlifter Leonidas Sampanis will find out on Sunday if he is to be stripped of his medal.
+0.9820625185966492,Sci/Tech,Business,"Hyundai signs deal for China truck plant Hyundai Motor Co. said yesterday that it has signed an agreement with a Chinese company, Jianghuai Automobile Corp., to build a commercial vehicle and engine plant in China #39;s Anhui province."
+0.9804061651229858,Business,Sci/Tech,AOL Files Lawsuit Against IM #39;Spim #39; America Online Inc. said Thursday it had filed a federal lawsuit accusing numerous unnamed defendants of violating federal and state laws by sending bulk messages known as quot;spim quot; to instant message accounts and Internet chat rooms.
+0.9792817831039429,World,Business,BSkyB sees profits rise after strong subscriber growth (AFP) AFP - British satellite broadcaster BSkyB said profit rose by 16 percent in the first quarter as the group enjoyed strong subscriber growth in the run-up to the key Christmas trading period.
+0.9784122109413147,World,Sci/Tech,"Stability Control Systems Can Save Lives (AP) AP - Stability control systems could save up to 7,000 lives each year if they were standard equipment on all vehicles, according to a study by the insurance industry."
+0.9783554077148438,World,Sci/Tech,"Ancient fungus 'revived' in lab Fungus from a deep-sea sediment core that is hundreds of thousands of years old will grow when placed in culture, scientists discover."
+0.9783084988594055,World,Sci/Tech,Swedes beam poetry into outer space (Reuters) Reuters - Swedish poets have broadcast their work into outer space by radio to give alien life forms -- if they exist -- a taste\of earthling literature.
+0.9754242897033691,World,Sci/Tech,European Press Review: Climate Change European editorials on Monday commented on the results of the local elections in the western German state of North Rhine-Westphalia.
+0.9730115532875061,World,Sci/Tech,"Dogs said to smell cancer signs LONDON -- It has long been suspected that man's best friend has a special ability to sense when something is wrong with us. Now, the first experiment to verify that scientifically has demonstrated that dogs are able to smell cancer."
+0.9713349342346191,Sci/Tech,Business,"Corning begins work on Taiwan LCD facility Encouraged by the demand for LCDs, glass maker Corning on Thursday said it has broken ground for a second manufacturing facility in Taiwan."
+0.9704983234405518,Business,Sci/Tech,"Siemens Says Cellphone Flaw May Hurt Users and Its Profit Siemens, the world #39;s fourth-largest maker of mobile phones, said Friday that a software flaw that can create a piercing ring in its newest phone models might hurt earnings in its handset division."
+0.9686391949653625,World,Sci/Tech,"Why Putin is backing Kyoto again Why did Russian President Vladimir Putin decide to ratify the Kyoto Protocol on climate change last week, only six months after his top adviser, Andrei Illarionov, called it a quot;death treaty?"
+0.9680674076080322,Sci/Tech,World,"Rivals Try to Turn Tables on Charles Schwab By MICHAEL LIEDTKE SAN FRANCISCO (AP) -- With its low prices and iconoclastic attitude, discount stock broker Charles Schwab Corp. (SCH) represented an annoying stone in Wall Street's wing-tipped shoes for decades..."
+0.9678860902786255,Business,Sci/Tech,"PeopleSofts big bash See you next year in Las Vegas , proclaimed a marquee at the PeopleSoft user conference in San Francisco in late September. It was one of many not-so-subtle attempts by the company to reassure its customers"
+0.9677106142044067,World,Business,"\$78,000 for a Cane That Helped a Legend Walk the Line Many of Johnny Cash's possessions were sold at Sotheby's, collecting \$3,984,260 for the Cash family, more than double the pre-auction estimate."
+0.9663767218589783,World,Sci/Tech,"EPA May Conduct Human Tests for Chemicals (AP) AP - In setting limits on chemicals in food and water, the Environmental Protection Agency may rely on industry tests that expose people to poisons and raise ethical questions."
+0.9653780460357666,Sci/Tech,World,"Training is the Key to Defibrillator Success By DANIEL YEE ALPHARETTA, Ga. (AP) -- Because defibrillators are more affordable than ever, they are quickly becoming commonplace in schools, businesses and other public places such as airports..."
+0.964113712310791,Business,Sci/Tech,SBC calling on cable SBC is teaming up with Microsoft to provide consumers with a new way to view television -- a move that puts it in direct competition with the cable TV industry.
+0.9629241228103638,Business,Sci/Tech,"No tax on Internet access until at least 2007 Consumers won #39;t have to pay a tax to log on to the Internet until at least 2007, after Congress voted Friday to renew a recently lapsed ban on Internet taxation."
+0.9567448496818542,Business,Sci/Tech,"Vodafone begins 3G service Vodafone launches its third-generation services for mobile phones, offering video calls, music downloads and games."
+0.9553869366645813,World,Sports,"Ken Caminiti, 1996 NL MVP, Dies at Age 41 NEW YORK - Ken Caminiti, the 1996 National League MVP who later admitted using steroids during his major league career, died Sunday. He was 41..."
+0.9358285665512085,Sci/Tech,Business,"Fujitsu Siemens profit grows 60 percent Fujitsu Siemens Computers (Holding) BV, Europe #39;s largest remaining computer manufacturer, posted a 60 percent leap in profit for the first half of its fiscal year on higher sales of laptops and servers to business customers, the company said Wednesday."
+0.9256702661514282,Sci/Tech,World,'Cities in crisis' leaders warn World leaders warn that rapid urbanisation will become one of the biggest challenges of the 21st Century.
+0.922490656375885,Business,Sci/Tech,"Important Rules for Phone Market Face F.C.C. Vote Next week, the FCC will likely change the rules on unbundled networks largely in ways favorable to the Regional bells."
+0.9216263294219971,Business,Sci/Tech,"Symantec Said to Be in Talks for Veritas Symantec, which produces the Norton line of computer products, is in talks to acquire Veritas Software, a maker of data backup programs."
+0.9185373783111572,Business,Sci/Tech,"Microsoft vs Sendo: It #39;s over The legal battle between UK phone manufacturer Sendo and Microsoft has been settled, the companies announced on Monday morning. Sendo had been suing Microsoft for the alleged theft of trade secrets, fraud"
+0.9137036204338074,World,Business,India's Tata expands regional footprint via NatSteel buyout (AFP) AFP - India's Tata Iron and Steel Company Ltd. took a strategic step to expand its Asian footprint with the announcement it will buy the Asia-Pacific steel operations of Singapore's NatSteel Ltd.
+0.9107791781425476,World,Sci/Tech,Plutonium: rising terror threat The radioactive element could be used to make weapons just as dangerous as enriched uranium bombs.
+0.9097115993499756,Sci/Tech,Business,PeopleSoft revises third-quarter profit Oracle target adds \$2.6 million to bottom line after tax adjustment related to ex-CEO's severance package.
+0.9084677696228027,World,Sci/Tech,"Black Market in British Treasure Sold on EBay (Reuters) Reuters - Pieces of Britain's past, including a\second-century silver ring and a 500-year-old Tudor trade\weight, are among artifacts being peddled daily on the Internet\to the alarm of experts at the British Museum."
+0.9064467549324036,Business,Sci/Tech,Disney Rules Out New Deal with Pixar Studios In January Disney and Pixar terminated their talks to extend a distribution partnership that has created such cartoon hits as quot;Finding Nemo quot; and the quot;Toy Story quot; series.
+0.9032207727432251,World,Business,"Internet pioneer closes Manitoba pharmacy; blames dollar, uncertain climate (Canadian Press) Canadian Press - WINNIPEG (CP) - Just one year ago, Mark Rzepka was opening a #36;1-million Internet pharmacy in the small Manitoba town of Niverville believing he would be able to quadruple his staff within 12 months."
+0.8972935676574707,World,Business,APEC Ministers Urge New Effort on Trade Talks Pacific Rim trading nations said on Wednesday they should pool their influence to energize talks to free up world trade. As trade and foreign ministers from the 21-member Asia-Pacific
+0.8847885727882385,World,Sports,Football: Brazil legend's UK debut Brazil football great Socrates is set to make his debut for non-league Garforth Town on Saturday.
+0.8775404095649719,Sci/Tech,Business,Final Round in Cable-ISP Fight The U.S. Supreme Court has agreed to hear whether cable operators must give access to their lines to third-party ISPs. Michael Grebb reports from Washington.
+0.8736421465873718,Sci/Tech,Business,"Travelocity Says Speed Is the Ticket For Growth Sam Gilliand, the chief executive of Travelocity, talks about the online travel industry, the Cendant-Orbitz merger and the woes of the airline industry."
+0.8648804426193237,World,Sci/Tech,"Breast scans 'fail' in some women Some women with breast cancer are less likely to have their tumours picked up by scans, say experts."
+0.8632648587226868,World,Business,"A Bit of Wall St. on the Tigris The 150 brokers and traders on the Iraq Stock Exchange are not waiting for the war to end, buying and selling orders a few hundred yards away from the fighting."
+0.8378040194511414,Business,Sci/Tech,"Storms Seem to Cure Floridians of Hurricane Amnesia The state #39;s East Coast hadn #39;t been hit by a hurricane since 1999. That, and the fact that Florida hasn #39;t had its historic share of such storms in recent decades, has led to some complacency about their effects."
+0.8290336728096008,Business,Sci/Tech,"Movies in a snap: Netflix and TiVo discuss downloads Bee Staff Writer. The high-tech ground is shifting underfoot again, amid rumblings of a new Silicon Valley alliance that would let owners of TiVo Inc."
+0.8274218440055847,Business,Sci/Tech,"Nextel and Sprint in talks on possible merger Nextel and Sprint are in talks that could lead to a merger between the two mobile phone operators, sources close to the discussions said on Thursday."
+0.8150805830955505,World,Sci/Tech,Russian Parliament Ratifies Kyoto Pact (AP) AP - The Kyoto Protocol overcame its final legislative hurdle in Russia when the upper house of parliament ratified the global climate pact Wednesday and sent it on to President Vladimir Putin for his signature #151; setting the stage for the treaty to come into force next year.
+0.8009431958198547,Business,Sci/Tech,Skyboxes May Reach A Limit Verizon Communications Inc. would seem to be a prime candidate to snap up a luxury suite at the \$440 million ballpark being planned for Washington's Major League Baseball team.
+0.800722599029541,Business,Sci/Tech,Touchy Times at Midas The auto maintenance company has a simple business but a complicated prognosis.
+0.7952063679695129,Business,World,"France joins Germany, Japan in economic slide (AFP) AFP - The French economy hit a rough patch in the third quarter, throwing the government's full-year growth target into question amid signs of an economic slowdown in the 12-nation eurozone."
+0.7810276746749878,Business,Sci/Tech,"Bedding Blip? Go Back to Sleep This is getting old. Every time Hidden Gems selection Select Comfort (Nasdaq: SCSS) gets settled in and ready for a long night #39;s rest full of dreams of two-times-in-three-years capital gains, along"
+0.7582210898399353,Business,Sci/Tech,"IBM, LG Electronics to End Joint Venture International Business Machines Corp. and LG Electronics Inc. will end an eight-year alliance that helped expand the US computer maker #39;s presence in the booming South Korean PC market."
+0.7142734527587891,Sci/Tech,World,UN 'must ignore cloning ban call' The UK's Royal Society urges the UN to ignore a call by President Bush to ban all forms of human cloning.
+0.7045448422431946,Business,Sci/Tech,"Microsoft, EU Officials in Procedure Meeting Microsoft (Quote, Chart) and representatives of the European Union #39;s Competition Commission will sit down at the table together on Thursday, but it won #39;t be to eat."
+0.7011252045631409,World,Business,"Oil Surges to New Intraday High in Europe (AP) AP - The price of crude oil surged to a new intraday high of US #36;53.42 in European trade Monday, despite assurances from Middle East oil producers that they were committed to bringing the price down as a strike began in Africa's largest exporter."
+0.6848811507225037,Business,Sci/Tech,"CA to buy Netegrity for \$430 million com October 6, 2004, 7:36 AM PT. This fourth priority #39;s main focus has been improving or obtaining CRM and ERP software for the past year and a half."
+0.6810747385025024,Business,Sci/Tech,"Bipartisan Panel Seeks Greenhouse Gas Limits A bipartisan commission that includes energy industry executives, environmentalists and academics will issue a report Wednesday that calls on the nation to adopt mandatory limits on greenhouse gas emissions linked to global warming, set stricter fuel economy standards and promote nuclear power, renewable energy and oil exploration."
+0.6726952791213989,Sci/Tech,World,"The battle for DR Congo's wildlife As donors pledge \$40m to save DR Congo's wildlife, life in Virunga Park remains a battle ground."
+0.67237788438797,Sci/Tech,Business,Update: PeopleSoft board won't negotiate Oracle takeover PeopleSoft executives said over the weekend that they won't discuss a sale to Oracle at a price of \$24 per share but would consider an offer at a higher price.
+0.6690238118171692,Sci/Tech,Business,Flat-screen TV prices are falling for holidays But trend provokes industry unrest; panel makers call for drop in retail markups to move units. By Evan Ramstad and Gary McWilliams.
+0.664328932762146,Sci/Tech,Business,"Boeing casts eyes on live TV over Connexion service The Boeing Co. is planning to add live television to its Connexion by Boeing service during 2005, a company executive said in a recent interview."
+0.6540976762771606,World,Sci/Tech,"Canadian freedoms 'under threat' Personal freedoms in Canada are being eroded by the ""war on terror"", the country's privacy commissioner warns."
+0.6521139144897461,Business,Sci/Tech,"Intel dauphin Otellini becomes king Intel #39;s board has given the go ahead for the long anticipated shift in power from current CEO Craig Barrett to current President Paul Otellini Come May 18, Otellini will take over the chipmaker and become its fifth ever CEO."
+0.6511443853378296,Sci/Tech,Business,Half.com to continue at full speed This fourth priority #39;s main focus has been improving or obtaining CRM and ERP software for the past year and a half. Online auction giant eBay won #39;t be closing down its Half.
+0.6467035412788391,Sci/Tech,Business,"Supreme Court Hears Wine Sales Case Winemakers who want to ship directly to consumers across state lines got a sympathetic hearing at the Supreme Court today, as the justices heard oral arguments in a case that could have a dramatic effect on Internet commerce and states' power to regulate the alcohol trade."
+0.6227477192878723,Business,World,"Strikes at London airports London - A 48-hour strike by aircraft refuellers at London Heathrow airport got under way on Friday, with baggage handlers at Gatwick airport also preparing to walk out, threatening a weekend of travel disruptions."
+0.6114665865898132,Business,Sci/Tech,Jury Orders Medtronic to Pay \$109 Mln to Inventor A jury in federal court in Tennessee has ordered Medtronic Inc. to pay at least \$109 million to an inventor in a dispute over rights to spinal fusion technology.
+0.5924298167228699,World,Sports,"Dodgers Nip Giants 3-2 in Crucial Series SAN FRANCISCO - Shawn Green can sit out Saturday knowing he was a huge help to the Dodgers during their crucial series against San Francisco. Green hit a two-run homer in Los Angeles' 3-2 victory over the Giants on Friday night, a day before the first baseman will miss a game to observe the Jewish holiday Yom Kippur..."
+0.5794382095336914,Sports,Sci/Tech,"Paterno #39;s real tragedy may be not knowing when to go Joe Paterno often has talked about the profound impact that a piece of classic literature has had on his life. While a student at Brooklyn Prep in the early 1940s, he devoured TheAeneid, written by the Roman poet Virgil."
+0.5644074082374573,World,Business,Next Big Hit at the Modern: Its Reopening The buzz over the greatly enlarged museum is expected to turn into a cacophony on Saturday.
+0.542029619216919,Sci/Tech,Business,"Gates: US Need Not Fear Overseas Tech The United States has nothing to fear from rapidly growing technology markets in China and India, Bill Gates, chairman and chief software architect of Microsoft Corp."
+0.531053900718689,Business,Sci/Tech,"Oracle v. Peoplesoft: the joke is on... Opinion I thought it was a joke when Oracle first announced that it was going to try to buy PeopleSoft; or, at best, a spoiling tactic over PeopleSoft #39;s acquisition of JD Edwards."
+0.5225266814231873,Sports,World,"Bekele, Isinbayeva top track athletes Names Ethiopian distance runner Kenenisa Bekele and Russian pole vaulter Yelena Isinbayeva were named male and female athletes of the year by the world track and field federation. Isinbayeva set eight world records in 2004, including one while winning the gold medal at the Olympics. Bekele won the 10,000 meters in Athens and finished second to Hicham El Guerrouj in ..."
+0.5219687223434448,World,Business,"Iraqi oil exports slump: report NEAR daily attacks on pipelines and pumping stations had pushed down Iraq #39;s oil exports to their lowest point in nearly a year, Britain #39;s Financial Times newspaper reported today."
+0.5215950608253479,World,Business,"Bookies take bets on new Band Aid Bookies take bets on a new Band Aid single being Christmas No 1, expected to be confirmed by Midge Ure."
+0.5137208104133606,Sci/Tech,Business,"Citrix buying VPN company Net6 for \$50 million BOSTON - Citrix Systems is buying Net6, a privately-held maker of SSL (Secure Socket Layer) VPN (Virtual Private Network) technology, for \$50 million cash, Citrix said Tuesday."
+0.4948706030845642,Sci/Tech,World,"Greek, British Police Break Illegal Software Ring Greek and British police in a joint operation cracked a multi-million illegal software sales ring, arresting two people and seizing thousands of pirate high-tech software programs, Greek police said on Friday."
+0.47541800141334534,Sports,World,"America #39;s curse There is an all but unanswerable case for asserting that the biggest story out of the United States this week has nothing to do with the presidential election, has no connection with the flu vaccine shortage and that it does not involve a gay bishop either"

metrics.json

@@ -0,0 +1,80 @@
+{
+  "validation": {
+    "eval_loss": 0.2767476737499237,
+    "eval_accuracy": 0.925,
+    "eval_precision_macro": 0.925570742872052,
+    "eval_recall_macro": 0.9255228515093903,
+    "eval_f1_macro": 0.9255146729217065,
+    "eval_runtime": 1.5237,
+    "eval_samples_per_second": 656.278,
+    "eval_steps_per_second": 21.001,
+    "epoch": 3.0
+  },
+  "test": {
+    "eval_loss": 0.32440805435180664,
+    "eval_accuracy": 0.903,
+    "eval_precision_macro": 0.9042141584915601,
+    "eval_recall_macro": 0.9037871967764604,
+    "eval_f1_macro": 0.9030096095118452,
+    "eval_runtime": 1.5194,
+    "eval_samples_per_second": 658.149,
+    "eval_steps_per_second": 21.061,
+    "epoch": 3.0
+  },
+  "classification_report": {
+    "World": {
+      "precision": 0.9504132231404959,
+      "recall": 0.8646616541353384,
+      "f1-score": 0.905511811023622,
+      "support": 266.0
+    },
+    "Sports": {
+      "precision": 0.9681274900398407,
+      "recall": 0.9878048780487805,
+      "f1-score": 0.9778672032193159,
+      "support": 246.0
+    },
+    "Business": {
+      "precision": 0.871900826446281,
+      "recall": 0.8577235772357723,
+      "f1-score": 0.8647540983606558,
+      "support": 246.0
+    },
+    "Sci/Tech": {
+      "precision": 0.8264150943396227,
+      "recall": 0.9049586776859504,
+      "f1-score": 0.863905325443787,
+      "support": 242.0
+    },
+    "accuracy": 0.903,
+    "macro avg": {
+      "precision": 0.9042141584915601,
+      "recall": 0.9037871967764604,
+      "f1-score": 0.9030096095118452,
+      "support": 1000.0
+    },
+    "weighted avg": {
+      "precision": 0.9054493360411464,
+      "recall": 0.903,
+      "f1-score": 0.903216070678353,
+      "support": 1000.0
+    }
+  },
+  "labels": {
+    "0": "World",
+    "1": "Sports",
+    "2": "Business",
+    "3": "Sci/Tech"
+  },
+  "training_config": {
+    "base_model": "google-bert/bert-base-uncased",
+    "dataset": "fancyzhx/ag_news",
+    "max_length": 256,
+    "train_batch_size": 16,
+    "eval_batch_size": 32,
+    "learning_rate": 2e-05,
+    "num_epochs": 3.0,
+    "weight_decay": 0.01,
+    "warmup_ratio": 0.1
+  }
+}