pwshub.com

AI ruling on jobless claims could make mistakes courts can’t undo, experts warn

AI ruling on jobless claims could make mistakes courts can’t undo, experts warn

Nevada will soon become the first state to use AI to help speed up the decision-making process when ruling on appeals that impact people's unemployment benefits.

The state's Department of Employment, Training, and Rehabilitation (DETR) agreed to pay Google $1,383,838 for the AI technology, a 2024 budget document shows, and it will be launched within the "next several months," Nevada officials told Gizmodo.

Nevada's first-of-its-kind AI will rely on a Google cloud service called Vertex AI Studio. Connecting to Google's servers, the state will fine-tune the AI system to only reference information from DETR's database, which officials think will ensure its decisions are "more tailored" and the system provides "more accurate results," Gizmodo reported.

Under the contract, DETR will essentially transfer data from transcripts of unemployment appeals hearings and rulings, after which Google's AI system will process that data, upload it to the cloud, and then compare the information to previous cases.

In as little as five minutes, the AI will issue a ruling that would've taken a state employee about three hours to reach without using AI, DETR's information technology administrator, Carl Stanfield, told The Nevada Independent. That's highly valuable to Nevada, which has a backlog of more than 40,000 appeals stemming from a pandemic-related spike in unemployment claims while dealing with "unforeseen staffing shortages" that DETR reported in July.

"The time saving is pretty phenomenal," Stanfield said.

As a safeguard, the AI's determination is then reviewed by a state employee to hopefully catch any mistakes, biases, or perhaps worse, hallucinations where the AI could possibly make up facts that could impact the outcome of their case.

Google's spokesperson Ashley Simms told Gizmodo that the tech giant will work with the state to "identify and address any potential bias" and to "help them comply with federal and state requirements.” According to the state's AI guidelines, the agency must prioritize ethical use of the AI system, "avoiding biases and ensuring fairness and transparency in decision-making processes."

If the reviewer accepts the AI ruling, they'll sign off on it and issue the decision. Otherwise, the reviewer will edit the decision and submit feedback so that DETR can investigate what went wrong.

Gizmodo noted that this novel use of AI "represents a significant experiment by state officials and Google in allowing generative AI to influence a high-stakes government decision—one that could put thousands of dollars in unemployed Nevadans’ pockets or take it away."

Google declined to comment on whether more states are considering using AI to weigh jobless claims.

Source: arstechnica.com

Related stories
1 month ago - A reliable source of billions of dollars in income is at risk for the iPhone maker.
6 days ago - Save money on a real interior designer by trying a disembodied one, and watch what it does with your house.
1 month ago - The Microsoft antitrust case didn't lead to the company being dismantled, but the DOJ seems intent on not letting Google off so easily after Judge Amit Mehta's scathing August 5 ruling.Read Entire Article
1 month ago - The first big tech-sector anti-monopoly ruling in a generation challenges the idea that the internet era has outgrown U.S. antitrust law.
3 weeks ago - On Aug. 5, a federal judge ruled that Google illegally maintained a monopoly in search, violating the antitrust laws. While Google remains the...
Other stories
1 hour ago - As an Amazon Prime member, not only do you get a free Grubhub+ membership, you can also score $10 off your first $15 order.
1 hour ago - Amazon's second Prime Day event of 2024 is still a few weeks away, but there are some bargains you can score now.
1 hour ago - YouTube will roll out a new generative AI video tool named Veo later this year that'll allow creators to create 6-second clips with nothing more...
2 hours ago - FBI Director hails successful action but calls it “just one round in a much longer fight.”
2 hours ago - SocialAI takes the social media "filter bubble" to an extreme with 100% fake interactions.