Home Office asylum AI flunks one in five accuracy checks

The Home Office's latest attempt to speed up asylum decisions with AI has hit an awkward snag: a new report says more than one in five interview summaries checked by experts failed accuracy tests. A 20-page investigation by the Open Rights Group (ORG) claims the department is pressing ahead with AI tools despite concerns about their accuracy, oversight, and promised efficiency gains. The findings, based on Freedom of Information requests and correspondence with ministers, concern two systems used by Home Office caseworkers: Asylum Case Summarisation (ACS), which summarizes asylum interviews, and Asylum Policy Search (APS), a chat-style tool helping officials search country policy information. Both use OpenAI's GPT-4o model through Microsoft's Azure AI Foundry. The government insists humans remain responsible for asylum decisions, but ORG questions how reliably caseworkers can spot mistakes in AI-generated information. …