Unveiling Referencing on Anthropic's API Technical Upgrade
New API Feature: Citations Enhances Accountability in AI-Generated Responses
In a significant leap forward for AI technology, the new API feature Citations is now available, offering a more accountable approach to AI-generated responses. This innovative feature is set to revolutionise the way developers create AI solutions across various use cases, from document summarization to complex Q&A and customer support.
At the helm of this development is Jake Heller, the founder of Casetext and Head of Product at CoCounsel by Thomson Reuters. With years of experience in building AI tools for lawyers, Heller led the development of CoCounsel, an AI legal assistant that leverages GPT-4 for legal research and contracts. CoCounsel was acquired by Thomson Reuters in 2023.
Citations works by processing user-provided source documents (PDF documents and plain text files) and chunking them into sentences. These chunked sentences, along with user-provided context, are then passed to the model with the user's query. The AI model generates a response that includes precise citations based on the provided chunks and context for any claims derived from the source material.
One of the key benefits of Citations is its ability to address the need for verifying the sources behind AI-generated responses. By providing detailed references to the exact sentences and passages it uses to generate responses, Citations ensures a higher level of transparency and trust in the AI's outputs.
In document summarization, Citations can generate concise summaries of long documents with each key point linked back to its original source. This feature minimises hallucinations, where the AI may inadvertently generate information not present in the source material.
In customer support, Citations can create support systems that can answer complex queries by referencing multiple product manuals, FAQs, and support tickets, always citing the exact source of information. This ensures that responses are accurate and reliable, reducing the risk of misinformation.
Citations is also proving to be beneficial in complex Q&A, where it can provide detailed answers to user queries across a large corpus of documents, with each response element traced back to specific sections of relevant texts.
Thomson Reuters uses Claude to power their AI platform, CoCounsel, for citing and linking to primary sources. The built-in citation capabilities of Claude are outperforming most custom implementations, increasing recall accuracy by up to 15%.
Endex is another company benefiting from Claude's new feature. They use Claude to power an Autonomous Agent for financial firms, reducing source hallucinations and increasing references per response.
The new API feature Citations is now generally available in Amazon Bedrock. It is also available on the Anthropic API and Google Cloud's Vertex AI. Users can provide their own chunks for the source documents if they prefer.
Citations is available for the new Claude 3.5 Sonnet and Claude 3.5 Haiku models. Users will not pay for output tokens that return the quoted text itself, making it a cost-effective solution for developers.
With Citations, developers can create AI solutions that offer enhanced accountability across various use cases, ensuring that AI-generated responses are transparent, reliable, and trustworthy.
Read also:
- User Data Analysis on Epic Games Store
- Rachel Reeves conducts a discussion with Scott Bessent and financial executives, focusing on investment matters
- Hyundai accelerates production plans: Introducing 7 new N models, aiming for a sales figure of 100,000 units by 2030.
- Yasa, an electric car engine producer, plans to broaden its operations.
