Procurement Summary
Country : Belgium
Summary : Agentic Evaluation Interface
Deadline : 12 Jun 2025
Other Information
Notice Type : Tender
TOT Ref.No.: 118312330
Document Ref. No. : 272332-2025
Financier : European Commission
Purchaser Ownership : Public
Tender Value : EUR 1080000
Purchaser's Detail
Name :Login to see tender_details
Address : Login to see tender_details
Email : Login to see tender_details
Login to see detailsTender Details
The objective of this lot is to supply the AI Office with a programmatic interface for the evaluation of General-Purpose Artificial Intelligence (GPAI) models through agentic interaction patterns, i.e. the evaluation of GPAI models for use in tasks requiring multiple decisions and interaction with digital environments such as a browser, command line, or a full operating system. The interface is taken to mean software, methodology, configuration, cloud orchestration and other digital technical components that would allow the AI Office to execute evaluations of GPAI model and their agentic capabilities, without further dependency on the contractor, supplementing and working in tandem with AI Office digital infrastructure. The AI Office is seeking such an interface in the form of a GPAI model evaluation workflow or ‘harness-, and the necessary components thereof, that allow the AI Office and its technical experts to rapidly integrate into the evaluation pipeline new GPAI models and benchmarks across all digital modalities (text, image, video, audio) and from the full spectrum of digital tasks. This harness should provide support for relevant and state of the art elicitation methods and agent scaffolding, including fallback mechanisms that connect text only models to multi-modal benchmarks. It is expected that a significant part of the service will be dedicated to supporting the AI Office in the deployment on Commission infrastructure of existing or developed components of the e...
Document Type: Prior Information Notice
Reference Number: EC-CNECT/2025/OP/0032-PIN
Contract Type: services
Estimated Value: 1080000 - EUR
Authority Type: eu-ins-bod-ag
Doc Title: Agentic Evaluation Interface
Dispatch Date: 2025-04-24
Publish Date: 2025-04-28
Submission Date: 2025-06-12
Documents
Tender Notice