CONTRACT MANAGEMENT
“ Even the best vendors and hyper-scalers will unknowingly introduce trap doors”
Shaz Khan CEO & Co-Founder Vroozi
Testing the algorithm, not just the vendor Under the EU AI Act, high-risk AI providers are required to apply rigorous data governance and bias mitigation, but Shaz argues the real test falls to the buyer, not the regulator.“ Organisations will have a difficult time to certify that an application vendor’ s AI algorithm is biased. Instead, the buyer must conduct a thorough technical algorithm assessment covering the models uses, training data and whether competitor and customer data is pooled, deployment context and strictly defined criteria on what qualifies as a successful bid outcome versus a failed scenario,” says Shaz.
“ Perhaps the biggest change we will see is the extra levels of testing that companies will need to do against their approved thresholds for bid events and the automated shutoff routines that need to be employed if anomalies emerge during a bid event.”
procurementmag. com 111