Senate Education and Employment Legislation Committee, , 35:08 to 37:19
Concerns raised about Deloitte's use of AI and potential hallucinations in reports, and the department's oversight of AI usage in major contracts.
Topics: Artificial intelligence, Procurement
Speakers: Senator Matt O'Sullivan, Mr. Tony Cook, Mr. Craig Boyd, Unknown Speaker
Uh in the last couple weeks, Deote was heavily criticized for the inclusion of AI slop in its W University merger report >> and the Australian welfare compliance report which included hallucinations and fake references. Given you've got so much important work associated with and delegated to Deote, have you taken steps to assure yourself about Deoit's use of AI in these very important core education and childare contracts?
>> Thank you, Senator. >> We had I don't know which contractors we had written to, I think, about AI previously, or have we not? I'll just check with my team. So what >> I'm just trying to work out whether we've actually written to any of our contractors around AI. I'm just asking Mr. Marovage or not.
>> We do have clauses included in the contracts. Y >> so if the department is undertaking something we do have standard clauses around the use of AI by the provider or the vendor um in this case. Uh and then we have processes within the department where the expectation is all of that output uh the reports for example would be reviewed by officers in the
>> in terms of ISP for example which is a significant work that Deoid's doing that doesn't involve II in terms of reports it's about processing and and providing advice to us the one that we particularly will be looking at is the service delivery price we haven't got I don't have a report from the service delivery price but it's a fair point about us assuring ourselves that what Deoit's doing around the SDP um if they're using AI they need to tell us about that to be explicit about it and
>> hallucinations right we've all used it we've seen how it spit out some pretty spearious results and
>> yeah,
>> we don't need any more hallucinations when it comes to um pricing in childare.
>> Yeah,
>> people can see it for themselves how the costs have been going up significantly. >> Um okay, a tech uh I want to ask about their establishment costs. The your report refers to a memorandum of understanding with a techch around corporate enabling services. How much did education spend establishing a tech