Incident library · Government · Australia

    Department of Families, Fairness and Housing (Victoria): Generative AI tools blocked across the department

    A child protection report submitted to court was drafted with ChatGPT. It contained inaccurate information that downplayed risks to a child.
    OVICSep 2024

    Investigation into the use of ChatGPT by a Child Protection worker

    Generative AI tools blocked across the department

    Found by the regulator

    Sensitive case details were entered into a public AI tool, and the department had not put adequate controls or training in place.

    Found by the regulator

    The reported contributing factor

    Sensitive case details were entered into a public AI tool, and the department had not put adequate controls or training in place.

    Incidents usually have several contributing factors. This is the one public reporting names; it is not presented as the sole cause.

    Which StackUp assessment checks for this gap

    Find out if your organisation has this gap

    Sources

    Published Sep 2024. Sources last checked Nov 2026. Spotted an error or an update? Tell us and we will correct it.

    • Forbes AustraliaMay 2023

      Samsung bans ChatGPT among employees after sensitive code leak

      Generative AI restricted company-wide

      Stated by the organisation

      Staff entered confidential source code into a public AI chatbot, without clear rules on what data could be shared.

    • LawSitesJun 2023

      Court Imposes Sanctions On Lawyers Who Filed Bogus Cases After Relying On ChatGPT For Legal Research

      $5,000 sanction and public censure

      Found by the court

      Cases suggested by ChatGPT were filed without anyone checking they were real, and the lawyers stood by them when questioned, the court found.

    • The Irish TimesOct 2022

      Former Uber security chief is convicted of covering up data breach and paying off hackers

      Former security chief convicted

      Found by the court

      The breach was kept from regulators instead of being disclosed, a jury found.

    Find out which of these gaps you have

    The free Readiness Check takes ten questions and shows the incidents tied to your weakest answers.