Skip to content

Team AI training guide · By Yes AI

Privacy Act rules for staff using AI tools

Published 6 min read

When a staff member pastes a customer email into an AI tool, the organisation may be using and disclosing personal information. The OAIC has published guidance on this situation. This guide summarises what it means for employers training staff. It is general administrative information, not legal advice.

Quick answer

If your organisation is covered by the Privacy Act, the Australian Privacy Principles apply to personal information staff put into AI tools and to personal information in what those tools produce. As best practice, the OAIC recommends not entering personal information, especially sensitive information, into publicly available generative AI tools. Most businesses with annual turnover of $3 million or less are not covered, with exceptions such as health service providers.

Customer service officer in a Hobart office checking a printed letter before working on her laptop

Does the Privacy Act cover our organisation?

The OAIC explains that a small business with annual turnover of $3 million or less is generally not covered by the Privacy Act on size alone, and lists kinds of small business that are covered regardless of turnover, including those below. If your organisation is covered, everything in this guide applies to staff use of AI tools. If it is not, the guidance still describes sensible practice, and you may have confidentiality duties under contracts or professional rules that apply anyway. Check your position against the OAIC's small business guidance or with a qualified adviser.

  • Health service providers.
  • Businesses that trade in personal information.
  • Contracted service providers under a Commonwealth contract.
  • Small businesses that have chosen to opt in.

What does the OAIC say about staff using AI tools?

The OAIC's guidance on privacy and the use of commercially available AI products, published in October 2024 and updated in January 2025, opens with five takeaways. Privacy obligations apply to personal information put into an AI system and to output that contains personal information. Organisations should do due diligence before adopting a product. APP 6 limits using information for purposes other than the one it was collected for. Privacy policies and notices should explain the organisation's use of AI. And as best practice, organisations should not enter personal information, especially sensitive information, into publicly available generative AI tools.

When is pasting information into an AI tool a secondary use?

Under APP 6, an organisation may use or disclose personal information only for the purpose it was collected for, unless the person consents, or would reasonably expect the secondary use and it is related to the primary purpose, or directly related for sensitive information. The OAIC notes a secondary use may fall within reasonable expectations if it was set out in a collection notice and the privacy policy. For staff, the practical test is whether the customer, patient or employee would expect their details to go into that tool for that task.

Hypothetical example: a staff member pastes a customer's complaint, with name, address and account history, into a free chatbot to draft a reply. Removing the identifying details first, or using the organisation's approved business tool under a rule that permits it, changes the privacy position. Which option is acceptable is for your organisation to decide with its privacy adviser.

Does it matter if the AI output about a person is wrong?

Yes. The OAIC states that inferred, incorrect or artificially generated information about an identified or reasonably identifiable person, including hallucinations, is personal information and must be handled under the APPs. Generating or inferring personal information with AI counts as a collection under APP 3. APP 10 requires reasonable steps to keep personal information accurate, and the OAIC suggests records should show where information came from an AI output, with a person responsible for checking it. For staff, an AI summary of a client's history is a draft until someone has checked it against the source.

What about information about employees?

A private sector employer's handling of employee records is exempt from the APPs when the act or practice is directly related to a current or former employment relationship. The OAIC explains the limits. The exemption does not cover future employment relationships, so it does not apply to job applicants who are not employed. It does not cover contractors handling another organisation's employee information, and it is unlikely to apply to organisations providing recruitment, HR, training or similar services under contract. HR teams using AI on applications should check their position before relying on the exemption.

What should staff training cover?

The OAIC says that controls or prohibitions on including personal information in AI inputs need to be accompanied by training and auditing measures, and that staff training should continue through the life of an AI product. A session should make the rule practical: which tools are approved, which kinds of information never go in, how to remove identifying details when a task allows it, what to check in an output about a person, and what to do after a mistake.

  • Practise on fictional material and check it first: the OAIC describes a chatbot asked for fictional case studies that produced a real case with real names.
  • Show the difference between a business account and a consumer account in your chosen tool.
  • Name the person staff contact if they have entered something they should not have.

Common staff AI tasks and the privacy question each raises

TaskPersonal information involvedQuestion to ask firstLower-risk approach
Drafting a reply to a customer complaintName, contact and account detailsWould the customer expect this use?Remove identifiers, or use the approved business tool under your rule
Summarising meeting notes that name clientsClient names and matters discussedIs the tool approved for client information?Use the approved tool and check the summary against the notes
Screening job applicationsApplicant details, possibly sensitiveWhich privacy rules apply to applicants?Get advice before any AI use on applications
Writing an internal procedureUsually noneDoes the draft include real cases?Use generic descriptions
Creating fictional training scenariosCan appear unexpectedly in outputCould the output describe a real person?Review generated scenarios before use
Analysing a customer spreadsheetNames, purchases and contact detailsIs the analysis within the purpose of collection?Aggregate or remove identifiers first

Practical checklist

  • Confirm whether your organisation is covered by the Privacy Act, and on what basis.
  • List the kinds of information staff must never enter into any AI tool.
  • Check that every exercise uses fictional material that has been reviewed.
  • Confirm which approved tool and account type, if any, may be used with personal information.
  • Name the contact for staff who think they have entered something they should not have.
  • Check whether your privacy policy describes how the organisation uses AI.

Common questions

We are under the $3 million turnover threshold. Does any of this matter?

Possibly less as a matter of law, unless you fall into a covered category such as health service providers. Clients may still expect you to keep their details out of public AI tools, contracts may contain confidentiality terms, and some industries have their own rules. Many small businesses follow the OAIC's guidance as good practice for those reasons. Check your position with a qualified adviser.

Is a business ChatGPT or Copilot account a publicly available tool?

The OAIC's best-practice recommendation is aimed at publicly available generative AI tools. An enterprise product under a business agreement is a different arrangement, but the OAIC still expects due diligence, such as whether the developer can access what you enter, and the APPs still apply to personal information you put in. The account type changes the risk and leaves the obligations in place.

Do we need a privacy impact assessment before staff use AI?

The OAIC says a privacy impact assessment may help an organisation answer the due diligence questions it lists, such as how the product will be used, what data flows through it and who can access that data. For low-risk use on non-personal information, a short assessment may be enough. For use involving customer or health information, a fuller assessment is worth considering.

Should our privacy policy mention AI?

The OAIC says businesses should update their privacy policies and notifications with clear and transparent information about their use of AI, and make sure public-facing AI tools such as chatbots are identified as AI to customers. If staff will use AI on customer information, review the privacy policy and collection notices at the same time as planning the training.

Who can give a definite answer for our situation?

This guide is general information. For a definite answer, speak to a privacy lawyer or your organisation's privacy officer, and read the OAIC's published guidance in full. Bring a list of the specific tasks staff use AI for and the information involved, because the answer depends on those details.

Sources and further reading

Continue planning

Plan a workshop around your team’s work

Describe the roles in your team, the tasks they want to practise and the tools you already use. We can discuss a suitable workshop format and scope. Keep staff records, customer documents and account credentials out of this enquiry.