Skip to main content

Beware: Use of Generative AI Tools for Sensitive Information is Risky Business

Jeffrey I. Snyder, Kenneth Duvall & Ethan D. Schwab

Illustration of a gavel and computer For many, generative AI tools have augmented, if not replaced, aspects of personal and corporate workflow. As of early 2026, between 37 and 50 percent of people use an AI tool as their primary source of information.1 In many industries and daily practices, using AI to brainstorm, streamline communication, and solve problems is not only permitted, but expected.  Recognizing that free, open-source generative AI tools (i.e., ChatGPT) use submitted data to train the model for future responses, many businesses have developed or subscribed to enterprise-tier, closed-end, proprietary AI tools.  These prompts and responses are often logged and retained, thereby creating a record that can later be accessed and potentially discovered.  

So it follows that a user’s prompts and responses are becoming the subject of questioning and depositions, requests for production, and other discovery requests.  Is this information discoverable in litigation?  Is it admissible at trial?  And, if someone crafts a prompt or otherwise uploads sensitive information to a generative AI tool in search of legal advice, is that information protected by the attorney-client privilege? 

Artificial Intelligence and the Attorney-Client Privilege

As a general proposition, where a business user interacts with a generative AI tool (whether or not closed-end) other than possibly at the direction of a licensed attorney, that information is likely discoverable to the same extent that it would be if the same interaction occurred by e-mail between two non-lawyers.  The attorney-client privilege protects communications between a lawyer and a client regarding legal advice and, where the communication does not involve a lawyer or legal advice, its discoverability is plainly not precluded by the attorney-client privilege.2  

Can discovery be avoided when a business user appears to seek legal advice from a generative AI tool? Generally, three elements must be met for a communication to be considered privileged and therefore withheld from discovery: (1) the communication must be between an attorney and a client; (2) the communication must be intended to be, and actually is, kept confidential; and (3) the purpose of the communication is to obtain or provide legal advice.3  

Though AI tools have developed expertise in many professional fields, and despite people treating these tools as personal, trusted advisors—they are not attorneys. In a recent case out of the federal trial court in Manhattan, U.S. v. Heppner, a criminal defendant who anticipated being accused of various offenses in connection with an over $100 million corporate fraud had conversations with a publicly-available consumer version of an AI chatbot, outlining what would constitute his defense strategy and the potential charges that may be levied against him. In a memorandum explaining its ruling in U.S. v. Heppner, Judge Jed S. Rakoff of the United States District Court for the Southern District of New York concluded that “[b]ecause Claude is not an attorney … that alone disposes of Heppner’s claim of privilege.” 4

Whether Claude is a licensed attorney, however, is only the tip of the iceberg with respect to a privilege analysis. What occurs when a communication is made between a lawyer and a client, but the client subsequently uploads that communication to generative AI?  The Heppner court noted that the confidentiality element was breached by uploading the information to the generative AI chatbot, reasoning that many large language models learn from and train on user-inputted data, and that one does not enjoy a reasonable expectation of privacy in information uploaded to these tools.5 Although this may appear to establish a blanket waiver of privilege for any information uploaded to generative AI, emerging private AI models offer businesses access to large language models within a company’s secure environment or servers, blurring the line as to whether the information has been shared with a third party.

The third element of privilege—whether the communication is made with the purpose of seeking legal advice—is similarly challenging to apply to AI tools. While the Heppner court noted that this element was not met because the defendant’s communications with the AI were not made at the direction of counsel, the court acknowledged that it would have been a closer call had the attorney instructed such chats to occur because the AI chatbot could arguably have been acting as a lawyer’s agent. 6  

The Heppner court observed that the defendant having subsequently shared the information generated by the AI chatbot with his counsel did not retroactively “cloak” the information in privilege (although presumably the additive portions of the interaction between the lawyer and client would have been privileged).7 

Artificial Intelligence and the Work Product Doctrine

Similar to the attorney-client privilege, the work product doctrine protects the mental impressions and thought processes of an attorney, allowing counsel to prepare the client’s case without such impressions being subject to discovery by the opposing party.8 The Heppner court concluded that the defendant’s chats were not protected work product because, even if they were prepared in anticipation of litigation as is required for protection, they were not prepared by or at the direction of counsel.9

But a recent case from another federal court—this one out of Michigan, Warner v. Gilbarco—appears to take a different approach. In Warner, the court held that documents uploaded to ChatGPT were protected by work product and that the protection was not waived by the upload—reasoning that waiver of work product protection requires disclosure to an adversary.10 ChatGPT, the Warner court reasoned, “[is a] tool[ ], not [a] person[ ]” and the defendants’ theory that AI use waives work product “would nullify work-product protection in nearly every modern drafting environment, a result no court has endorsed.”11 These divergent outcomes underscore that both the legal framework and the assumptions informing judicial analysis of these tools remain unsettled and evolving.

Bilzin Sumberg’s Confidential, Attorney-Directed AI Use May Preserve Privilege

Where appropriate, Bilzin Sumberg uses enterprise-grade AI platforms that, among other things, prohibit the retention and disclosure of user data to third parties, and only uses these platforms at the direction of a licensed (human) attorney.  Accordingly, the resulting interactions (i.e., prompts and responses) are more likely to satisfy each of the elements of the privilege or work product doctrines or, if they fail to do so, it will not be because of the manner in which the AI platform was utilized or operates (as opposed to, for example, the potential failure of the work product doctrine to apply in a transactional matter where litigation was not reasonably anticipated).

Conclusion

Until courts establish clearer guidance regarding both the attorney-client privilege and the work product doctrine, businesses and individuals should exercise extreme caution before uploading confidential or sensitive information to any generative AI platform and should consult with legal counsel regarding such use.  Clients may also want to implement internal policies governing when and how AI may be used for legal work, including, for example, guidance on platform selection, data handling, and the role of in-house or external legal counsel since courts look at the nature, timing, and objective of an attorney’s involvement, not merely than an attorney was involved .  When seeking legal advice or preparing for potential litigation, communicating directly with retained legal counsel and seeking legal advice only from a licensed attorney is the safest course of action to preserve the protections that the attorney-client privilege and the work product doctrine are designed to provide.

 

1 https://searchengineland.com/consumers-start-searches-ai-not-google-study-467159.
2 https://www.law.cornell.edu/wex/attorney-client_privilege.
3 United States v. Mejia,
655 F.3d 126, 132 (2d Cir. 2011).  
4 U.S. v. Heppner,
--- F.Supp. 3d. ----, 2026 WL 436479 (S.D.N.Y. Feb. 17, 2026).
5 Id. at *6.
6 Heppner at 7.
7 Heppner at __.
8 https://www.law.cornell.edu/wex/attorney_work_product_privilege.
9 Heppner at 9.
10 Warner v. Gilbarco, 20
26 WL 373043, at *4 (E.D. Mich Feb. 10, 2026) (emphasis added)
11
Id.

 
YOU MIGHT ALSO LIKE
Publication October 21, 2025
Artificial intelligence is rapidly reshaping homebuilding, boosting efficiency in design, management, and customer engagement. But as adoption grows, builders face escalating legal risks—from contracts and IP to data privacy and compliance—requiring proactive safeguards.
Client Alert August 26, 2025
Artificial intelligence is rapidly reshaping the homebuilding industry, offering significant benefits in design, project management, and customer engagement. But with these advancements come complex legal challenges—from contractual liability and intellectual property concerns to data privacy,...
Press Release April 28, 2026
The FIFA World Cup 2026™ Miami Host Committee today announced that Florida law firm Bilzin Sumberg has been named an Official Miami World Cup 2026™ Host City Supporter, recognizing the firm’s extraordinary service as legal counsel.
VIEW MORE