The short answer
No model is compliant by itself. Compliance comes from the tier (consumer vs business/API), the contract (BAA, DPA, zero data retention), the configuration (eligible features only, region pinned) and your own controls. With those in place, regulated data can go to Claude, GPT, Gemini and others today. Without them, even the best model is a reportable disclosure.
- Never use consumer chat apps for regulated data. Free and individual paid plans (Claude Free/Pro/Max, ChatGPT Free/Plus, the free Gemini API tier) may train on your data and offer no BAA or DPA.
- Business and API tiers do not train on your data at Anthropic, OpenAI, Google (paid/Vertex), Microsoft and AWS. Default retention is roughly 0–30 days for abuse monitoring; zero retention is available by approval, with features such as code execution, file storage, batch processing and search grounding excluded. Some newer models (Anthropic's Fable 5/5.1 and Mythos 5/5.1) require 30-day retention and are not available under zero retention.
- HIPAA: all five major routes offer a BAA for eligible services. The BAA covers specific features, not the whole product; anything outside it (web fetch, code execution, your own logging tools) breaks compliance. HIPAA has no certification, so "HIPAA certified" is a red flag.
- Lawyers: yes, officially allowed. ABA Formal Opinion 512 (July 2024) and at least 15 state bars and courts permit AI use under existing duties: competence, confidentiality, informed consent for tools that retain or learn from inputs, verification, supervision and fair billing. The enforcement risk is unverified citations (about 1,600 hallucination cases worldwide by June 2026), not AI use itself. A February 2026 ruling (Heppner) found a defendant's own consumer-Claude chats were not privileged, while two civil courts protected self-represented parties' AI work, so privilege for AI use is still unsettled.
- Government: use only offerings authorized at the data's impact level. Frontier models run at FedRAMP High and DoD IL4/IL5 via AWS GovCloud, Google Assured Workloads and Azure Government, and up to Top Secret in dedicated clouds. Commercial APIs are not the authorized route. Vendor eligibility can change for policy reasons (DoD's 2026 supply-chain designation of Anthropic).
- Privacy law: GDPR needs a DPA, lawful basis and a transfer mechanism (the EU-US Data Privacy Framework is valid but under appeal). The EU AI Act's high-risk rules were delayed to December 2027 / August 2028; transparency duties apply from August 2026. About 20 US state privacy laws are in effect.
- The biggest real-world leak points are on your side: logs, observability tools, vector databases, staff using unapproved tools, and agent tools that send data outside the contract boundary.
Quick answer by provider route for regulated data (details in the matrix below):
| Need | Good routes |
|---|---|
| HIPAA PHI | Claude API (HIPAA-ready), Bedrock, Vertex AI, Azure OpenAI, OpenAI API or ChatGPT Enterprise with BAA |
| Law firm client data | Enterprise/API tier of any major vendor with no training + ZDR where available; legal-specific products built on these |
| EU personal data with EU processing | Azure EU DataZone, Vertex AI EU regions, Bedrock EU regions, OpenAI EU processing |
| US federal sensitive (FedRAMP High) | Bedrock GovCloud, Vertex AI Assured Workloads, Azure Government, Claude for Government |
| DoD CUI (IL4/IL5) | Bedrock GovCloud, Azure Government (subject to DoD vendor restrictions) |
| Classified / air-gapped | Dedicated classified clouds or self-hosted open-weight models |
Is ChatGPT, Claude, Gemini or Copilot HIPAA compliant?
None of them is “HIPAA compliant” by itself, because HIPAA has no certification. The real question is whether the vendor signs a Business Associate Agreement (BAA) for the exact product you use. Consumer plans never qualify; business and API plans can.
| Product | Consumer plans | Business / API with a BAA |
|---|---|---|
| ChatGPT / OpenAI | No BAA for ChatGPT Free, Plus, Pro or Team. | BAA for the OpenAI API by request (reported to require zero or modified retention), and for ChatGPT Enterprise and Edu through sales. |
| Claude / Anthropic | No BAA for Claude Free, Pro or Max. | Claude API with “HIPAA readiness”: sign the BAA in the Console or through sales. Claude Enterprise via sales. Claude Code is not covered. |
| Gemini / Google | No BAA for the Gemini app or the Gemini API in AI Studio. | Vertex AI (including Claude on Vertex) under the Google Cloud BAA. Workspace with Gemini supports HIPAA workloads with some features blocked. |
| Copilot / Microsoft | Only the business Microsoft 365 Copilot is listed as covered; don’t assume other Copilot apps are. | Microsoft 365 Copilot and Azure OpenAI are covered under Microsoft’s BAA in the Product Terms. |
| AWS Bedrock | — | HIPAA eligible under the AWS BAA, for Claude, Llama, Mistral and other hosted models. |
How AI data flows: training, retention and zero data retention
The single biggest factor in AI data risk is not which model you pick but which product tier you send data through. The same model can be safe for client files through an enterprise API under contract, and unsafe through a free consumer chat app.
Inference itself happens in memory and is not the main risk. The risk is the copies: safety logs, stored features, training pipelines, and the logs your own team adds. Every one of these needs an answer before regulated data goes in.
The three tiers, in general terms (provider-specific figures are in the matrix below):
| Tier | Examples | Training on your data | Retention | Contracts available | Fit for regulated data |
|---|---|---|---|---|---|
| Consumer apps (free and paid individual plans) | Claude Free/Pro/Max, ChatGPT Free/Plus/Pro, Gemini app | Often on by default or by user choice; must be switched off per account | Long; chat history kept until deleted, longer if used for training | Consumer terms only. No BAA, no DPA. | No. Never for PHI, client confidences or government data. |
| Business / enterprise apps | Claude Team/Enterprise, ChatGPT Business/Enterprise, Gemini for Workspace, Microsoft 365 Copilot | Off by contract | Admin-controlled; often configurable | DPA standard; BAA on some enterprise plans; SSO, audit logs | Yes, if the right plan, contract and settings are in place. |
| API / cloud platform | Anthropic API, OpenAI API, Vertex AI, Azure OpenAI, AWS Bedrock | Off by default | Short (days) for abuse monitoring; ZDR available on request | DPA standard; BAA and ZDR by agreement; regional processing | Yes. This is the main route for building compliant products. |
Questions every data flow must answer:
- Is the data used to train or improve any model? (Must be no, in writing.)
- How long are inputs and outputs kept, by whom, and why? (Abuse monitoring, legal holds, feature storage.)
- Which model version is used, and does that model carry its own retention requirement? (Anthropic's Covered Models, for example, require 30-day retention even for customers who otherwise have zero retention.)
- Can retention be cut to zero, and which features stop working if it is?
- Where is data processed and stored geographically? (Region, residency, cross-border transfer basis.)
- Who else touches it? (Subprocessors, the hosting cloud, human safety reviewers.)
- What do your systems keep? (Application logs, observability tools, vector databases, backups, prompt caches.) This is where most real-world leaks happen.
- Who inside your organization can see prompts and outputs? (Role-based access, audit logs.)
Legal holds override retention promises. A vendor's deletion promise can be suspended by a court preservation order in litigation against that vendor. That happened to OpenAI in 2025 (see the provider matrix). Zero-retention arrangements are the strongest protection, because there is nothing to preserve.
What “compliant” really means: BAA, SOC 2, FedRAMP and the rest
No AI model is "HIPAA compliant" or "lawyer-approved" on its own. Compliance belongs to a deployment: a specific vendor service, under a specific contract, configured a specific way, used by an organization with its own controls. Badges fall into three kinds, and they prove very different things.
- Contracts create legal obligations for the vendor (BAA, DPA, SCCs, enterprise terms, zero-data-retention addendum). These are what make regulated use lawful.
- Audits and certifications are third-party evidence that the vendor's security program works as described (SOC 2, ISO 27001). They do not make your use compliant.
- Government authorizations are permissions for agencies to use a service at a stated risk level (FedRAMP, DoD IL). They apply to a named cloud offering, not to the vendor as a whole.
| Term | Kind | What it proves | What it does NOT prove |
|---|---|---|---|
| BAA (Business Associate Agreement) | Contract, US HIPAA | Vendor agrees to safeguard PHI, report breaches, limit use. Legally required before a covered entity shares PHI with a vendor. | That every product of that vendor is covered. BAAs list eligible services and often exclude beta features. |
| DPA (Data Processing Addendum) | Contract, GDPR/UK GDPR/state laws | Vendor acts as processor on your instructions; sets subprocessors, transfers, deletion. | That data stays in a given region unless residency is stated. |
| SCCs / EU-US Data Privacy Framework | Contract / certification | A lawful mechanism for moving EU personal data to the US. | That the transfer passes your own risk assessment. |
| Zero Data Retention (ZDR) | Contract addendum | Prompts and outputs are not stored after the response (except abuse/legal exceptions stated in the addendum). | Usually not on by default; must be requested and approved, and some features are excluded. |
| SOC 2 Type II | Audit report (AICPA) | Controls for security (and optionally availability, confidentiality, privacy) operated effectively over an observation period, commonly 3–12 months (the AICPA sets no fixed minimum; many buyers expect at least 6). | Legal compliance with HIPAA, GDPR or bar rules. Type I only covers a single date. |
| ISO/IEC 27001 | Certification | A certified information security management system. | Model behavior or training practices. |
| ISO/IEC 27701 | Certification | Privacy information management on top of 27001. | GDPR compliance by itself. |
| ISO/IEC 42001 | Certification | An AI management system (risk, governance, lifecycle). The first AI-specific management standard (2023). | Accuracy or safety of any one model. |
| HITRUST | Certification | Healthcare-oriented control framework mapped to HIPAA. | A BAA. You still need the contract. |
| FedRAMP (Moderate / High) | US federal authorization | A cloud service may hold federal data at that impact level. High covers the most sensitive unclassified data. | Classified data, or that the agency itself has approved your use. |
| DoD Impact Levels (IL2, IL4, IL5, IL6) | DoD authorization | IL4/IL5 = Controlled Unclassified Information (CUI) and mission data; IL6 = classified SECRET. | That a model is available at that level in every region. |
| StateRAMP / TX-RAMP | State authorization | State and local agencies may use the service. | Federal use. |
| CJIS Security Policy | FBI policy | Rules for criminal justice information (personnel screening, encryption, audit). Met by agreement per state, not a certificate. | That a vendor is "CJIS certified" (no such national certificate exists). |
| ITAR / EAR | Export control law | Defense or controlled technical data must stay with US persons / authorized locations. | Covered by FedRAMP alone. Needs US-person-only support and US data handling, e.g. GovCloud. |
| PCI DSS | Industry standard | Card data handling. | Health or legal data protections. |
What "HIPAA compliant" really means. HIPAA has no certification. The US Department of Health and Human Services (HHS) never certifies products. When a vendor says "HIPAA compliant" or "HIPAA eligible", the only meaningful parts are: (1) they will sign a BAA, (2) the BAA covers the exact service and features you use, and (3) you configure and use it as the BAA requires. The Security Rule obligations (risk analysis, access controls, audit logs, workforce training) stay with you.
Provider matrix: Claude, ChatGPT, Gemini, Azure OpenAI, Bedrock
Every major provider now offers a commercial route with no training on your data, a BAA for eligible services, and some form of zero data retention by approval. They differ on default retention, which features fall outside ZDR or the BAA, regional processing, and government authorization. The route you buy through (direct API vs a cloud platform) changes who the data processor is.
The table scrolls sideways; the first column stays in place.
| Provider / route | Training on your data | Default retention | Zero data retention | HIPAA BAA | Regional processing | Government authorization | Last verified |
|---|---|---|---|---|---|---|---|
| Anthropic Claude API | No, unless you give express permission | Conflicting pages: API docs say prompts and outputs are not retained by default; the privacy center says deleted within 30 days. Treat 30 days as the upper bound. Covered Models (Claude Fable 5/5.1, Mythos 5/5.1) require 30-day retention on every platform. Policy-violation flags up to 2 years | By approval per org. Not eligible: Batch (29-day retention), Files API, Agent Skills, MCP connector, Managed Agents, code execution, programmatic tool calling, dynamic filtering in web search/fetch, any Console usage, and Covered Models unless Anthropic expressly authorizes. The API does not block these under ZDR | Yes ("HIPAA readiness"), self-serve in Console or via sales. Permanent once enabled. Direct API only, not Claude Platform on AWS or Microsoft Foundry. Claude Code not covered. Use a separate org for non-HIPAA work. Server tools outside scope (web fetch, code execution) return a 400 error; client-side browser use is not blocked but is outside scope | US-only inference option (inference_geo: us, 1.1x price); no EU option on the direct API | Direct API not FedRAMP; FedRAMP 20x Moderate for Claude Enterprise in process (gov page) | 2026-10-12 |
| Anthropic Claude Team / Enterprise apps | No (commercial terms) | Admin-configurable | Claude Code for Enterprise eligible | Enterprise plans, via sales | As above | Claude for Government: FedRAMP High via Palantir FedStart | 2026-10-12 |
| Anthropic Claude consumer (Free, Pro, Max) | Since Aug 2025, used for training unless the user opts out; 5-year retention if allowed (announcement) | 30 days if opted out | No | No | No | No | 2026-10-12 |
| OpenAI API | No, unless you opt in (since Mar 2023) | Abuse logs up to 30 days | ZDR or Modified Abuse Monitoring by approval; ZDR forces store=false; excludes Assistants, threads, files, vector stores, fine-tuning, batches, evals, audio | Yes, by request (reported to require zero/modified retention; primary page not reachable) | Storage in 10 regions incl. EU, UK, Canada, Australia, Japan; processing in US, EU, UAE (non-US requires MAM/ZDR) | ChatGPT Enterprise + API: FedRAMP 20x Moderate (announced Apr 2026, OpenAI) | 2026-10-12 |
| OpenAI ChatGPT Business / Enterprise / Edu | No (business terms) | Admin-configurable | Enterprise options | Enterprise and Edu via sales; "ChatGPT for Healthcare" offering; not Team/consumer (secondary sources) | Data residency program | ChatGPT Gov (agency-hosted in Azure) | 2026-10-12 |
| OpenAI ChatGPT consumer | Yes by default; user can opt out | Until deleted | No | No | No | No | 2026-10-12 |
| Google Gemini API, unpaid tier (AI Studio, no billing) | Yes; human reviewers may read prompts. Google says not to submit sensitive data | Not limited | No | No | No | No | 2026-10-12 |
| Google Gemini API, paid tier | No | "Limited period" for abuse; grounding with Search/Maps kept 30 days | No | No (use Vertex) | Paid terms apply to all EEA/UK/Swiss usage | No | 2026-10-12 |
| Google Vertex AI (incl. Claude on Vertex) | No | 24-hour in-memory cache (can disable); abuse logging under GCP terms; Covered Models keep 30 days inside your cloud environment | By exception request; impossible with Search grounding (3 days) or Maps grounding (30 days) | Yes, under Google Cloud BAA | Regional endpoints, EU available | Claude on Vertex + Assured Workloads: FedRAMP High | 2026-10-12 |
| Azure OpenAI / Microsoft Foundry | No; not shared with OpenAI | Abuse monitoring stores flagged prompts for human review by default | Modified abuse monitoring by Limited Access application (ContentLogging=false) | Yes, under Microsoft Product Terms BAA (Claude in Foundry: Anthropic HIPAA readiness not available) | Standard = in your geography; DataZone = US or EU zone; Global = any | Azure Government: FedRAMP High, IL4/IL5 (Microsoft); IL6 and Top Secret clouds authorized | 2026-10-12 |
| Microsoft 365 Copilot | No | Purview-managed | Opted out of Azure OpenAI abuse monitoring | Yes (listed as HIPAA-covered) | EU Data Boundary, but Anthropic models used as a subprocessor are outside the EUDB | GCC / GCC High variants | 2026-10-12 |
| AWS Bedrock (incl. Claude, Llama, Mistral) | No; model providers have no access to prompts or logs | None by default, with model-specific exceptions: Claude Fable 5/5.1 traffic kept up to 30 days for abuse detection; some OpenAI models keep flagged traffic 30 days | Default for most models; check the per-model exception list | Yes, HIPAA eligible under the AWS BAA | Single-region via application inference profile; cross-region profiles move data | Claude in GovCloud: FedRAMP High + DoD IL4/IL5 (Anthropic); Secret/Top Secret regions for Gov models | 2026-10-12 |
| Cohere | Yes for the SaaS API unless you turn it off in the dashboard | Logged prompts and generations deleted after 30 days | Approved enterprise customers (commitments) | Only for custom model development engagements; Cohere says not to send PHI through its SaaS API | SaaS, customer VPC, on-premises, or via OCI, Azure, AWS, Google Cloud (security) | Not found | 2026-10-12 |
| Mistral | Not confirmed on a primary page (third-party sources conflict) | Not confirmed (30 days per third parties only) | Paid plans, stateless calls only (chat, embeddings, moderation, OCR, audio); excludes Agents, Batch, Conversations, Libraries, Files; approved case by case | Not confirmed (one third party says no BAA) | EU-based company and hosting | Not found | 2026-10-12 |
Certifications (where verified). Anthropic lists SOC 2 Type I and II, ISO 27001:2022 and ISO/IEC 42001:2023 (support article). Cohere lists ISO 27001, ISO 42001 and an annual SOC 2 Type II (trust center). AWS, Google Cloud and Microsoft Azure each hold SOC 1/2/3, ISO 27001/27017/27018, HITRUST-mapped controls and FedRAMP High for their government regions; their trust portals list which AI services are in scope. Always download the current SOC 2 report under NDA rather than relying on a logo.
Who is the processor? On Bedrock and Vertex, the cloud provider is your data processor and its BAA/DPA govern, not the model maker's. On the direct Claude API, Claude Platform on AWS and Claude in Microsoft Foundry, Anthropic is the processor (Anthropic docs). This matters when you choose which contract to sign.
Legal holds in practice. In NYT v. OpenAI, a May 2025 order required OpenAI to preserve consumer and API chats it would otherwise have deleted. An October 2025 order ended the obligation going forward (logs after 26 September 2025), but already-preserved logs and NYT-flagged accounts stayed covered; ZDR customers were not affected (Engadget). The lesson applies to every vendor: retention promises can be suspended by litigation.
Verification gaps. OpenAI's help-center pages on BAAs and certifications could not be opened during research (access blocked); those cells rely on secondary sources. xAI's data terms could not be verified at all, and Mistral's training default, retention and BAA position could not be confirmed on its own pages.
HIPAA compliant AI: BAAs, scope traps and de-identification
You can send protected health information (PHI) to an AI model lawfully only when four things are true: a signed BAA covers the exact service, the features you call are inside the BAA's scope, your own Security Rule safeguards cover the surrounding system, and the use is permitted by the Privacy Rule (treatment, payment, operations, or patient authorization). Any one missing makes it a reportable disclosure.
Who needs a BAA
- Covered entities (providers, health plans, clearinghouses) and their business associates (anyone handling PHI on their behalf) must sign a BAA with any vendor that creates, receives, maintains or transmits PHI for them. An AI API that processes clinical notes is a business associate, or a subcontractor of one.
- If you are a software company building for clinics, you are the business associate. You need a BAA with your customer and a subcontractor BAA with the AI provider (or the cloud platform serving the model).
- A health app used directly by consumers, not on behalf of a provider, is usually outside HIPAA but inside the FTC Health Breach Notification Rule (expanded 2024; unauthorized disclosure counts as a breach, as in the GoodRx and Premom cases) and state laws such as Washington's My Health My Data Act.
BAA scope traps
| Trap | Example | What to do |
|---|---|---|
| Feature outside the BAA | Anthropic's HIPAA-ready API rejects web fetch and code execution; OpenAI ZDR excludes Assistants, files and vector stores | Map every API feature you call against the vendor's eligible list |
| Consumer app used by staff | A nurse pastes a chart into a personal chatbot | Block consumer AI domains; provide an approved tool |
| Grounding / search tools | Vertex grounding with Google Search retains data up to 3 days and cannot be ZDR | Strip PHI before any tool call that leaves the BAA boundary |
| Your own logging | Observability tools capture full prompts | Your logging vendor needs a BAA too, or redact before logging |
| Vector databases | RAG index holds embedded chart text | Treat embeddings of PHI as PHI: encrypt, access-control, BAA for the host |
| Cross-region routing | Cross-region inference moves data | Fine under HIPAA (no residency rule), but check state law and contracts |
A trap that is not blocked for you. On Anthropic's HIPAA-ready API, web fetch and code execution are rejected with a 400 error, but the client-side browser use tool is not blocked even though it is outside HIPAA readiness. HIPAA readiness is also permanent once enabled, does not cover Claude Code, is not available on Claude Platform on AWS or Microsoft Foundry, and needs a separate organization for non-HIPAA work (Anthropic docs). Read the eligibility table for every feature you use; don't rely on the API to stop you.
De-identification: the way to use AI without a BAA
Data that is properly de-identified is no longer PHI. HIPAA allows two methods:
- Safe Harbor: remove all 18 listed identifiers (names, geographic units smaller than a state, all date elements except year, phone, email, SSN, record numbers, device IDs, URLs, IPs, biometrics, full-face photos, any other unique code) and have no actual knowledge the rest could identify someone.
- Expert Determination: a qualified statistician certifies the re-identification risk is very small, and documents the method.
Free-text clinical notes are hard to de-identify reliably; names and dates hide in narrative. Automated redaction tools reduce risk but do not by themselves meet Safe Harbor. For notes, a BAA-covered service is usually safer than trusting redaction.
Rules that changed or are pending
| Date | Rule | Status and effect |
|---|---|---|
| Jan 2026 | Texas TRAIGA (HB 149) | In force: written disclosure to patients when AI is used in diagnosis or treatment; AG enforcement, $10k–$200k per violation |
| Aug 2025 | Illinois WOPR Act (HB 1806) | In force: AI may not provide therapy or make independent therapeutic decisions; admin/support use only, with disclosure and oversight |
| May 2025 | HHS Section 1557 rule, 45 CFR 92.210 | In force: covered entities must identify decision-support tools (including AI) that use protected characteristics and mitigate discrimination risk |
| Jan 2025 | HIPAA Security Rule update (NPRM) | Proposed only; final action pushed to at least July 2027. Would mandate asset inventories, MFA, encryption, annual audits. Current rule still enforced |
| Jan 2025 | California AB 3030 | In force: AI-generated patient communications need a disclaimer and a route to a human; AB 489 bars AI implying a healthcare license |
Architecture checklist for a HIPAA AI system
- BAA signed with the model provider or the cloud platform hosting the model
- BAA or equivalent with every other vendor that sees PHI: logging, vector DB, storage, email, analytics
- Only BAA-eligible features enabled; ineligible ones blocked in code
- Zero or minimum retention configured where available
- Minimum necessary: send only the fields the task needs
- Encryption in transit (TLS 1.2+) and at rest for prompts, outputs, caches and indexes
- Role-based access and audit logs on who sent and viewed what
- Security Rule risk analysis updated to include the AI system
- Human review of AI output before it affects care; Section 1557 bias review for decision-support tools
- Patient disclosures where state law requires them (Texas, California, Illinois)
- Breach response plan that covers prompt leakage and model-output exposure
Building for providers or payers? See healthcare software development.
Can lawyers use ChatGPT or Claude? ABA Opinion 512, state bars and Heppner
Yes. No US jurisdiction bans lawyers from using generative AI, including through APIs, with client information. Every bar that has spoken says the same thing: existing ethics rules apply, and the lawyer stays fully responsible. In practice that means a business or API tier that does not train on inputs and contractually protects confidentiality, client consent where the rules require it, and human verification of every output filed or sent.
The governing national guidance: ABA Formal Opinion 512 (29 July 2024)
ABA Formal Opinion 512 is the main national reference. It creates no new rules; it maps AI onto the Model Rules (summary). ABA opinions are persuasive, not binding; your state's rules govern.
| Model Rule | Duty | What it means for AI |
|---|---|---|
| 1.1 Competence | Understand the tools you use | Know how the tool works, its limits (hallucinations), and its data handling. Read the terms of use and privacy policy, or rely on someone who has. |
| 1.6 Confidentiality | Protect client information | Assess the risk that inputs are disclosed, retained or used for training. "Self-learning" tools can surface one client's data in later outputs. |
| 1.4 Communication | Keep the client informed | Tell clients when AI use matters to the representation or when they ask. |
| 1.6 + 1.4 Informed consent | Consent before confidential data enters a self-learning tool | Boilerplate in an engagement letter is not enough (quoted text). |
| 3.1, 3.3 Candor | No false statements to a tribunal | Verify every citation, quotation and factual claim. |
| 5.1, 5.3 Supervision | Supervise lawyers, staff and vendors | Firm AI policies, training, vendor due diligence. |
| 1.5 Fees | Reasonable fees | Do not bill hours the tool saved; learning a general tool is overhead. Charge actual costs only as agreed. |
Why the API/enterprise tier matters for lawyers: Opinion 512's consent requirement is triggered by tools that may disclose or learn from inputs. An enterprise or API tier with no training, short or zero retention, and a confidentiality contract is the strongest basis for concluding the risk is low. A free consumer chatbot is the weakest.
State bar guidance (selected)
| Jurisdiction | Guidance | Key requirement |
|---|---|---|
| California | State Bar Practical Guidance, revised May 14, 2026 (replaces Nov 2023) | Revised at the California Supreme Court's direction; adds agentic AI; organized around competence, confidentiality, communication and candor. Non-binding |
| Virginia | LEO 1901, approved by the Supreme Court of Virginia Nov 24, 2025 | Fees only (Rule 1.5): reduced time does not automatically mean a proportionately reduced fee. Court approval gives it more weight than an ordinary advisory opinion |
| Alaska | Ethics Opinion 2025-1 (Apr 2025) | Closely tracks ABA 512 |
| Texas | Opinion 705 (Feb 2025) | Permitted; lawyer fully responsible; verify output; do not bill for time saved |
| Oregon | Formal Opinion 2025-205 (Feb 2025) | Use of AI tools under existing rules (text not reviewed) |
| Mississippi | Ethics Opinion 267 (Nov 2024) | Listed in compendiums; text not reviewed |
| North Carolina | 2024 FEO 1 (adopted Nov 1, 2024) | Competence, supervision, confidentiality, oversight of output. NC formal opinions are adopted by the State Bar Council and bind lawyers for discipline |
| New Mexico | Formal Opinion 2024-004 (Sep 2024) | Listed in compendiums; text not reviewed |
| New York City | NYC Bar Formal Opinion 2024-5 (Aug 2024) | Confidentiality, competence, supervision; disclosure to clients when external tools handle their data (index) |
| West Virginia | LEO 2024-01 (Jun 2024) | Listed in compendiums; text not reviewed |
| New York State | NYSBA Task Force on AI report (Apr 2024) | Recommendations on confidentiality, competence and consent; not a binding opinion |
| Kentucky | KBA E-457 (Mar 2024) | No billing for learning AI; consent depends on how much AI affects the matter (compendium) |
| New Jersey | Supreme Court Preliminary Guidelines (Jan 2024) | Accuracy, truthfulness, confidentiality; telling clients recommended, not always required |
| Florida | Opinion 24-1 (Jan 2024) | Permitted; protect confidentiality (consent recommended for third-party tools); verify; bill fairly; follow advertising rules |
| Pennsylvania | Joint Formal Opinion 2024-200 (PBA + Philadelphia Bar) | Verify all citations and analysis; do not bill AI time as manual work |
| District of Columbia | DC Bar Opinion 388 (2024) | Understand AI limits, especially hallucinations; protect confidences |
At least 15 state bars and courts have now issued AI opinions or guidance (compendium). Some are formal ethics opinions and others are guidance or task-force reports.
Courts: disclosure rules
- Hundreds of individual federal and state judges have standing orders requiring AI disclosure or certification; there is no uniform rule. Check every judge's order before filing (running list). The first widely known one was Judge Brantley Starr's certification order (N.D. Tex., May 2023).
- The Fifth Circuit considered a circuit-wide AI certification rule in 2024 and did not adopt it, relying on existing Rule 11-style duties.
- The Illinois Supreme Court AI policy (effective 1 January 2025) says disclosure "should not be required" in pleadings; existing ethics rules govern.
- Proposed Federal Rule of Evidence 707 would hold machine-generated evidence offered without an expert to Rule 702 reliability standards. Public comment closed 16 February 2026; it drew strong opposition and had not been adopted as of this guide (Proskauer).
Sanctions: the real enforcement risk is hallucinated citations
Courts are not sanctioning lawyers for using AI. They are sanctioning lawyers for filing unverified output. A tracking database of AI hallucination cases worldwide counted about 1,598 cases by 9 June 2026, growing by roughly 8 a day (UNC Law Library).
| Date | Case | Outcome |
|---|---|---|
| Apr 2026 | Coomer v. Lindell (D. Colo.) | After 2025 Rule 11 fines (about $3,000) for nearly 30 defective citations, the judge proposed further sanctions for continued fake citations (report). |
| Jul 2025 | Johnson v. Dunn (N.D. Ala.), Butler Snow | Three lawyers disqualified, referred to every state bar where licensed; court said fines were not deterring. Firm spared because of its AI policy (summary). |
| Feb 2025 | Wadsworth v. Walmart (D. Wyo.), Morgan & Morgan | Eight fake citations; $3,000 fine and loss of pro hac vice for the drafter, $1,000 each for two others (Bloomberg Law). |
| Jun 2023 | Mata v. Avianca (S.D.N.Y.) | $5,000 sanction for citing cases invented by ChatGPT; the case that started the trend. |
Note the pattern in Johnson and Wadsworth: firms with a written AI policy and verification steps were not themselves sanctioned. A firm policy is a liability shield.
Privilege: United States v. Heppner (S.D.N.Y., Feb 2026)
Judge Rakoff ruled from the bench on February 10, 2026 and issued a written opinion on February 17. He held that about 31 chats a criminal defendant had with Anthropic's consumer Claude, made on his own without counsel's direction, were neither privileged nor work product (O'Melveny, Cleary Gottlieb). The reasoning:
- An AI is not a lawyer, so there is no attorney-client communication.
- The consumer terms allowed the provider to disclose and train on chats, so there was no reasonable expectation of confidentiality.
- Sending outputs to lawyers afterwards did not make them privileged, and pasting attorney advice into the tool risked waiving privilege over that advice.
Work product failed because the materials were not prepared by or at the direction of counsel. In dicta, the court said that if counsel had directed the use, Claude "might arguably" act like the lawyer's agent. Practical reading: lawyer-directed use, on an enterprise or API tier with no training and contractual confidentiality, is the defensible position. Client self-help on consumer chatbots is not.
Civil cases point the other way for self-represented parties. In Warner v. Gilbarco (E.D. Mich., Feb 10, 2026) the court refused to compel a self-represented plaintiff's ChatGPT prompts and outputs, treating AI as a tool rather than a third party. In Morgan v. V2X (D. Colo., Mar 30, 2026) the court held that a self-represented party's AI-assisted preparation is work product under FRCP 26(b)(3), which does not require a lawyer, though the name of the tool used must be disclosed (Kirkland, Bressler). These civil cases are distinguishable from Heppner, a criminal case, but they show the question is unsettled.
Law firms and HIPAA
A law firm is a HIPAA business associate only when it provides legal services to a covered entity or business associate and that work involves PHI (HHS). A firm representing a hospital in a malpractice defense needs a BAA with the hospital, and a subcontractor BAA with any AI vendor that sees the PHI. A firm representing an individual (a personal-injury plaintiff, a party in a divorce) holding that person's own medical records is usually not under HIPAA. Those records are still client confidences under Rule 1.6, so the confidentiality analysis above applies in full.
Outside the US
- UK: The Solicitors Regulation Authority issued a warning notice (Aug 2026) on hallucinated material and entering client confidential information into AI tools without safeguards; the solicitor, not the vendor, is liable (Legal Cheek).
- EU: The CCBE guide (2 October 2025) advises lawyers not to input personal, confidential or client-related information into generative AI tools and to verify all outputs (eucrim). GDPR applies on top.
Law-firm checklist
- Written firm AI policy: approved tools, banned tools (consumer chatbots for client data), verification rules
- Vendor due diligence on file: no training, retention period, ZDR, subprocessors, breach notice, SOC 2 report
- Engagement letter language that specifically explains AI use, plus matter-specific informed consent where data enters a tool that retains or learns
- Citation and quotation verification by a human, logged, before every filing
- Check each judge's standing order on AI disclosure
- Billing policy: no hours for time saved; disclose AI tool costs if passed through
- Training for lawyers and staff; supervision under Rules 5.1/5.3
- Privilege protocol: AI use directed by counsel, on approved tiers, documented as such
For firms building their own tools: legal tech development.
Government data: FedRAMP, IL4/IL5, CJIS and ITAR
For government data the question is not "is the model compliant" but "is this specific cloud offering authorized at the data's impact level". Frontier models are now available from FedRAMP Moderate up to Top Secret, but only through specific government regions and platforms. The commercial API you use for a startup is usually not the authorized route.
Authorization ladder
| Data type | Required authorization | Where frontier models are available |
|---|---|---|
| Public / low-impact federal | FedRAMP Low or Moderate | Claude via Bedrock commercial US regions (Moderate); ChatGPT Enterprise + OpenAI API (FedRAMP 20x Moderate, 2026) |
| Sensitive unclassified (PII, law enforcement, health, financial) | FedRAMP High | Claude on Bedrock GovCloud; Claude on Vertex with Assured Workloads; Claude for Government (Palantir FedStart); Azure OpenAI in Azure Government |
| DoD CUI and mission data | DoD IL4 / IL5 | Claude on Bedrock GovCloud (Anthropic); Azure OpenAI in Azure Government (Microsoft) |
| Classified SECRET | DoD IL6 | Azure OpenAI (authorized early 2025); Claude Gov models in AWS Secret region |
| Top Secret | ICD 503 | Azure OpenAI Top Secret cloud; Claude Gov models in AWS Top Secret region (Anthropic gov page) |
| Export-controlled (ITAR/EAR) | US-person-only operations + US data location | AWS GovCloud (Anthropic states ITAR support via Bedrock GovCloud); Azure Government |
| Criminal justice information (CJI) | CJIS Security Policy v6.0 (Dec 2024) | Signed CJIS agreement with your state CSA; government cloud regions with screened personnel. Vendor "CJIS-ready" claims are not FBI determinations |
| State and local data | GovRAMP (formerly StateRAMP), TX-RAMP, or state-specific review | Varies by state; most accept FedRAMP as equivalent |
FedRAMP 20x. FedRAMP is moving to a faster, automation-based process ("20x"). Reported 2026 changes include renaming "authorization" to "certification" and impact levels to Classes A–D; check fedramp.gov for the current terms, as these could not be confirmed against the primary source.
Federal policy that governs agency AI use
| Date | Policy | Effect |
|---|---|---|
| Dec 2025 | OMB M-26-04 "Unbiased AI Principles" | Implements EO 14319 ("Preventing Woke AI", Jul 2025): "truth-seeking" and "ideological neutrality" become contract terms for federal LLM procurement; national security systems exempt |
| Aug 2025 | GSA OneGov deals + USAi | ChatGPT Enterprise and Claude offered to agencies for $1; Gemini $0.47; Grok $0.42. USAi = free GSA evaluation platform |
| Jul 2025 | CDAO frontier AI awards | Up to $200M each to Anthropic, Google, OpenAI, xAI |
| Apr 2025 | OMB M-25-21 and M-25-22 | Replace the 2024 memos: Chief AI Officers, minimum practices for "high-impact AI", public use-case inventories, AI acquisition rules |
Vendor eligibility can change for non-technical reasons
In 2026 the Department of Defense made two separate supply-chain-risk designations of Anthropic (NPR via VPM):
- Under 10 U.S.C. § 3252: struck down and permanently enjoined by the federal court in San Francisco on August 27, 2026 (Anthropic PBC v. U.S. Dep't of War, N.D. Cal.) (Holland & Knight).
- Under the Federal Acquisition Supply Chain Security Act (FASCSA), 41 U.S.C. § 4713: upheld by the D.C. Circuit 2–1 on September 25, 2026 (Clark Hill, Miller & Chevalier).
The surviving order covers removal of Anthropic products from Department systems and contractor-supported Pentagon work. It is not a government-wide ban, and contractors generally may still use Claude in unrelated commercial work. They should document that separation, because FAR 52.204-29 requires a "reasonable inquiry", and some agencies are already asking for certifications. The practical lesson: for defense work, check DoD vendor restrictions, not only FedRAMP status. For civilian agencies, confirm with the contracting officer.
Government checklist
- Classify the data first (public, CUI, PII, CJI, ITAR, classified)
- Use only the offering authorized at that level, in the authorized region
- Confirm the agency's own ATO or reuse of the FedRAMP package
- Check DoD and agency vendor restrictions and any supply-chain designations
- Apply M-25-21 high-impact AI practices (impact assessment, testing, human oversight) where applicable
- Add M-26-04 unbiased-AI contract terms for federal LLM procurements
- For CJI: CJIS agreement, screened personnel, audit logging
- For ITAR: US-person-only support confirmed in writing
More on public-sector builds: government software development.
GDPR, the EU AI Act and US state privacy laws
Privacy law governs personal data whatever the sector, so it applies on top of HIPAA, bar rules or government rules. Using an AI API is lawful under GDPR and US state laws if you have a lawful basis, a processor contract (DPA), a valid transfer mechanism, and you honor data-subject rights. The EU AI Act adds separate duties depending on what the AI system is used for.
GDPR (EU) essentials for AI APIs
- Roles: you are the controller; the AI provider is your processor under a DPA (Article 28). If the provider uses your data to train its own models, it becomes a controller for that use, which is why "no training" terms matter.
- Lawful basis: usually contract or legitimate interest for business use. Special category data (health, biometrics, religion) needs an Article 9 condition as well.
- DPIA: a Data Protection Impact Assessment is expected for new AI processing of personal data at scale or of sensitive data.
- Transfers to the US: the EU-US Data Privacy Framework is valid. The General Court rejected the Latombe challenge (3 September 2025); an appeal is pending before the Court of Justice (C-703/25 P). Keep Standard Contractual Clauses as a fallback.
- Models and personal data: EDPB Opinion 28/2024 says a model trained on personal data is not anonymous by default; unlawful training can taint later deployment.
- Enforcement: Italy's €15M fine on OpenAI (Dec 2024) was annulled on jurisdiction grounds in March 2026 (Ireland is OpenAI's lead authority); the court did not rule on substance.
- Residency: GDPR does not require EU-only processing, but many customers' contracts do. EU regional processing is available from OpenAI, Azure (EU DataZone), Vertex AI and Bedrock EU regions; the direct Claude API offers only global or US inference.
EU AI Act: what applies when
The AI Omnibus (Regulation (EU) 2026/1744, in force 27 July 2026) delayed the high-risk rules.
| Date | What applies |
|---|---|
| Feb 2, 2025 | Prohibited practices (social scoring, certain biometric uses, manipulative AI); AI literacy duty for staff |
| Aug 2, 2025 | Obligations for general-purpose AI (GPAI) model providers; GPAI Code of Practice signed by Anthropic, OpenAI, Google, Microsoft, Amazon, Mistral, IBM and others (Meta declined; xAI signed one chapter) |
| Jul 27, 2026 | Omnibus in force. AI literacy duty softened: from "ensure a sufficient level of AI literacy" to "take measures to support the development of AI literacy" of staff (Cuatrecasas) |
| Aug 2, 2026 | Article 50 transparency duties (tell people they are dealing with AI); AI Office enforcement powers over GPAI |
| Dec 2, 2026 | New prohibitions added by the Omnibus: AI that generates non-consensual intimate imagery ("nudification") or child sexual abuse material. Also marking of AI-generated synthetic content (Article 50(2)) |
| Dec 2, 2027 | High-risk systems in Annex III: employment, credit, education, essential services, law enforcement, justice |
| Aug 2, 2028 | High-risk AI embedded in regulated products (Annex I, e.g. medical devices) |
For most businesses using an API, the AI Act duties fall on you as the deployer of a system, depending on use case. Using AI to screen job applicants or score credit is high-risk; drafting marketing copy is not. AI used in the administration of justice is listed as high-risk, which matters for legal-tech products.
UK
The Data (Use and Access) Act 2025 took effect for its main data-protection provisions on 5 February 2026. It relaxes the old ban on solely automated decisions: they are allowed with safeguards (information, representations, human intervention, right to contest), except where special category data is involved. UK GDPR otherwise mirrors the EU rules above.
United States
- No federal privacy law. About 20 state comprehensive privacy laws are in effect in 2026 (MultiState), all requiring processor contracts, and most giving opt-outs from profiling.
- California: CCPA regulations on automated decision-making technology took effect 1 January 2026; ADMT compliance from 1 January 2027; risk assessments due for existing activities by 31 December 2027.
- Colorado: the 2024 AI Act never took effect. It was repealed and replaced by SB 26-189 (May 2026), a narrower ADMT law effective 1 January 2027 (McDermott).
- Federal pressure on state AI laws: Executive Order 14365 (11 December 2025) created a DOJ task force to challenge state AI laws and ties broadband funds to them. It does not itself preempt any state law; comply with state laws until a court says otherwise.
- Sector laws still apply: GLBA (financial data), FERPA (student records), COPPA (children under 13), state biometric laws such as Illinois BIPA.
Breach notification
All 50 states, plus DC, Guam, Puerto Rico and the US Virgin Islands, have data breach notification laws (Jackson Lewis). A vendor processing data for a client is usually a "third-party agent" with its own duty to tell the client. Example: Florida § 501.171 requires notice to the state within 30 days for a breach affecting 500+ Floridians. A third-party agent must notify the covered entity within 10 days, and penalties reach $500,000 per breach. If you build AI products on client data, your contracts and incident plan need these clocks, separate from HIPAA's 60-day ceiling.
Foreign-hosted models
DeepSeek's privacy policy states user data is stored in the People's Republic of China. Italy ordered it to stop processing Italian users' data (January 2025), and Australia, Taiwan, South Korea and the Czech Republic restricted it on government systems (Al Jazeera). Do not send regulated data to a hosted service whose data may be held under a foreign government's jurisdiction without a legal review.
Related: the EU AI Act’s watermarking rules explained and what new AI rules mean for builders.
How to evaluate an AI provider: decision route and questionnaire
Start from the most sensitive data that will ever enter the system, not from the model. The data category sets the minimum contract and authorization; model quality is chosen only among offerings that clear that bar. When data types mix, every rule that legally applies, applies.
If more than one row legally applies (a law firm defending a hospital that is also a federal contractor), every applicable row's requirements apply at once. First check which rules actually reach your data: a law firm holding its own client's medical records is under Rule 1.6, not HIPAA (see the lawyers section).
Five-step evaluation
- Classify the data. List every data type that could reach the model, including through uploaded documents, retrieval indexes and tool results.
- Pick the tier and route. Business or API tier only for regulated data. Decide direct API vs cloud platform (Bedrock, Vertex, Azure) based on which contracts and authorizations you need.
- Get the paperwork. DPA, BAA, ZDR addendum, SOC 2 Type II report, subprocessor list, FedRAMP package as applicable. Keep copies with dates.
- Configure to match the contract. Enable ZDR or HIPAA mode, disable ineligible features, pin regions, set retention, restrict access.
- Govern your own side. Logging redaction, vector DB security, staff policy, human review of outputs, incident response, annual vendor re-review.
Vendor due-diligence questionnaire
| # | Question | Acceptable answer for regulated data |
|---|---|---|
| 1 | Is our data used to train or improve any model, including via human review? | No, by contract; opt-in only |
| 2 | How long are inputs and outputs retained, and for what purposes? | Defined period (days), stated purposes; zero available |
| 3 | Which features are excluded from zero retention? | A written list we can check our usage against |
| 4 | Will you sign a BAA? Which services and features does it cover? | Yes, with a feature-level eligibility list |
| 5 | Will you sign a DPA with SCCs / DPF certification? | Yes |
| 6 | Where is data processed and stored? Can we pin a region? | Named regions; pinning available |
| 7 | Who are your subprocessors, including other model providers? | Published list with change notice |
| 8 | Can your staff see our prompts? Under what conditions? | Only for flagged abuse or support with consent; logged |
| 9 | Which audits and certifications are current? Can we see the reports? | SOC 2 Type II under NDA; ISO 27001; ISO 42001 a plus |
| 10 | What is your breach notification timeline? | Without undue delay; contractual hours/days; HIPAA 60-day ceiling |
| 11 | What happens to our data under a legal hold or subpoena? | Notice to us where legally allowed; ZDR data not preserved |
| 12 | Is the service authorized for government use at our level? | Named FedRAMP / IL listing on the Marketplace |
| 13 | How do you handle encryption in transit and at rest; customer-managed keys? | TLS 1.2+, AES-256, CMK option for high-sensitivity data |
| 14 | Can we delete our data on demand and get confirmation? | Yes, with documented timelines |
| 15 | How will we be told about changes to these terms? | Advance notice with right to terminate |
Red flags: "HIPAA certified" (no such certification), a BAA that does not list services, "we may use data to improve our services" in business terms, no SOC 2 Type II, refusal to name subprocessors, data hosted in a jurisdiction your regulator restricts.
Self-hosted and open-weight models
Running an open-weight model (Llama, Mistral, Qwen, Gemma, gpt-oss and similar) on your own servers removes the third-party processor from the data path, but it moves every compliance duty onto you. It is the right answer when data legally cannot leave your environment (classified, some ITAR, air-gapped networks, contractual no-cloud clauses), and usually the wrong one when a BAA-covered cloud API is acceptable.
| Factor | Cloud API under BAA/DPA/ZDR | Self-hosted open-weight model |
|---|---|---|
| Who holds the data | Vendor processes it under contract | Only you |
| Security controls and audits | Vendor's SOC 2 / ISO / FedRAMP plus yours | Entirely yours: access control, logging, patching, encryption, pen tests |
| HIPAA paperwork | BAA with the vendor (and its subprocessors) | No model-vendor BAA needed; hosting provider BAA still needed if in a cloud |
| Model quality | Frontier models | Usually behind frontier models on hard reasoning and long documents |
| Cost profile | Pay per token | GPUs, ops staff, upgrades; cheaper only at sustained high volume |
| License terms | Vendor terms of service | Model license (some restrict use, user counts or field of use; read it) |
| Supply-chain risk | Vendor's responsibility, contractually | Yours: verify weights' origin, scan model files, pin versions |
| Origin concerns | US/EU vendors with published policies | Some agencies and states restrict models from certain countries even when self-hosted; check your sector's list |
A middle path is a managed model inside your own cloud account: the same frontier model served by AWS Bedrock, Google Vertex AI or Azure, under the cloud provider's BAA, FedRAMP scope and regional controls you already use. For most regulated organizations this is the practical sweet spot.
Risks that stay the same either way: prompt injection, data leakage through retrieval (RAG) indexes, over-broad access to source documents, and logs or traces that capture sensitive prompts. Self-hosting does not fix these.
Background: open vs closed AI models.
What is known, and what is not
The data-handling side is well understood and contract-backed; the legal side is still forming, mostly through ethics opinions and a handful of court rulings. Standards bodies have not caught up with AI-specific risks, so certifications prove a vendor runs a sound security program, not that a model is safe for a given use.
| Area | Confidence | Why |
|---|---|---|
| Training on API/enterprise data | High | Every major vendor commits to no training in contract terms; verifiable in published docs |
| Retention periods and ZDR | High, per vendor | Documented, but exceptions vary by feature and change with new products (e.g. model-specific retention on Bedrock) |
| BAA availability | High | Published by all major clouds and model providers; scope lists must be checked per feature |
| HIPAA rules for AI specifically | Medium | No AI-specific HIPAA rule; Security Rule update delayed to 2027 at the earliest; guidance is general |
| Lawyer ethics | Medium-high | ABA 512 plus 10+ state opinions agree on the framework; details (consent thresholds, billing) differ by state |
| Privilege for AI-assisted work | Low | Heppner (criminal, consumer Claude, no counsel direction) denied protection; Warner and Morgan (civil, self-represented parties) granted work-product protection; the counsel-directed, enterprise-tier case is undecided |
| Court disclosure rules | Low | Judge-by-judge standing orders; no uniform federal rule; FRE 707 not adopted |
| EU AI Act obligations | Medium | Dates now fixed by the Omnibus; harmonized standards and guidance still being written |
| US state AI laws | Low | Colorado repealed and replaced; federal executive order targets state laws; litigation ongoing |
| Government authorizations | Medium | FedRAMP 20x terminology and process changing in 2026; vendor eligibility can change for policy reasons |
| Model-level risks (prompt injection, memorisation, leakage via outputs) | Low | No certification measures these; ISO 42001 covers management process, not model behavior |
Gaps no standard covers yet:
- Memorisation: whether a model trained on data can reproduce it. Irrelevant for API data that is never trained on, central for consumer tiers.
- Prompt injection: a document or web page can instruct an AI agent to leak data it has access to. This is a design problem in your system, not a vendor certification item.
- Agentic tools: when a model can browse, run code or call APIs, data can leave the BAA or ZDR boundary through the tool, not the model. Several vendors exclude exactly these features from ZDR and HIPAA scope.
- Subprocessor chains: a product can route to a different model provider under the hood (for example Microsoft Copilot using Anthropic models outside the EU Data Boundary). Read the subprocessor list, not only the main contract.
- Policy volatility: terms and availability change. Anthropic's consumer training default changed in 2025; litigation suspended OpenAI's deletion in 2025; a DoD designation changed Anthropic's defense eligibility in 2026. In June 2026 a Commerce Department export-control directive restricted access to Claude Fable 5 and Mythos 5 until it was terminated on June 30, with access returning from July 1 (Digital Policy Alert; news reports only, no Anthropic statement found). Re-review vendors at least yearly, and build regulated products with a tested fallback model so they do not depend on one model.
NerdHeadz builds AI products that pass a compliance review.
Tell us what data your product touches. We’ll map the right provider route, contracts and settings, and come back with a scoped proposal within 48 hours.
Frequently asked questions
Is ChatGPT HIPAA compliant?
Not the consumer versions. ChatGPT Free, Plus, Pro and Team come with no Business Associate Agreement, so they must never receive protected health information. OpenAI signs a BAA for its API on request (reported to require zero or modified data retention) and for ChatGPT Enterprise and Edu through its sales team. HIPAA compliance then also depends on using only covered features and on your own safeguards.
Is Claude HIPAA compliant, and does Anthropic sign a BAA?
Yes for the Claude API with “HIPAA readiness” enabled: eligible organizations sign Anthropic’s BAA in the Console or through sales, and requests to ineligible server tools such as web fetch and code execution are rejected. The setting is permanent, does not cover Claude Code, and the client-side browser use tool is not blocked even though it is out of scope. Claude Free, Pro and Max are not covered. Claude on AWS Bedrock or Google Vertex AI falls under those clouds’ BAAs.
Which AI tools are HIPAA compliant?
No AI tool is HIPAA compliant on its own; HIPAA has no certification. What exists is BAA coverage for specific services: the Claude API (HIPAA readiness), the OpenAI API and ChatGPT Enterprise/Edu, Google Vertex AI, Azure OpenAI and Microsoft 365 Copilot, and AWS Bedrock. You are compliant only if a BAA covers the exact features you use and your own systems (logs, vector databases, staff access) meet the Security Rule.
Is it safe to put confidential client information into ChatGPT or Claude?
Not into consumer chat apps, which may train on your conversations and give no confidentiality contract. A business or API tier that does not train on inputs, keeps data briefly or not at all, and is covered by a confidentiality agreement is the defensible route. Lawyers should also follow ABA Formal Opinion 512: understand the tool, protect confidentiality, get informed consent where a tool retains or learns from inputs, and verify every output.
Does Claude, ChatGPT or Gemini train on my data?
On business and API tiers, no: Anthropic, OpenAI, Google (paid Gemini API and Vertex AI), Microsoft and AWS all commit not to train on customer data by default. Consumer tiers differ: since August 2025 Claude Free, Pro and Max conversations are used for training unless the user opts out; ChatGPT consumer accounts train by default with an opt-out; and the unpaid Gemini API tier is used to improve Google’s products, with human review possible.
What is a zero data retention agreement?
A contract addendum under which the AI provider does not store your prompts and outputs after returning a response, apart from narrow abuse or legal exceptions. It is approved per organization, not on by default, and excludes stateful features such as file storage, batch jobs and agent sessions. Some newer models require retention regardless; Anthropic’s Fable 5/5.1 and Mythos 5/5.1, for example, need 30-day retention unless expressly authorized.
Can lawyers use ChatGPT or Claude, and are AI chats privileged?
Yes, lawyers may use generative AI under ABA Formal Opinion 512 and at least 15 state bar opinions and court policies, as long as they meet their duties of competence, confidentiality, client communication, candor, supervision and fair billing. On privilege, United States v. Heppner (S.D.N.Y., February 2026) held that a defendant’s own consumer-Claude chats, made without counsel’s direction, were not privileged; two civil courts (Warner, Morgan) protected self-represented parties’ AI work as work product. Lawyer-directed use on an enterprise tier is the defensible position.
Which AI models are FedRAMP authorized?
Claude is FedRAMP High and DoD IL4/IL5 on AWS Bedrock in GovCloud, FedRAMP High on Google Vertex AI with Assured Workloads, and FedRAMP High as Claude for Government. Azure OpenAI is FedRAMP High and IL4/IL5 in Azure Government, with IL6 and Top Secret clouds authorized. ChatGPT Enterprise and the OpenAI API announced FedRAMP 20x Moderate in April 2026. The commercial direct APIs are generally not the authorized route for federal data.
Sources and verification notes
Researched 12 October 2026. Vendor terms change often; re-check the primary pages before relying on any cell. This guide is general information, not legal advice. Have counsel review contracts and jurisdiction-specific duties.
Primary vendor documentation
- Anthropic: API and data retention · Data residency · Privacy center, retention · Certifications · Government solutions · Claude in Bedrock FedRAMP High · Consumer terms update
- OpenAI: Your data (API) · FedRAMP Moderate
- Google: Gemini API terms · Vertex AI data governance
- Microsoft: Azure OpenAI data privacy · Abuse monitoring · Microsoft 365 Copilot privacy · Azure Government authorization
- AWS: Bedrock data protection · Bedrock abuse detection
- Mistral: Zero data retention · Cohere: Enterprise data commitments
Government and regulators
- OMB M-25-21 · OMB M-26-04 · GSA USAi · HHS de-identification guidance · UK Data (Use and Access) Act guidance · Florida Bar Opinion 24-1 · ABA Formal Opinion 512
Secondary analysis (law firms, trade press) is linked inline in each section.
Could not be verified against a primary source: OpenAI BAA scope and certifications (help center blocked); xAI data terms; Azure's default abuse-monitoring retention period; FedRAMP 20x 2026 terminology; NYT v. OpenAI order details (press reports only); several state bar opinions (NYC 2024-5, DC 388, Oregon 2025-205, West Virginia 2024-01, New Mexico 2024-004, Mississippi 267) were confirmed only through compendiums; the June 2026 export-control episode (news reports only); the EU AI Omnibus details (law-firm summaries, not the Official Journal text); the exact 2026 California guidance changes (summaries only).
Related: all NerdHeadz guides · vibe-coding security risks · 33 questions executives ask about AI · fintech and banking development










