Skip to content
Compliance guideVerified 12 Oct 2026

HIPAA Compliant AI and Beyond: Which LLM Providers Are Safe for Regulated Data

Health records, client files, government data: which AI providers and plans can lawfully receive them, under which contracts and settings. Claude, ChatGPT, Gemini, Azure OpenAI and Bedrock compared on BAAs, training, retention and FedRAMP — plus what ABA Opinion 512, the EU AI Act and US state laws require.

General information, not legal advice. Vendor terms change; every provider fact here was checked against vendor documentation on 12 October 2026.

  • 14provider routes compared on training, retention, BAA and FedRAMP
  • 15+bar opinions and court rulings on lawyers using AI
  • 15due-diligence questions to ask any AI vendor
  • 4regulated data types: health, legal, government, personal
TL;DR

The short answer

No model is compliant by itself. Compliance comes from the tier (consumer vs business/API), the contract (BAA, DPA, zero data retention), the configuration (eligible features only, region pinned) and your own controls. With those in place, regulated data can go to Claude, GPT, Gemini and others today. Without them, even the best model is a reportable disclosure.

  • Never use consumer chat apps for regulated data. Free and individual paid plans (Claude Free/Pro/Max, ChatGPT Free/Plus, the free Gemini API tier) may train on your data and offer no BAA or DPA.
  • Business and API tiers do not train on your data at Anthropic, OpenAI, Google (paid/Vertex), Microsoft and AWS. Default retention is roughly 0–30 days for abuse monitoring; zero retention is available by approval, with features such as code execution, file storage, batch processing and search grounding excluded. Some newer models (Anthropic's Fable 5/5.1 and Mythos 5/5.1) require 30-day retention and are not available under zero retention.
  • HIPAA: all five major routes offer a BAA for eligible services. The BAA covers specific features, not the whole product; anything outside it (web fetch, code execution, your own logging tools) breaks compliance. HIPAA has no certification, so "HIPAA certified" is a red flag.
  • Lawyers: yes, officially allowed. ABA Formal Opinion 512 (July 2024) and at least 15 state bars and courts permit AI use under existing duties: competence, confidentiality, informed consent for tools that retain or learn from inputs, verification, supervision and fair billing. The enforcement risk is unverified citations (about 1,600 hallucination cases worldwide by June 2026), not AI use itself. A February 2026 ruling (Heppner) found a defendant's own consumer-Claude chats were not privileged, while two civil courts protected self-represented parties' AI work, so privilege for AI use is still unsettled.
  • Government: use only offerings authorized at the data's impact level. Frontier models run at FedRAMP High and DoD IL4/IL5 via AWS GovCloud, Google Assured Workloads and Azure Government, and up to Top Secret in dedicated clouds. Commercial APIs are not the authorized route. Vendor eligibility can change for policy reasons (DoD's 2026 supply-chain designation of Anthropic).
  • Privacy law: GDPR needs a DPA, lawful basis and a transfer mechanism (the EU-US Data Privacy Framework is valid but under appeal). The EU AI Act's high-risk rules were delayed to December 2027 / August 2028; transparency duties apply from August 2026. About 20 US state privacy laws are in effect.
  • The biggest real-world leak points are on your side: logs, observability tools, vector databases, staff using unapproved tools, and agent tools that send data outside the contract boundary.

Quick answer by provider route for regulated data (details in the matrix below):

NeedGood routes
HIPAA PHIClaude API (HIPAA-ready), Bedrock, Vertex AI, Azure OpenAI, OpenAI API or ChatGPT Enterprise with BAA
Law firm client dataEnterprise/API tier of any major vendor with no training + ZDR where available; legal-specific products built on these
EU personal data with EU processingAzure EU DataZone, Vertex AI EU regions, Bedrock EU regions, OpenAI EU processing
US federal sensitive (FedRAMP High)Bedrock GovCloud, Vertex AI Assured Workloads, Azure Government, Claude for Government
DoD CUI (IL4/IL5)Bedrock GovCloud, Azure Government (subject to DoD vendor restrictions)
Classified / air-gappedDedicated classified clouds or self-hosted open-weight models
Quick answers

Is ChatGPT, Claude, Gemini or Copilot HIPAA compliant?

None of them is “HIPAA compliant” by itself, because HIPAA has no certification. The real question is whether the vendor signs a Business Associate Agreement (BAA) for the exact product you use. Consumer plans never qualify; business and API plans can.

ProductConsumer plansBusiness / API with a BAA
ChatGPT / OpenAINo BAA for ChatGPT Free, Plus, Pro or Team.BAA for the OpenAI API by request (reported to require zero or modified retention), and for ChatGPT Enterprise and Edu through sales.
Claude / AnthropicNo BAA for Claude Free, Pro or Max.Claude API with “HIPAA readiness”: sign the BAA in the Console or through sales. Claude Enterprise via sales. Claude Code is not covered.
Gemini / GoogleNo BAA for the Gemini app or the Gemini API in AI Studio.Vertex AI (including Claude on Vertex) under the Google Cloud BAA. Workspace with Gemini supports HIPAA workloads with some features blocked.
Copilot / MicrosoftOnly the business Microsoft 365 Copilot is listed as covered; don’t assume other Copilot apps are.Microsoft 365 Copilot and Azure OpenAI are covered under Microsoft’s BAA in the Product Terms.
AWS Bedrock—HIPAA eligible under the AWS BAA, for Claude, Llama, Mistral and other hosted models.
Basics

How AI data flows: training, retention and zero data retention

The single biggest factor in AI data risk is not which model you pick but which product tier you send data through. The same model can be safe for client files through an enterprise API under contract, and unsafe through a free consumer chat app.

A prompt can outlive its response in four placesYour application sends a prompt through the provider API to model inference, which returns a response. Copies may persist at the provider in abuse logs (kept a fixed period; zero data retention removes this), feature storage (files, batch jobs, chat history, memory) and training data (consumer chat apps; off by default for the API), and in your own copies (logs, traces, caches, vector indexes, backups).A prompt can outlive its response in four placesYour applicationprompts + documentsProvider APIencrypted in transitModel inferenceprocessed in memoryResponsereturned to youcopies may persistand so do yoursAt the providerAbuse logskept a fixed periodZDR removes thisFeature storagefiles, batch jobs,chat history, memoryTraining dataconsumer chat appsAPI: off by defaultYour own copieslogs, traces, cachevector index, backups
Inference happens in memory; the risk is the copies. Each of the four needs an answer before regulated data goes in.

Inference itself happens in memory and is not the main risk. The risk is the copies: safety logs, stored features, training pipelines, and the logs your own team adds. Every one of these needs an answer before regulated data goes in.

The three tiers, in general terms (provider-specific figures are in the matrix below):

TierExamplesTraining on your dataRetentionContracts availableFit for regulated data
Consumer apps (free and paid individual plans)Claude Free/Pro/Max, ChatGPT Free/Plus/Pro, Gemini appOften on by default or by user choice; must be switched off per accountLong; chat history kept until deleted, longer if used for trainingConsumer terms only. No BAA, no DPA.No. Never for PHI, client confidences or government data.
Business / enterprise appsClaude Team/Enterprise, ChatGPT Business/Enterprise, Gemini for Workspace, Microsoft 365 CopilotOff by contractAdmin-controlled; often configurableDPA standard; BAA on some enterprise plans; SSO, audit logsYes, if the right plan, contract and settings are in place.
API / cloud platformAnthropic API, OpenAI API, Vertex AI, Azure OpenAI, AWS BedrockOff by defaultShort (days) for abuse monitoring; ZDR available on requestDPA standard; BAA and ZDR by agreement; regional processingYes. This is the main route for building compliant products.

Questions every data flow must answer:

  1. Is the data used to train or improve any model? (Must be no, in writing.)
  2. How long are inputs and outputs kept, by whom, and why? (Abuse monitoring, legal holds, feature storage.)
  3. Which model version is used, and does that model carry its own retention requirement? (Anthropic's Covered Models, for example, require 30-day retention even for customers who otherwise have zero retention.)
  4. Can retention be cut to zero, and which features stop working if it is?
  5. Where is data processed and stored geographically? (Region, residency, cross-border transfer basis.)
  6. Who else touches it? (Subprocessors, the hosting cloud, human safety reviewers.)
  7. What do your systems keep? (Application logs, observability tools, vector databases, backups, prompt caches.) This is where most real-world leaks happen.
  8. Who inside your organization can see prompts and outputs? (Role-based access, audit logs.)

Legal holds override retention promises. A vendor's deletion promise can be suspended by a court preservation order in litigation against that vendor. That happened to OpenAI in 2025 (see the provider matrix). Zero-retention arrangements are the strongest protection, because there is nothing to preserve.

Vocabulary

What “compliant” really means: BAA, SOC 2, FedRAMP and the rest

No AI model is "HIPAA compliant" or "lawyer-approved" on its own. Compliance belongs to a deployment: a specific vendor service, under a specific contract, configured a specific way, used by an organization with its own controls. Badges fall into three kinds, and they prove very different things.

  • Contracts create legal obligations for the vendor (BAA, DPA, SCCs, enterprise terms, zero-data-retention addendum). These are what make regulated use lawful.
  • Audits and certifications are third-party evidence that the vendor's security program works as described (SOC 2, ISO 27001). They do not make your use compliant.
  • Government authorizations are permissions for agencies to use a service at a stated risk level (FedRAMP, DoD IL). They apply to a named cloud offering, not to the vendor as a whole.
TermKindWhat it provesWhat it does NOT prove
BAA (Business Associate Agreement)Contract, US HIPAAVendor agrees to safeguard PHI, report breaches, limit use. Legally required before a covered entity shares PHI with a vendor.That every product of that vendor is covered. BAAs list eligible services and often exclude beta features.
DPA (Data Processing Addendum)Contract, GDPR/UK GDPR/state lawsVendor acts as processor on your instructions; sets subprocessors, transfers, deletion.That data stays in a given region unless residency is stated.
SCCs / EU-US Data Privacy FrameworkContract / certificationA lawful mechanism for moving EU personal data to the US.That the transfer passes your own risk assessment.
Zero Data Retention (ZDR)Contract addendumPrompts and outputs are not stored after the response (except abuse/legal exceptions stated in the addendum).Usually not on by default; must be requested and approved, and some features are excluded.
SOC 2 Type IIAudit report (AICPA)Controls for security (and optionally availability, confidentiality, privacy) operated effectively over an observation period, commonly 3–12 months (the AICPA sets no fixed minimum; many buyers expect at least 6).Legal compliance with HIPAA, GDPR or bar rules. Type I only covers a single date.
ISO/IEC 27001CertificationA certified information security management system.Model behavior or training practices.
ISO/IEC 27701CertificationPrivacy information management on top of 27001.GDPR compliance by itself.
ISO/IEC 42001CertificationAn AI management system (risk, governance, lifecycle). The first AI-specific management standard (2023).Accuracy or safety of any one model.
HITRUSTCertificationHealthcare-oriented control framework mapped to HIPAA.A BAA. You still need the contract.
FedRAMP (Moderate / High)US federal authorizationA cloud service may hold federal data at that impact level. High covers the most sensitive unclassified data.Classified data, or that the agency itself has approved your use.
DoD Impact Levels (IL2, IL4, IL5, IL6)DoD authorizationIL4/IL5 = Controlled Unclassified Information (CUI) and mission data; IL6 = classified SECRET.That a model is available at that level in every region.
StateRAMP / TX-RAMPState authorizationState and local agencies may use the service.Federal use.
CJIS Security PolicyFBI policyRules for criminal justice information (personnel screening, encryption, audit). Met by agreement per state, not a certificate.That a vendor is "CJIS certified" (no such national certificate exists).
ITAR / EARExport control lawDefense or controlled technical data must stay with US persons / authorized locations.Covered by FedRAMP alone. Needs US-person-only support and US data handling, e.g. GovCloud.
PCI DSSIndustry standardCard data handling.Health or legal data protections.

What "HIPAA compliant" really means. HIPAA has no certification. The US Department of Health and Human Services (HHS) never certifies products. When a vendor says "HIPAA compliant" or "HIPAA eligible", the only meaningful parts are: (1) they will sign a BAA, (2) the BAA covers the exact service and features you use, and (3) you configure and use it as the BAA requires. The Security Rule obligations (risk analysis, access controls, audit logs, workforce training) stay with you.

Comparison

Provider matrix: Claude, ChatGPT, Gemini, Azure OpenAI, Bedrock

Every major provider now offers a commercial route with no training on your data, a BAA for eligible services, and some form of zero data retention by approval. They differ on default retention, which features fall outside ZDR or the BAA, regional processing, and government authorization. The route you buy through (direct API vs a cloud platform) changes who the data processor is.

The table scrolls sideways; the first column stays in place.

Provider / routeTraining on your dataDefault retentionZero data retentionHIPAA BAARegional processingGovernment authorizationLast verified
Anthropic Claude APINo, unless you give express permissionConflicting pages: API docs say prompts and outputs are not retained by default; the privacy center says deleted within 30 days. Treat 30 days as the upper bound. Covered Models (Claude Fable 5/5.1, Mythos 5/5.1) require 30-day retention on every platform. Policy-violation flags up to 2 yearsBy approval per org. Not eligible: Batch (29-day retention), Files API, Agent Skills, MCP connector, Managed Agents, code execution, programmatic tool calling, dynamic filtering in web search/fetch, any Console usage, and Covered Models unless Anthropic expressly authorizes. The API does not block these under ZDRYes ("HIPAA readiness"), self-serve in Console or via sales. Permanent once enabled. Direct API only, not Claude Platform on AWS or Microsoft Foundry. Claude Code not covered. Use a separate org for non-HIPAA work. Server tools outside scope (web fetch, code execution) return a 400 error; client-side browser use is not blocked but is outside scopeUS-only inference option (inference_geo: us, 1.1x price); no EU option on the direct APIDirect API not FedRAMP; FedRAMP 20x Moderate for Claude Enterprise in process (gov page)2026-10-12
Anthropic Claude Team / Enterprise appsNo (commercial terms)Admin-configurableClaude Code for Enterprise eligibleEnterprise plans, via salesAs aboveClaude for Government: FedRAMP High via Palantir FedStart2026-10-12
Anthropic Claude consumer (Free, Pro, Max)Since Aug 2025, used for training unless the user opts out; 5-year retention if allowed (announcement)30 days if opted outNoNoNoNo2026-10-12
OpenAI APINo, unless you opt in (since Mar 2023)Abuse logs up to 30 daysZDR or Modified Abuse Monitoring by approval; ZDR forces store=false; excludes Assistants, threads, files, vector stores, fine-tuning, batches, evals, audioYes, by request (reported to require zero/modified retention; primary page not reachable)Storage in 10 regions incl. EU, UK, Canada, Australia, Japan; processing in US, EU, UAE (non-US requires MAM/ZDR)ChatGPT Enterprise + API: FedRAMP 20x Moderate (announced Apr 2026, OpenAI)2026-10-12
OpenAI ChatGPT Business / Enterprise / EduNo (business terms)Admin-configurableEnterprise optionsEnterprise and Edu via sales; "ChatGPT for Healthcare" offering; not Team/consumer (secondary sources)Data residency programChatGPT Gov (agency-hosted in Azure)2026-10-12
OpenAI ChatGPT consumerYes by default; user can opt outUntil deletedNoNoNoNo2026-10-12
Google Gemini API, unpaid tier (AI Studio, no billing)Yes; human reviewers may read prompts. Google says not to submit sensitive dataNot limitedNoNoNoNo2026-10-12
Google Gemini API, paid tierNo"Limited period" for abuse; grounding with Search/Maps kept 30 daysNoNo (use Vertex)Paid terms apply to all EEA/UK/Swiss usageNo2026-10-12
Google Vertex AI (incl. Claude on Vertex)No24-hour in-memory cache (can disable); abuse logging under GCP terms; Covered Models keep 30 days inside your cloud environmentBy exception request; impossible with Search grounding (3 days) or Maps grounding (30 days)Yes, under Google Cloud BAARegional endpoints, EU availableClaude on Vertex + Assured Workloads: FedRAMP High2026-10-12
Azure OpenAI / Microsoft FoundryNo; not shared with OpenAIAbuse monitoring stores flagged prompts for human review by defaultModified abuse monitoring by Limited Access application (ContentLogging=false)Yes, under Microsoft Product Terms BAA (Claude in Foundry: Anthropic HIPAA readiness not available)Standard = in your geography; DataZone = US or EU zone; Global = anyAzure Government: FedRAMP High, IL4/IL5 (Microsoft); IL6 and Top Secret clouds authorized2026-10-12
Microsoft 365 CopilotNoPurview-managedOpted out of Azure OpenAI abuse monitoringYes (listed as HIPAA-covered)EU Data Boundary, but Anthropic models used as a subprocessor are outside the EUDBGCC / GCC High variants2026-10-12
AWS Bedrock (incl. Claude, Llama, Mistral)No; model providers have no access to prompts or logsNone by default, with model-specific exceptions: Claude Fable 5/5.1 traffic kept up to 30 days for abuse detection; some OpenAI models keep flagged traffic 30 daysDefault for most models; check the per-model exception listYes, HIPAA eligible under the AWS BAASingle-region via application inference profile; cross-region profiles move dataClaude in GovCloud: FedRAMP High + DoD IL4/IL5 (Anthropic); Secret/Top Secret regions for Gov models2026-10-12
CohereYes for the SaaS API unless you turn it off in the dashboardLogged prompts and generations deleted after 30 daysApproved enterprise customers (commitments)Only for custom model development engagements; Cohere says not to send PHI through its SaaS APISaaS, customer VPC, on-premises, or via OCI, Azure, AWS, Google Cloud (security)Not found2026-10-12
MistralNot confirmed on a primary page (third-party sources conflict)Not confirmed (30 days per third parties only)Paid plans, stateless calls only (chat, embeddings, moderation, OCR, audio); excludes Agents, Batch, Conversations, Libraries, Files; approved case by caseNot confirmed (one third party says no BAA)EU-based company and hostingNot found2026-10-12

Certifications (where verified). Anthropic lists SOC 2 Type I and II, ISO 27001:2022 and ISO/IEC 42001:2023 (support article). Cohere lists ISO 27001, ISO 42001 and an annual SOC 2 Type II (trust center). AWS, Google Cloud and Microsoft Azure each hold SOC 1/2/3, ISO 27001/27017/27018, HITRUST-mapped controls and FedRAMP High for their government regions; their trust portals list which AI services are in scope. Always download the current SOC 2 report under NDA rather than relying on a logo.

Who is the processor? On Bedrock and Vertex, the cloud provider is your data processor and its BAA/DPA govern, not the model maker's. On the direct Claude API, Claude Platform on AWS and Claude in Microsoft Foundry, Anthropic is the processor (Anthropic docs). This matters when you choose which contract to sign.

Legal holds in practice. In NYT v. OpenAI, a May 2025 order required OpenAI to preserve consumer and API chats it would otherwise have deleted. An October 2025 order ended the obligation going forward (logs after 26 September 2025), but already-preserved logs and NYT-flagged accounts stayed covered; ZDR customers were not affected (Engadget). The lesson applies to every vendor: retention promises can be suspended by litigation.

Verification gaps. OpenAI's help-center pages on BAAs and certifications could not be opened during research (access blocked); those cells rely on secondary sources. xAI's data terms could not be verified at all, and Mistral's training default, retention and BAA position could not be confirmed on its own pages.

Healthcare

HIPAA compliant AI: BAAs, scope traps and de-identification

You can send protected health information (PHI) to an AI model lawfully only when four things are true: a signed BAA covers the exact service, the features you call are inside the BAA's scope, your own Security Rule safeguards cover the surrounding system, and the use is permitted by the Privacy Rule (treatment, payment, operations, or patient authorization). Any one missing makes it a reportable disclosure.

Who needs a BAA

  • Covered entities (providers, health plans, clearinghouses) and their business associates (anyone handling PHI on their behalf) must sign a BAA with any vendor that creates, receives, maintains or transmits PHI for them. An AI API that processes clinical notes is a business associate, or a subcontractor of one.
  • If you are a software company building for clinics, you are the business associate. You need a BAA with your customer and a subcontractor BAA with the AI provider (or the cloud platform serving the model).
  • A health app used directly by consumers, not on behalf of a provider, is usually outside HIPAA but inside the FTC Health Breach Notification Rule (expanded 2024; unauthorized disclosure counts as a breach, as in the GoodRx and Premom cases) and state laws such as Washington's My Health My Data Act.

BAA scope traps

TrapExampleWhat to do
Feature outside the BAAAnthropic's HIPAA-ready API rejects web fetch and code execution; OpenAI ZDR excludes Assistants, files and vector storesMap every API feature you call against the vendor's eligible list
Consumer app used by staffA nurse pastes a chart into a personal chatbotBlock consumer AI domains; provide an approved tool
Grounding / search toolsVertex grounding with Google Search retains data up to 3 days and cannot be ZDRStrip PHI before any tool call that leaves the BAA boundary
Your own loggingObservability tools capture full promptsYour logging vendor needs a BAA too, or redact before logging
Vector databasesRAG index holds embedded chart textTreat embeddings of PHI as PHI: encrypt, access-control, BAA for the host
Cross-region routingCross-region inference moves dataFine under HIPAA (no residency rule), but check state law and contracts

A trap that is not blocked for you. On Anthropic's HIPAA-ready API, web fetch and code execution are rejected with a 400 error, but the client-side browser use tool is not blocked even though it is outside HIPAA readiness. HIPAA readiness is also permanent once enabled, does not cover Claude Code, is not available on Claude Platform on AWS or Microsoft Foundry, and needs a separate organization for non-HIPAA work (Anthropic docs). Read the eligibility table for every feature you use; don't rely on the API to stop you.

De-identification: the way to use AI without a BAA

Data that is properly de-identified is no longer PHI. HIPAA allows two methods:

  1. Safe Harbor: remove all 18 listed identifiers (names, geographic units smaller than a state, all date elements except year, phone, email, SSN, record numbers, device IDs, URLs, IPs, biometrics, full-face photos, any other unique code) and have no actual knowledge the rest could identify someone.
  2. Expert Determination: a qualified statistician certifies the re-identification risk is very small, and documents the method.

Free-text clinical notes are hard to de-identify reliably; names and dates hide in narrative. Automated redaction tools reduce risk but do not by themselves meet Safe Harbor. For notes, a BAA-covered service is usually safer than trusting redaction.

Rules that changed or are pending

DateRuleStatus and effect
Jan 2026Texas TRAIGA (HB 149)In force: written disclosure to patients when AI is used in diagnosis or treatment; AG enforcement, $10k–$200k per violation
Aug 2025Illinois WOPR Act (HB 1806)In force: AI may not provide therapy or make independent therapeutic decisions; admin/support use only, with disclosure and oversight
May 2025HHS Section 1557 rule, 45 CFR 92.210In force: covered entities must identify decision-support tools (including AI) that use protected characteristics and mitigate discrimination risk
Jan 2025HIPAA Security Rule update (NPRM)Proposed only; final action pushed to at least July 2027. Would mandate asset inventories, MFA, encryption, annual audits. Current rule still enforced
Jan 2025California AB 3030In force: AI-generated patient communications need a disclaimer and a route to a human; AB 489 bars AI implying a healthcare license

Architecture checklist for a HIPAA AI system

  • BAA signed with the model provider or the cloud platform hosting the model
  • BAA or equivalent with every other vendor that sees PHI: logging, vector DB, storage, email, analytics
  • Only BAA-eligible features enabled; ineligible ones blocked in code
  • Zero or minimum retention configured where available
  • Minimum necessary: send only the fields the task needs
  • Encryption in transit (TLS 1.2+) and at rest for prompts, outputs, caches and indexes
  • Role-based access and audit logs on who sent and viewed what
  • Security Rule risk analysis updated to include the AI system
  • Human review of AI output before it affects care; Section 1557 bias review for decision-support tools
  • Patient disclosures where state law requires them (Texas, California, Illinois)
  • Breach response plan that covers prompt leakage and model-output exposure

Building for providers or payers? See healthcare software development.

Legal

Can lawyers use ChatGPT or Claude? ABA Opinion 512, state bars and Heppner

Yes. No US jurisdiction bans lawyers from using generative AI, including through APIs, with client information. Every bar that has spoken says the same thing: existing ethics rules apply, and the lawyer stays fully responsible. In practice that means a business or API tier that does not train on inputs and contractually protects confidentiality, client consent where the rules require it, and human verification of every output filed or sent.

The governing national guidance: ABA Formal Opinion 512 (29 July 2024)

ABA Formal Opinion 512 is the main national reference. It creates no new rules; it maps AI onto the Model Rules (summary). ABA opinions are persuasive, not binding; your state's rules govern.

Model RuleDutyWhat it means for AI
1.1 CompetenceUnderstand the tools you useKnow how the tool works, its limits (hallucinations), and its data handling. Read the terms of use and privacy policy, or rely on someone who has.
1.6 ConfidentialityProtect client informationAssess the risk that inputs are disclosed, retained or used for training. "Self-learning" tools can surface one client's data in later outputs.
1.4 CommunicationKeep the client informedTell clients when AI use matters to the representation or when they ask.
1.6 + 1.4 Informed consentConsent before confidential data enters a self-learning toolBoilerplate in an engagement letter is not enough (quoted text).
3.1, 3.3 CandorNo false statements to a tribunalVerify every citation, quotation and factual claim.
5.1, 5.3 SupervisionSupervise lawyers, staff and vendorsFirm AI policies, training, vendor due diligence.
1.5 FeesReasonable feesDo not bill hours the tool saved; learning a general tool is overhead. Charge actual costs only as agreed.

Why the API/enterprise tier matters for lawyers: Opinion 512's consent requirement is triggered by tools that may disclose or learn from inputs. An enterprise or API tier with no training, short or zero retention, and a confidentiality contract is the strongest basis for concluding the risk is low. A free consumer chatbot is the weakest.

State bar guidance (selected)

JurisdictionGuidanceKey requirement
CaliforniaState Bar Practical Guidance, revised May 14, 2026 (replaces Nov 2023)Revised at the California Supreme Court's direction; adds agentic AI; organized around competence, confidentiality, communication and candor. Non-binding
VirginiaLEO 1901, approved by the Supreme Court of Virginia Nov 24, 2025Fees only (Rule 1.5): reduced time does not automatically mean a proportionately reduced fee. Court approval gives it more weight than an ordinary advisory opinion
AlaskaEthics Opinion 2025-1 (Apr 2025)Closely tracks ABA 512
TexasOpinion 705 (Feb 2025)Permitted; lawyer fully responsible; verify output; do not bill for time saved
OregonFormal Opinion 2025-205 (Feb 2025)Use of AI tools under existing rules (text not reviewed)
MississippiEthics Opinion 267 (Nov 2024)Listed in compendiums; text not reviewed
North Carolina2024 FEO 1 (adopted Nov 1, 2024)Competence, supervision, confidentiality, oversight of output. NC formal opinions are adopted by the State Bar Council and bind lawyers for discipline
New MexicoFormal Opinion 2024-004 (Sep 2024)Listed in compendiums; text not reviewed
New York CityNYC Bar Formal Opinion 2024-5 (Aug 2024)Confidentiality, competence, supervision; disclosure to clients when external tools handle their data (index)
West VirginiaLEO 2024-01 (Jun 2024)Listed in compendiums; text not reviewed
New York StateNYSBA Task Force on AI report (Apr 2024)Recommendations on confidentiality, competence and consent; not a binding opinion
KentuckyKBA E-457 (Mar 2024)No billing for learning AI; consent depends on how much AI affects the matter (compendium)
New JerseySupreme Court Preliminary Guidelines (Jan 2024)Accuracy, truthfulness, confidentiality; telling clients recommended, not always required
FloridaOpinion 24-1 (Jan 2024)Permitted; protect confidentiality (consent recommended for third-party tools); verify; bill fairly; follow advertising rules
PennsylvaniaJoint Formal Opinion 2024-200 (PBA + Philadelphia Bar)Verify all citations and analysis; do not bill AI time as manual work
District of ColumbiaDC Bar Opinion 388 (2024)Understand AI limits, especially hallucinations; protect confidences

At least 15 state bars and courts have now issued AI opinions or guidance (compendium). Some are formal ethics opinions and others are guidance or task-force reports.

Courts: disclosure rules

  • Hundreds of individual federal and state judges have standing orders requiring AI disclosure or certification; there is no uniform rule. Check every judge's order before filing (running list). The first widely known one was Judge Brantley Starr's certification order (N.D. Tex., May 2023).
  • The Fifth Circuit considered a circuit-wide AI certification rule in 2024 and did not adopt it, relying on existing Rule 11-style duties.
  • The Illinois Supreme Court AI policy (effective 1 January 2025) says disclosure "should not be required" in pleadings; existing ethics rules govern.
  • Proposed Federal Rule of Evidence 707 would hold machine-generated evidence offered without an expert to Rule 702 reliability standards. Public comment closed 16 February 2026; it drew strong opposition and had not been adopted as of this guide (Proskauer).

Sanctions: the real enforcement risk is hallucinated citations

Courts are not sanctioning lawyers for using AI. They are sanctioning lawyers for filing unverified output. A tracking database of AI hallucination cases worldwide counted about 1,598 cases by 9 June 2026, growing by roughly 8 a day (UNC Law Library).

DateCaseOutcome
Apr 2026Coomer v. Lindell (D. Colo.)After 2025 Rule 11 fines (about $3,000) for nearly 30 defective citations, the judge proposed further sanctions for continued fake citations (report).
Jul 2025Johnson v. Dunn (N.D. Ala.), Butler SnowThree lawyers disqualified, referred to every state bar where licensed; court said fines were not deterring. Firm spared because of its AI policy (summary).
Feb 2025Wadsworth v. Walmart (D. Wyo.), Morgan & MorganEight fake citations; $3,000 fine and loss of pro hac vice for the drafter, $1,000 each for two others (Bloomberg Law).
Jun 2023Mata v. Avianca (S.D.N.Y.)$5,000 sanction for citing cases invented by ChatGPT; the case that started the trend.

Note the pattern in Johnson and Wadsworth: firms with a written AI policy and verification steps were not themselves sanctioned. A firm policy is a liability shield.

Privilege: United States v. Heppner (S.D.N.Y., Feb 2026)

Judge Rakoff ruled from the bench on February 10, 2026 and issued a written opinion on February 17. He held that about 31 chats a criminal defendant had with Anthropic's consumer Claude, made on his own without counsel's direction, were neither privileged nor work product (O'Melveny, Cleary Gottlieb). The reasoning:

  • An AI is not a lawyer, so there is no attorney-client communication.
  • The consumer terms allowed the provider to disclose and train on chats, so there was no reasonable expectation of confidentiality.
  • Sending outputs to lawyers afterwards did not make them privileged, and pasting attorney advice into the tool risked waiving privilege over that advice.

Work product failed because the materials were not prepared by or at the direction of counsel. In dicta, the court said that if counsel had directed the use, Claude "might arguably" act like the lawyer's agent. Practical reading: lawyer-directed use, on an enterprise or API tier with no training and contractual confidentiality, is the defensible position. Client self-help on consumer chatbots is not.

Civil cases point the other way for self-represented parties. In Warner v. Gilbarco (E.D. Mich., Feb 10, 2026) the court refused to compel a self-represented plaintiff's ChatGPT prompts and outputs, treating AI as a tool rather than a third party. In Morgan v. V2X (D. Colo., Mar 30, 2026) the court held that a self-represented party's AI-assisted preparation is work product under FRCP 26(b)(3), which does not require a lawyer, though the name of the tool used must be disclosed (Kirkland, Bressler). These civil cases are distinguishable from Heppner, a criminal case, but they show the question is unsettled.

Law firms and HIPAA

A law firm is a HIPAA business associate only when it provides legal services to a covered entity or business associate and that work involves PHI (HHS). A firm representing a hospital in a malpractice defense needs a BAA with the hospital, and a subcontractor BAA with any AI vendor that sees the PHI. A firm representing an individual (a personal-injury plaintiff, a party in a divorce) holding that person's own medical records is usually not under HIPAA. Those records are still client confidences under Rule 1.6, so the confidentiality analysis above applies in full.

Outside the US

  • UK: The Solicitors Regulation Authority issued a warning notice (Aug 2026) on hallucinated material and entering client confidential information into AI tools without safeguards; the solicitor, not the vendor, is liable (Legal Cheek).
  • EU: The CCBE guide (2 October 2025) advises lawyers not to input personal, confidential or client-related information into generative AI tools and to verify all outputs (eucrim). GDPR applies on top.

Law-firm checklist

  • Written firm AI policy: approved tools, banned tools (consumer chatbots for client data), verification rules
  • Vendor due diligence on file: no training, retention period, ZDR, subprocessors, breach notice, SOC 2 report
  • Engagement letter language that specifically explains AI use, plus matter-specific informed consent where data enters a tool that retains or learns
  • Citation and quotation verification by a human, logged, before every filing
  • Check each judge's standing order on AI disclosure
  • Billing policy: no hours for time saved; disclose AI tool costs if passed through
  • Training for lawyers and staff; supervision under Rules 5.1/5.3
  • Privilege protocol: AI use directed by counsel, on approved tiers, documented as such

For firms building their own tools: legal tech development.

Public sector

Government data: FedRAMP, IL4/IL5, CJIS and ITAR

For government data the question is not "is the model compliant" but "is this specific cloud offering authorized at the data's impact level". Frontier models are now available from FedRAMP Moderate up to Top Secret, but only through specific government regions and platforms. The commercial API you use for a startup is usually not the authorized route.

Authorization ladder

Data typeRequired authorizationWhere frontier models are available
Public / low-impact federalFedRAMP Low or ModerateClaude via Bedrock commercial US regions (Moderate); ChatGPT Enterprise + OpenAI API (FedRAMP 20x Moderate, 2026)
Sensitive unclassified (PII, law enforcement, health, financial)FedRAMP HighClaude on Bedrock GovCloud; Claude on Vertex with Assured Workloads; Claude for Government (Palantir FedStart); Azure OpenAI in Azure Government
DoD CUI and mission dataDoD IL4 / IL5Claude on Bedrock GovCloud (Anthropic); Azure OpenAI in Azure Government (Microsoft)
Classified SECRETDoD IL6Azure OpenAI (authorized early 2025); Claude Gov models in AWS Secret region
Top SecretICD 503Azure OpenAI Top Secret cloud; Claude Gov models in AWS Top Secret region (Anthropic gov page)
Export-controlled (ITAR/EAR)US-person-only operations + US data locationAWS GovCloud (Anthropic states ITAR support via Bedrock GovCloud); Azure Government
Criminal justice information (CJI)CJIS Security Policy v6.0 (Dec 2024)Signed CJIS agreement with your state CSA; government cloud regions with screened personnel. Vendor "CJIS-ready" claims are not FBI determinations
State and local dataGovRAMP (formerly StateRAMP), TX-RAMP, or state-specific reviewVaries by state; most accept FedRAMP as equivalent

FedRAMP 20x. FedRAMP is moving to a faster, automation-based process ("20x"). Reported 2026 changes include renaming "authorization" to "certification" and impact levels to Classes A–D; check fedramp.gov for the current terms, as these could not be confirmed against the primary source.

Federal policy that governs agency AI use

DatePolicyEffect
Dec 2025OMB M-26-04 "Unbiased AI Principles"Implements EO 14319 ("Preventing Woke AI", Jul 2025): "truth-seeking" and "ideological neutrality" become contract terms for federal LLM procurement; national security systems exempt
Aug 2025GSA OneGov deals + USAiChatGPT Enterprise and Claude offered to agencies for $1; Gemini $0.47; Grok $0.42. USAi = free GSA evaluation platform
Jul 2025CDAO frontier AI awardsUp to $200M each to Anthropic, Google, OpenAI, xAI
Apr 2025OMB M-25-21 and M-25-22Replace the 2024 memos: Chief AI Officers, minimum practices for "high-impact AI", public use-case inventories, AI acquisition rules

Vendor eligibility can change for non-technical reasons

In 2026 the Department of Defense made two separate supply-chain-risk designations of Anthropic (NPR via VPM):

  • Under 10 U.S.C. § 3252: struck down and permanently enjoined by the federal court in San Francisco on August 27, 2026 (Anthropic PBC v. U.S. Dep't of War, N.D. Cal.) (Holland & Knight).
  • Under the Federal Acquisition Supply Chain Security Act (FASCSA), 41 U.S.C. § 4713: upheld by the D.C. Circuit 2–1 on September 25, 2026 (Clark Hill, Miller & Chevalier).

The surviving order covers removal of Anthropic products from Department systems and contractor-supported Pentagon work. It is not a government-wide ban, and contractors generally may still use Claude in unrelated commercial work. They should document that separation, because FAR 52.204-29 requires a "reasonable inquiry", and some agencies are already asking for certifications. The practical lesson: for defense work, check DoD vendor restrictions, not only FedRAMP status. For civilian agencies, confirm with the contracting officer.

Government checklist

  • Classify the data first (public, CUI, PII, CJI, ITAR, classified)
  • Use only the offering authorized at that level, in the authorized region
  • Confirm the agency's own ATO or reuse of the FedRAMP package
  • Check DoD and agency vendor restrictions and any supply-chain designations
  • Apply M-25-21 high-impact AI practices (impact assessment, testing, human oversight) where applicable
  • Add M-26-04 unbiased-AI contract terms for federal LLM procurements
  • For CJI: CJIS agreement, screened personnel, audit logging
  • For ITAR: US-person-only support confirmed in writing

More on public-sector builds: government software development.

Privacy law

GDPR, the EU AI Act and US state privacy laws

Privacy law governs personal data whatever the sector, so it applies on top of HIPAA, bar rules or government rules. Using an AI API is lawful under GDPR and US state laws if you have a lawful basis, a processor contract (DPA), a valid transfer mechanism, and you honor data-subject rights. The EU AI Act adds separate duties depending on what the AI system is used for.

GDPR (EU) essentials for AI APIs

  • Roles: you are the controller; the AI provider is your processor under a DPA (Article 28). If the provider uses your data to train its own models, it becomes a controller for that use, which is why "no training" terms matter.
  • Lawful basis: usually contract or legitimate interest for business use. Special category data (health, biometrics, religion) needs an Article 9 condition as well.
  • DPIA: a Data Protection Impact Assessment is expected for new AI processing of personal data at scale or of sensitive data.
  • Transfers to the US: the EU-US Data Privacy Framework is valid. The General Court rejected the Latombe challenge (3 September 2025); an appeal is pending before the Court of Justice (C-703/25 P). Keep Standard Contractual Clauses as a fallback.
  • Models and personal data: EDPB Opinion 28/2024 says a model trained on personal data is not anonymous by default; unlawful training can taint later deployment.
  • Enforcement: Italy's €15M fine on OpenAI (Dec 2024) was annulled on jurisdiction grounds in March 2026 (Ireland is OpenAI's lead authority); the court did not rule on substance.
  • Residency: GDPR does not require EU-only processing, but many customers' contracts do. EU regional processing is available from OpenAI, Azure (EU DataZone), Vertex AI and Bedrock EU regions; the direct Claude API offers only global or US inference.

EU AI Act: what applies when

The AI Omnibus (Regulation (EU) 2026/1744, in force 27 July 2026) delayed the high-risk rules.

DateWhat applies
Feb 2, 2025Prohibited practices (social scoring, certain biometric uses, manipulative AI); AI literacy duty for staff
Aug 2, 2025Obligations for general-purpose AI (GPAI) model providers; GPAI Code of Practice signed by Anthropic, OpenAI, Google, Microsoft, Amazon, Mistral, IBM and others (Meta declined; xAI signed one chapter)
Jul 27, 2026Omnibus in force. AI literacy duty softened: from "ensure a sufficient level of AI literacy" to "take measures to support the development of AI literacy" of staff (Cuatrecasas)
Aug 2, 2026Article 50 transparency duties (tell people they are dealing with AI); AI Office enforcement powers over GPAI
Dec 2, 2026New prohibitions added by the Omnibus: AI that generates non-consensual intimate imagery ("nudification") or child sexual abuse material. Also marking of AI-generated synthetic content (Article 50(2))
Dec 2, 2027High-risk systems in Annex III: employment, credit, education, essential services, law enforcement, justice
Aug 2, 2028High-risk AI embedded in regulated products (Annex I, e.g. medical devices)

For most businesses using an API, the AI Act duties fall on you as the deployer of a system, depending on use case. Using AI to screen job applicants or score credit is high-risk; drafting marketing copy is not. AI used in the administration of justice is listed as high-risk, which matters for legal-tech products.

UK

The Data (Use and Access) Act 2025 took effect for its main data-protection provisions on 5 February 2026. It relaxes the old ban on solely automated decisions: they are allowed with safeguards (information, representations, human intervention, right to contest), except where special category data is involved. UK GDPR otherwise mirrors the EU rules above.

United States

  • No federal privacy law. About 20 state comprehensive privacy laws are in effect in 2026 (MultiState), all requiring processor contracts, and most giving opt-outs from profiling.
  • California: CCPA regulations on automated decision-making technology took effect 1 January 2026; ADMT compliance from 1 January 2027; risk assessments due for existing activities by 31 December 2027.
  • Colorado: the 2024 AI Act never took effect. It was repealed and replaced by SB 26-189 (May 2026), a narrower ADMT law effective 1 January 2027 (McDermott).
  • Federal pressure on state AI laws: Executive Order 14365 (11 December 2025) created a DOJ task force to challenge state AI laws and ties broadband funds to them. It does not itself preempt any state law; comply with state laws until a court says otherwise.
  • Sector laws still apply: GLBA (financial data), FERPA (student records), COPPA (children under 13), state biometric laws such as Illinois BIPA.

Breach notification

All 50 states, plus DC, Guam, Puerto Rico and the US Virgin Islands, have data breach notification laws (Jackson Lewis). A vendor processing data for a client is usually a "third-party agent" with its own duty to tell the client. Example: Florida § 501.171 requires notice to the state within 30 days for a breach affecting 500+ Floridians. A third-party agent must notify the covered entity within 10 days, and penalties reach $500,000 per breach. If you build AI products on client data, your contracts and incident plan need these clocks, separate from HIPAA's 60-day ceiling.

Foreign-hosted models

DeepSeek's privacy policy states user data is stored in the People's Republic of China. Italy ordered it to stop processing Italian users' data (January 2025), and Australia, Taiwan, South Korea and the Czech Republic restricted it on government systems (Al Jazeera). Do not send regulated data to a hosted service whose data may be held under a foreign government's jurisdiction without a legal review.

Related: the EU AI Act’s watermarking rules explained and what new AI rules mean for builders.

Checklist

How to evaluate an AI provider: decision route and questionnaire

Start from the most sensitive data that will ever enter the system, not from the model. The data category sets the minimum contract and authorization; model quality is chosen only among offerings that clear that bar. When data types mix, every rule that legally applies, applies.

The data type, not the model, decides the routePublic or internal (no personal data): Any business or API tier consumer apps only with care. Personal data (GDPR, US state laws): DPA, no training, transfer basis, regional processing if contracted. Health data (PHI) (HIPAA, state health laws): Signed BAA + eligible features only, or de-identify first. Client confidences (bar ethics rules): Enterprise or API tier, no training, firm policy, consent, verify output. Government data (FedRAMP, CJIS, IL4/IL5): Authorized gov region at that impact level, agency ATO. Classified or ITAR (IL6, Top Secret, export law): Classified gov regions, US persons, or self-hosted and air-gapped.The data type, not the model, decides the routeWhat goes intothe prompt?Public or internalno personal dataAny business or API tierconsumer apps only with carePersonal dataGDPR, US state lawsDPA, no training, transfer basis,regional processing if contractedHealth data (PHI)HIPAA, state health lawsSigned BAA + eligible features only,or de-identify firstClient confidencesbar ethics rulesEnterprise or API tier, no training,firm policy, consent, verify outputGovernment dataFedRAMP, CJIS, IL4/IL5Authorized gov region at thatimpact level, agency ATOClassified or ITARIL6, Top Secret, export lawClassified gov regions, US persons,or self-hosted and air-gapped
Start from the most sensitive data that will ever reach the model. When types mix, every rule that legally applies, applies.

If more than one row legally applies (a law firm defending a hospital that is also a federal contractor), every applicable row's requirements apply at once. First check which rules actually reach your data: a law firm holding its own client's medical records is under Rule 1.6, not HIPAA (see the lawyers section).

Five-step evaluation

  1. Classify the data. List every data type that could reach the model, including through uploaded documents, retrieval indexes and tool results.
  2. Pick the tier and route. Business or API tier only for regulated data. Decide direct API vs cloud platform (Bedrock, Vertex, Azure) based on which contracts and authorizations you need.
  3. Get the paperwork. DPA, BAA, ZDR addendum, SOC 2 Type II report, subprocessor list, FedRAMP package as applicable. Keep copies with dates.
  4. Configure to match the contract. Enable ZDR or HIPAA mode, disable ineligible features, pin regions, set retention, restrict access.
  5. Govern your own side. Logging redaction, vector DB security, staff policy, human review of outputs, incident response, annual vendor re-review.

Vendor due-diligence questionnaire

#QuestionAcceptable answer for regulated data
1Is our data used to train or improve any model, including via human review?No, by contract; opt-in only
2How long are inputs and outputs retained, and for what purposes?Defined period (days), stated purposes; zero available
3Which features are excluded from zero retention?A written list we can check our usage against
4Will you sign a BAA? Which services and features does it cover?Yes, with a feature-level eligibility list
5Will you sign a DPA with SCCs / DPF certification?Yes
6Where is data processed and stored? Can we pin a region?Named regions; pinning available
7Who are your subprocessors, including other model providers?Published list with change notice
8Can your staff see our prompts? Under what conditions?Only for flagged abuse or support with consent; logged
9Which audits and certifications are current? Can we see the reports?SOC 2 Type II under NDA; ISO 27001; ISO 42001 a plus
10What is your breach notification timeline?Without undue delay; contractual hours/days; HIPAA 60-day ceiling
11What happens to our data under a legal hold or subpoena?Notice to us where legally allowed; ZDR data not preserved
12Is the service authorized for government use at our level?Named FedRAMP / IL listing on the Marketplace
13How do you handle encryption in transit and at rest; customer-managed keys?TLS 1.2+, AES-256, CMK option for high-sensitivity data
14Can we delete our data on demand and get confirmation?Yes, with documented timelines
15How will we be told about changes to these terms?Advance notice with right to terminate

Red flags: "HIPAA certified" (no such certification), a BAA that does not list services, "we may use data to improve our services" in business terms, no SOC 2 Type II, refusal to name subprocessors, data hosted in a jurisdiction your regulator restricts.

Alternative

Self-hosted and open-weight models

Running an open-weight model (Llama, Mistral, Qwen, Gemma, gpt-oss and similar) on your own servers removes the third-party processor from the data path, but it moves every compliance duty onto you. It is the right answer when data legally cannot leave your environment (classified, some ITAR, air-gapped networks, contractual no-cloud clauses), and usually the wrong one when a BAA-covered cloud API is acceptable.

FactorCloud API under BAA/DPA/ZDRSelf-hosted open-weight model
Who holds the dataVendor processes it under contractOnly you
Security controls and auditsVendor's SOC 2 / ISO / FedRAMP plus yoursEntirely yours: access control, logging, patching, encryption, pen tests
HIPAA paperworkBAA with the vendor (and its subprocessors)No model-vendor BAA needed; hosting provider BAA still needed if in a cloud
Model qualityFrontier modelsUsually behind frontier models on hard reasoning and long documents
Cost profilePay per tokenGPUs, ops staff, upgrades; cheaper only at sustained high volume
License termsVendor terms of serviceModel license (some restrict use, user counts or field of use; read it)
Supply-chain riskVendor's responsibility, contractuallyYours: verify weights' origin, scan model files, pin versions
Origin concernsUS/EU vendors with published policiesSome agencies and states restrict models from certain countries even when self-hosted; check your sector's list

A middle path is a managed model inside your own cloud account: the same frontier model served by AWS Bedrock, Google Vertex AI or Azure, under the cloud provider's BAA, FedRAMP scope and regional controls you already use. For most regulated organizations this is the practical sweet spot.

Risks that stay the same either way: prompt injection, data leakage through retrieval (RAG) indexes, over-broad access to source documents, and logs or traces that capture sensitive prompts. Self-hosting does not fix these.

Background: open vs closed AI models.

Limits

What is known, and what is not

The data-handling side is well understood and contract-backed; the legal side is still forming, mostly through ethics opinions and a handful of court rulings. Standards bodies have not caught up with AI-specific risks, so certifications prove a vendor runs a sound security program, not that a model is safe for a given use.

AreaConfidenceWhy
Training on API/enterprise dataHighEvery major vendor commits to no training in contract terms; verifiable in published docs
Retention periods and ZDRHigh, per vendorDocumented, but exceptions vary by feature and change with new products (e.g. model-specific retention on Bedrock)
BAA availabilityHighPublished by all major clouds and model providers; scope lists must be checked per feature
HIPAA rules for AI specificallyMediumNo AI-specific HIPAA rule; Security Rule update delayed to 2027 at the earliest; guidance is general
Lawyer ethicsMedium-highABA 512 plus 10+ state opinions agree on the framework; details (consent thresholds, billing) differ by state
Privilege for AI-assisted workLowHeppner (criminal, consumer Claude, no counsel direction) denied protection; Warner and Morgan (civil, self-represented parties) granted work-product protection; the counsel-directed, enterprise-tier case is undecided
Court disclosure rulesLowJudge-by-judge standing orders; no uniform federal rule; FRE 707 not adopted
EU AI Act obligationsMediumDates now fixed by the Omnibus; harmonized standards and guidance still being written
US state AI lawsLowColorado repealed and replaced; federal executive order targets state laws; litigation ongoing
Government authorizationsMediumFedRAMP 20x terminology and process changing in 2026; vendor eligibility can change for policy reasons
Model-level risks (prompt injection, memorisation, leakage via outputs)LowNo certification measures these; ISO 42001 covers management process, not model behavior

Gaps no standard covers yet:

  • Memorisation: whether a model trained on data can reproduce it. Irrelevant for API data that is never trained on, central for consumer tiers.
  • Prompt injection: a document or web page can instruct an AI agent to leak data it has access to. This is a design problem in your system, not a vendor certification item.
  • Agentic tools: when a model can browse, run code or call APIs, data can leave the BAA or ZDR boundary through the tool, not the model. Several vendors exclude exactly these features from ZDR and HIPAA scope.
  • Subprocessor chains: a product can route to a different model provider under the hood (for example Microsoft Copilot using Anthropic models outside the EU Data Boundary). Read the subprocessor list, not only the main contract.
  • Policy volatility: terms and availability change. Anthropic's consumer training default changed in 2025; litigation suspended OpenAI's deletion in 2025; a DoD designation changed Anthropic's defense eligibility in 2026. In June 2026 a Commerce Department export-control directive restricted access to Claude Fable 5 and Mythos 5 until it was terminated on June 30, with access returning from July 1 (Digital Policy Alert; news reports only, no Anthropic statement found). Re-review vendors at least yearly, and build regulated products with a tested fallback model so they do not depend on one model.
Regulated data, real AI

NerdHeadz builds AI products that pass a compliance review.

Tell us what data your product touches. We’ll map the right provider route, contracts and settings, and come back with a scoped proposal within 48 hours.

FAQ

Frequently asked questions

Is ChatGPT HIPAA compliant?

Not the consumer versions. ChatGPT Free, Plus, Pro and Team come with no Business Associate Agreement, so they must never receive protected health information. OpenAI signs a BAA for its API on request (reported to require zero or modified data retention) and for ChatGPT Enterprise and Edu through its sales team. HIPAA compliance then also depends on using only covered features and on your own safeguards.

Is Claude HIPAA compliant, and does Anthropic sign a BAA?

Yes for the Claude API with “HIPAA readiness” enabled: eligible organizations sign Anthropic’s BAA in the Console or through sales, and requests to ineligible server tools such as web fetch and code execution are rejected. The setting is permanent, does not cover Claude Code, and the client-side browser use tool is not blocked even though it is out of scope. Claude Free, Pro and Max are not covered. Claude on AWS Bedrock or Google Vertex AI falls under those clouds’ BAAs.

Which AI tools are HIPAA compliant?

No AI tool is HIPAA compliant on its own; HIPAA has no certification. What exists is BAA coverage for specific services: the Claude API (HIPAA readiness), the OpenAI API and ChatGPT Enterprise/Edu, Google Vertex AI, Azure OpenAI and Microsoft 365 Copilot, and AWS Bedrock. You are compliant only if a BAA covers the exact features you use and your own systems (logs, vector databases, staff access) meet the Security Rule.

Is it safe to put confidential client information into ChatGPT or Claude?

Not into consumer chat apps, which may train on your conversations and give no confidentiality contract. A business or API tier that does not train on inputs, keeps data briefly or not at all, and is covered by a confidentiality agreement is the defensible route. Lawyers should also follow ABA Formal Opinion 512: understand the tool, protect confidentiality, get informed consent where a tool retains or learns from inputs, and verify every output.

Does Claude, ChatGPT or Gemini train on my data?

On business and API tiers, no: Anthropic, OpenAI, Google (paid Gemini API and Vertex AI), Microsoft and AWS all commit not to train on customer data by default. Consumer tiers differ: since August 2025 Claude Free, Pro and Max conversations are used for training unless the user opts out; ChatGPT consumer accounts train by default with an opt-out; and the unpaid Gemini API tier is used to improve Google’s products, with human review possible.

What is a zero data retention agreement?

A contract addendum under which the AI provider does not store your prompts and outputs after returning a response, apart from narrow abuse or legal exceptions. It is approved per organization, not on by default, and excludes stateful features such as file storage, batch jobs and agent sessions. Some newer models require retention regardless; Anthropic’s Fable 5/5.1 and Mythos 5/5.1, for example, need 30-day retention unless expressly authorized.

Can lawyers use ChatGPT or Claude, and are AI chats privileged?

Yes, lawyers may use generative AI under ABA Formal Opinion 512 and at least 15 state bar opinions and court policies, as long as they meet their duties of competence, confidentiality, client communication, candor, supervision and fair billing. On privilege, United States v. Heppner (S.D.N.Y., February 2026) held that a defendant’s own consumer-Claude chats, made without counsel’s direction, were not privileged; two civil courts (Warner, Morgan) protected self-represented parties’ AI work as work product. Lawyer-directed use on an enterprise tier is the defensible position.

Which AI models are FedRAMP authorized?

Claude is FedRAMP High and DoD IL4/IL5 on AWS Bedrock in GovCloud, FedRAMP High on Google Vertex AI with Assured Workloads, and FedRAMP High as Claude for Government. Azure OpenAI is FedRAMP High and IL4/IL5 in Azure Government, with IL6 and Top Secret clouds authorized. ChatGPT Enterprise and the OpenAI API announced FedRAMP 20x Moderate in April 2026. The commercial direct APIs are generally not the authorized route for federal data.

Aleksandr Kamenev

Aleksandr Kamenev

Founder & CEO, NerdHeadz

Aleksandr founded NerdHeadz in 2022 to ship software in production, not decks. The team has delivered 60+ products and builds AI systems for healthcare, legal, fintech and public-sector clients — with senior engineers owning every data-handling decision.

Sources and verification notes

Researched 12 October 2026. Vendor terms change often; re-check the primary pages before relying on any cell. This guide is general information, not legal advice. Have counsel review contracts and jurisdiction-specific duties.

Primary vendor documentation

Government and regulators

Secondary analysis (law firms, trade press) is linked inline in each section.

Could not be verified against a primary source: OpenAI BAA scope and certifications (help center blocked); xAI data terms; Azure's default abuse-monitoring retention period; FedRAMP 20x 2026 terminology; NYT v. OpenAI order details (press reports only); several state bar opinions (NYC 2024-5, DC 388, Oregon 2025-205, West Virginia 2024-01, New Mexico 2024-004, Mississippi 267) were confirmed only through compendiums; the June 2026 export-control episode (news reports only); the EU AI Omnibus details (law-firm summaries, not the Official Journal text); the exact 2026 California guidance changes (summaries only).

Related: all NerdHeadz guides · vibe-coding security risks · 33 questions executives ask about AI · fintech and banking development