True Care SystemTrue Care SystemDocumentation
Return to Website
DocumentationAI Agents › AI Safety & Limitations
AI AGENTS • GOVERNANCE

AI Safety & Limitations

Responsible-AI controls, prohibited uses, and human accountability.

Document IDAI-DOC-010
Version1.0
StatusDraft
Last Updated07/28/2026
Responsible AI, privacy, and provider-isolation notice

AI features are designed as assistive tools for authorized users. They do not replace required human review, professional judgment, Provider policy, or applicable legal and regulatory obligations. Public screenshots and examples must use redacted or demonstration information.

Purpose

This page defines the safety boundaries that apply to all True Care System AI capabilities. AI is an assistive layer and must not bypass user permissions, Provider policy, regulatory obligations, or required professional judgment.

AI Safety & Limitations
AI Safety & Limitations workspace or infographic.

Required Controls

Human-in-the-loop

Material decisions require review and confirmation by an authorized person.

Role-based access

AI cannot grant permissions or disclose records beyond the user’s role.

Provider isolation

AI may not combine or expose data from different Providers.

Data minimization

Only the minimum information necessary for the approved task should be processed.

Audit logging

Relevant AI-assisted actions, approvals, and exceptions should be reviewable.

Source transparency

Users should be able to identify whether an answer is based on system data, documentation, or an AI inference.

Prohibited Uses

Autonomous clinical decisions

AI must not diagnose, prescribe, administer medication, or replace licensed clinical judgment.

Autonomous legal or regulatory decisions

AI must not make final breach, employment, tax, billing, or compliance determinations.

Credential processing

Do not submit passwords, OTP codes, private keys, or full financial credentials.

Unapproved PHI disclosure

Do not transmit PHI to unapproved external AI systems.

Silent record changes

AI must not alter operational records without an authorized, attributable action.

Known Limitations

Incomplete data

Recommendations may be incorrect when source records are missing, stale, or inconsistent.

Model error

AI can misunderstand context or produce inaccurate statements.

Changing requirements

Federal, state, payer, and program requirements may change and must be independently verified.

Human accountability

The authorized user remains responsible for the final action.

Security and HIPAA Expectations

Authorization

Users may access only the records and functions permitted by their assigned role and Provider scope.

Minimum necessary

Only information reasonably required for the approved operational purpose should be processed.

Human review

Authorized personnel remain responsible for validating recommendations and approving final actions.

Auditability

Material AI-assisted activity should remain attributable, reviewable, and connected to the source workflow.