SozoRockTechnology

RESEARCH / EMERGING APPLIED RESEARCH

Autonomous Systems Assurance

When software can act, what determines whether an action should proceed, be independently verified, require human authorization, be denied, or be isolated?

Control for systems that can act.

SozoRock is examining how autonomous systems should be authorized, independently verified and escalated when their actions affect consequential systems. The research starts with a proposed action and the context in which it would take effect.

This is an emerging applied research direction. It is not a completed commercial product or a deployed security platform.

CONCEPTUAL RESEARCH DEMONSTRATION

An autonomous action
enters a decision path.

Agent proposes a consequential system change. Before execution, examine its identity, permission, affected resource, consequence, reversibility, verification and policy.

Open the synthetic scenarios below to follow each decision. Compare the two Deploy code examples: the proposed action is the same, but the identity and context change the outcome. These examples do not execute actions, connect to systems or evaluate visitor data.

Read a non-sensitive recordKnown identity, permitted read
  1. Identity

    A known service identity.

  2. Permission

    Read permission for this record.

  3. Affected resource

    A synthetic, non-sensitive record.

  4. Consequence

    No system state changes.

  5. Reversibility

    No persistent change to reverse.

  6. Verification

    The source and read scope have been checked independently.

  7. Policy

    The proposed read stays within the permitted scope.

CONCEPTUAL OUTCOME

ALLOW

In this example, the bounded read may proceed. Permission does not extend to later writes or other records.

Modify an access policyA consequential permission change
  1. Identity

    A known automation identity.

  2. Permission

    Permission to propose a policy change, not approve it.

  3. Affected resource

    A synthetic service access policy.

  4. Consequence

    A change could expand who can reach the service.

  5. Reversibility

    The prior policy is available for restoration.

  6. Verification

    Confidence from the proposing agent is insufficient; an independent check of the policy difference is missing.

  7. Policy

    Pause execution until the independent check supplies the required evidence.

CONCEPTUAL OUTCOME

VERIFY

Verify the proposed permission change before making a new decision. A successful check would not automatically authorize execution.

Deploy codeVerified change to a production service
  1. Identity

    A known deployment identity.

  2. Permission

    Permission to propose a release.

  3. Affected resource

    A synthetic production service.

  4. Consequence

    The change could interrupt a service people depend on.

  5. Reversibility

    A tested rollback is available, but disruption would still matter.

  6. Verification

    Independent tests and change review are available.

  7. Policy

    A responsible human must authorize this consequential release.

CONCEPTUAL OUTCOME

HUMAN AUTHORIZATION

Technical checks provide evidence for a decision. In this example, a named human must authorize the specific action before it proceeds.

Change a production databaseIrreversible change outside policy
  1. Identity

    A known maintenance identity.

  2. Permission

    Permission for bounded maintenance only.

  3. Affected resource

    A synthetic production database.

  4. Consequence

    The proposed deletion would remove required records.

  5. Reversibility

    No verified recovery path exists for the proposed deletion.

  6. Verification

    The proposal conflicts with the stated retention requirement.

  7. Policy

    The action violates an explicit constraint.

CONCEPTUAL OUTCOME

DENY

Do not execute this proposal. A different, permitted approach needs a new review; more confidence alone cannot override the constraint.

Deploy codeUnexpected identity and scope
  1. Identity

    The identity cannot be reliably established.

  2. Permission

    The request claims permissions outside the expected scope.

  3. Affected resource

    The same synthetic production service.

  4. Consequence

    An untrusted actor could change a consequential system.

  5. Reversibility

    Rollback cannot establish whether the actor is trustworthy.

  6. Verification

    Identity and permission evidence conflict with the request.

  7. Policy

    Contain the activity and require investigation before further actions.

CONCEPTUAL OUTCOME

ISOLATE

Isolate the untrusted activity in this conceptual example. The same deploy action receives a different decision because its context changed.

Illustrative reasoning only. These examples are not a validated decision model, security assessment or guarantee of safe execution. Real decisions require evidence, defined authority and controls appropriate to the system.

Questions guiding the research

Authorization and human control

Which identity and permissions apply to the specific action? When should a responsible human authorize it, and how can that authority remain bounded, visible and revocable?

Independent verification and risk

What evidence must be checked separately from the agent proposing the action? How should consequences, reversibility and uncertainty affect whether execution can proceed? Confidence is an input to examine, not permission to act.

Multi-agent accountability

When one agent delegates to another, how should responsibility and permission boundaries be retained? Delegation should not make the responsible actor or the basis for a decision disappear.

Evidence and auditability

What record is needed to explain the proposed action, the evidence considered, the policy applied, the authorizing actor and the resulting outcome? How can that record support later review without collecting unnecessary sensitive information?

Applied work and research

Our commercial AI work focuses on practical workflows, evaluation and human review. Our cybersecurity work addresses identity, permissions and operational controls. This research examines further questions raised when systems can initiate actions.