RESEARCH / EMERGING APPLIED RESEARCH
Autonomous Systems Assurance
When software can act, what determines whether an action should proceed, be independently verified, require human authorization, be denied, or be isolated?
Control for systems that can act.
SozoRock is examining how autonomous systems should be authorized, independently verified and escalated when their actions affect consequential systems. The research starts with a proposed action and the context in which it would take effect.
This is an emerging applied research direction. It is not a completed commercial product or a deployed security platform.
CONCEPTUAL RESEARCH DEMONSTRATION
An autonomous action
enters a decision path.
Agent proposes a consequential system change. Before execution, examine its identity, permission, affected resource, consequence, reversibility, verification and policy.
Open the synthetic scenarios below to follow each decision. Compare the two Deploy code examples: the proposed action is the same, but the identity and context change the outcome. These examples do not execute actions, connect to systems or evaluate visitor data.
Read a non-sensitive recordKnown identity, permitted read
Identity
A known service identity.
Permission
Read permission for this record.
Affected resource
A synthetic, non-sensitive record.
Consequence
No system state changes.
Reversibility
No persistent change to reverse.
Verification
The source and read scope have been checked independently.
Policy
The proposed read stays within the permitted scope.
CONCEPTUAL OUTCOME
ALLOW
In this example, the bounded read may proceed. Permission does not extend to later writes or other records.
Modify an access policyA consequential permission change
Identity
A known automation identity.
Permission
Permission to propose a policy change, not approve it.
Affected resource
A synthetic service access policy.
Consequence
A change could expand who can reach the service.
Reversibility
The prior policy is available for restoration.
Verification
Confidence from the proposing agent is insufficient; an independent check of the policy difference is missing.
Policy
Pause execution until the independent check supplies the required evidence.
CONCEPTUAL OUTCOME
VERIFY
Verify the proposed permission change before making a new decision. A successful check would not automatically authorize execution.
Deploy codeVerified change to a production service
Identity
A known deployment identity.
Permission
Permission to propose a release.
Affected resource
A synthetic production service.
Consequence
The change could interrupt a service people depend on.
Reversibility
A tested rollback is available, but disruption would still matter.
Verification
Independent tests and change review are available.
Policy
A responsible human must authorize this consequential release.
CONCEPTUAL OUTCOME
HUMAN AUTHORIZATION
Technical checks provide evidence for a decision. In this example, a named human must authorize the specific action before it proceeds.
Change a production databaseIrreversible change outside policy
Identity
A known maintenance identity.
Permission
Permission for bounded maintenance only.
Affected resource
A synthetic production database.
Consequence
The proposed deletion would remove required records.
Reversibility
No verified recovery path exists for the proposed deletion.
Verification
The proposal conflicts with the stated retention requirement.
Policy
The action violates an explicit constraint.
CONCEPTUAL OUTCOME
DENY
Do not execute this proposal. A different, permitted approach needs a new review; more confidence alone cannot override the constraint.
Deploy codeUnexpected identity and scope
Identity
The identity cannot be reliably established.
Permission
The request claims permissions outside the expected scope.
Affected resource
The same synthetic production service.
Consequence
An untrusted actor could change a consequential system.
Reversibility
Rollback cannot establish whether the actor is trustworthy.
Verification
Identity and permission evidence conflict with the request.
Policy
Contain the activity and require investigation before further actions.
CONCEPTUAL OUTCOME
ISOLATE
Isolate the untrusted activity in this conceptual example. The same deploy action receives a different decision because its context changed.
Illustrative reasoning only. These examples are not a validated decision model, security assessment or guarantee of safe execution. Real decisions require evidence, defined authority and controls appropriate to the system.
Questions guiding the research
Authorization and human control
Which identity and permissions apply to the specific action? When should a responsible human authorize it, and how can that authority remain bounded, visible and revocable?
Independent verification and risk
What evidence must be checked separately from the agent proposing the action? How should consequences, reversibility and uncertainty affect whether execution can proceed? Confidence is an input to examine, not permission to act.
Multi-agent accountability
When one agent delegates to another, how should responsibility and permission boundaries be retained? Delegation should not make the responsible actor or the basis for a decision disappear.
Evidence and auditability
What record is needed to explain the proposed action, the evidence considered, the policy applied, the authorizing actor and the resulting outcome? How can that record support later review without collecting unnecessary sensitive information?
Applied work and research
Our commercial AI work focuses on practical workflows, evaluation and human review. Our cybersecurity work addresses identity, permissions and operational controls. This research examines further questions raised when systems can initiate actions.