Risk Management | Hokstad Consulting

Risk Management

Blog posts in the Risk Management category

AI Agent Tool Recovery: Retry vs Re-route vs Replan

Choose the smallest safe recovery for failed tool calls: retry, re-route or replan using error type, execution state, risk and budget.

Read more

How RAG Systems Resolve Conflicting Source Evidence

How RAG systems detect and reconcile conflicting sources by comparing claims, grouping evidence by scope and authority, and verifying citations.

Read more

Tool Contract Tests vs End-to-End Tests for AI Agents

Catch interface drift with contract tests, then use sandboxed end-to-end tests to verify agent decisions, state and safe recovery.

Read more

Pydantic Validates AI Tool Arguments Before Execution

Validate AI-generated tool arguments with Pydantic v2 using strict types, safe correction feedback and two retry attempts before execution.

Read more

AI Agent Recovery: Replay and Duplicate Tool Actions

Save action IDs, reuse idempotency keys, limit retries and reconcile unknown outcomes to prevent duplicate payments.

Read more

BackdoorBench: Attack and Defence Testing for AI Teams

Benchmark image-classification backdoors with repeatable tests measuring ASR, clean accuracy and compute cost across attacks and defences.

Read more

AI Agent Sagas: Orchestration vs Choreography

Compare orchestration vs choreography for AI agent sagas: control, recovery ownership, idempotency, tracing and support‑cost trade‑offs.

Read more

ROCm Upgrades: AMD Driver Compatibility Risks

Whole‑stack ROCm upgrade checklist: verify GPU/kernel/driver compatibility, run canaries, pin versions and rehearse rollback.

Read more

AI Agent Contracts: Liability Caps and Loss Recovery

Headline caps can mislead: test fixed, fee-based and risk-specific AI agent limits against recoverable losses, exclusions and supplier ability to pay.

Read more

Self-Questioning Prompts for RAG: Checking Evidence

15 self-questioning prompts to verify RAG sources: map claims to passages, check conflicts and decide to answer, qualify, retrieve or abstain.

Read more

AI Roadmaps: Linking Business Vision to Deployment

Start with measurable business targets, verify data and controls, run phased pilots and decision gates for safe AI deployment.

Read more

AI Pilot vs Production: How Decision Gates Differ

Pilot success isn’t permission to launch; satisfy four gates—test coverage, user exposure, support ownership and failure limits—before production.

Read more