Nestack Agent Care
Industries / Construction / Site-vision agent

Construction AI agent · Site vision

Site-Vision & Progress-Capture AI Agent

Capture the site, index it to the model and the date, and rank what looks wrong — then route each observation to a named owner on a clock, because one nobody closes is evidence.

4–6 weeksTypical delivery
Your stackDeployment
Identity-freeSafety review
Agent CareAfter launch

What this agent does

Captures the site; it does not call the breach

In
01

Capture from 360 walkthroughs, fixed cameras and scheduled flights, each flown by a named certificated pilot.

02

Blur faces and mask off-site areas at ingest, before a frame reaches a screen — no face or gait template is made.

Reason
03

Register each capture to the model and the date, and index it to the level, the zone and the capture position.

04

Compute geometric deltas between captures and against the baseline revision the project has named as current.

05

Compute progress per element as an estimate, carrying its method and confidence — never as a certified figure.

Decide
06

Rank candidate observations against the rule set configured for this site, not against a national default.

07

Route each ranked observation to the named person with authority to abate it, with an escalation clock running.

Out
08

Retain the frame, the rule cited, the routing, the owner and the closure decision against the observation.

09

Execute write actions only inside the approval boundaries agreed during implementation.

Product statement

The agent raises candidates; the site safety manager decides what is a breach — and once raised, an observation cannot be unrecorded, only closed, late and on the record.

Example workflow

One capture run, frame to owner

AgentHuman
1Capture run receivedA 360 walkthrough, a fixed-camera series or a flight with a named remote pilot
2Frames de-identifiedFaces blurred and off-site areas masked at ingest, before any person sees the frame
3Candidates rankedDetected conditions, progress deltas, the frame and confidence
4Controls appliedSite rule set, capture-boundary checks, recognition gate and confidence threshold
No human action required

Stages 1 to 4 run unaided, and nothing is a breach at any of them — the agent is ranking candidates, and the safety lane opens at the confidence gate.

5DecisionBranches at the confidence threshold
High confidence

Goes to the owner who can abate it.

Low confidence

Picks up a site-safety triage read first.

Safety review

The observation is held with its frame, the rule cited and the confidence.

Assign · Reclassify · Escalate to the safety manager
Assigned — owner and clock set
6Site systems updatedOnly where write access and approval policy allow it
7Outcome evaluatedMissed hazards, false positives, time to closure and observations closed with no action
Closures

Every closure decision is counted in the evaluation.

What should not run autonomously

Human approval stays in control

Outside the boundary — human approval required8 items
Enrolling, templating or matching a face or gait.
Deciding a detected condition is a breach.
Directing a worker to stop, or clearing work to resume.
Certifying a progress claim or completion percentage.
Automation boundaryAgent acts unaided
Capture, stitch, register and index imagery to the model and date.
Compute geometric deltas against the baseline.
Rank candidates and route them with an escalation clock.
Blur faces and off-site areas at ingest, before anyone sees a frame.
Writes happen inside the boundaries agreed at implementation, never onto a certificate.
Authorising flight over people or beyond line of sight.
Closing an observation without action.
Publishing imagery outside the authorised list.
Feeding an observation into a disciplinary decision.

Example output

One observation, annotated

Everything the agent raises is attached to the frame it came from, and to the clock it starts.

Observation output · single frameIllustrative example
Zone
Detected condition
Measured gap
Rule cited
Confidence
Routed to
Level 4, north face
Unprotected edge at a slab penetration, adjacent to a stacked load
1.8 m opening
Edge-protection rule
88%
The exposing employer's supervisor
As receivedTaken from the registered frame and the configured rule set — nothing here is decided by the agent.
Frame evidence used Registered frame Baseline model Prior capture
Why it was raisedIt matches a rule configured for this zone — the breach call is the manager's.
ActionAssignReclassifyEscalate to the safety manager
What the score decidesBelow the threshold the observation picks up a triage read before an owner.

Value

Where AI adds value

The same four claims, placed at the point in the workflow where each one applies.

Where the value landsValue 01 – 04
Every capture runFrom the capture run
03Detection

Rank against the site rule set

Draw on the baseline model, the prior capture and the rule set configured for this site.

01Approved path

Point the walk at the risk

Routine coverage arrives already indexed to the level, the zone and the date.

02Human review

Put the walk-round on the list

Ranked candidates carry their confidence and their clock, so the walk-round starts at the top.

04Build an evidence trail

Each observation keeps its frame, its confidence and who it was routed to.

Integrations

Typical integrations

Five system groups connect to the same agent. Which of them are in scope is decided in discovery.

Reality captureOpenSpace · StructionSite
Matterport · Reconstruct
Drone and surveyDroneDeploy · Propeller Aero
Surveyed capture positions
Progress and safety visionBuildots · Disperse
Voxel · Protex AI

Agent

Site vision & progress capture

Reads the frame
Ranks candidates
Routes to an owner

Project systemsProcore · Autodesk Build
BIM baselines · EarthCam
Observability & evaluationOpenTelemetry · Langfuse
Supported monitoring/evaluation sources

Integration availability depends on the client's existing systems and API access.

Agent controls

Six layers between the model and the site

Each control wraps the one inside it. None of them closes an observation — and one raised and left open is worse than one never raised.

L6 · Outermost — last line of defenceInward → L1 · closest to the model
L6Rollback / safe modePull ranking back to review-only when detection or production signals degrade.Roll back
L5Version monitoringTrack model, rule-set, recognition-gate and capture-configuration changes.Track
L4TraceabilityRecord the frame, the rule cited, the routing, the owner and the closure.Record
L3Safety reviewHold observations for a named owner; it governs who acts, not whether the frame was read right.Gate
L2Policy guardrailsTest each capture against the site rule set, the recognition gate and the recipient list; a failure holds the frame.Restrict
L1Confidence thresholdsSend low-confidence candidates to a triage read before an owner is assigned.Require review
Model coreObservation raised — condition, zone, frame, progress delta and confidence
L1 – L2Test whether a candidate may stand
L3Puts the call in a safety manager's hands
L4 – L5Preserve the frame, its confidence and its routing
L6Stops automated offers and holds the staffed path

How Nestack evaluates it

Evaluate the capture-to-closure workflow — not only the detection.

Coverage runs the whole depth of the workflow, and every layer is cut by slice.

Surface — the observation the site acts on
Depth of coverage ▼
E1Final-output evaluationDid the observation match a condition the frame actually shows?
E2Step-level evaluationDid the agent use the right baseline revision, zone and site rule set?
E3Tool evaluationDid it register the frame to the correct level, zone and date?
E4Confidence calibrationDo low-confidence captures actually carry more missed hazards?
E5Slice evaluationHow does performance change across capture conditions?
E6Business outcomeHow many hazards were missed, wrongly raised, or closed with no action?
Floor — the outcome the contractor answers for

Failure modes

Where each failure originates in the agent

Seven failure modes, each plotted where it starts rather than where it shows.

Agent lifecycleDirection of processing →
01 · Retrieval1 mode
SI-01

Superseded baseline

Progress read against a baseline revision the project has replaced.

Stage gathersFrames, baseline revision, prior captures and the site rule set
02 · Reasoning2 modes
SI-02

Sheeting read as finishes

Crash-deck sheeting is booked as an installed floor finish.

SI-03

Rule applied out of place

A hard-hat flag where the rule does not apply teaches dismissal.

Stage proposesRanked candidates, progress deltas and confidence
03 · Tool / write2 modes
SI-04

Inferred quantity written

An inferred quantity lands in the progress-claim schedule.

SI-05

Recognition inherited

A tenant setting turns face matching on with no notice or consent.

Stage writesOnly where write access and approval policy allow it
04 · Output1 mode
SI-06

Off-site capture published

A neighbour's interior reaches the full project directory.

Stage returnsThe observation the site acts on and the imagery it shares
05 · Change / Version1 mode
SI-07

Backdated re-scoring

An upgrade re-scores archived imagery into new, backdated observations.

Stage tracksModel, rule set, recognition gate and capture config
Sev-1 · a face or gait template is created Sev-2 · an observation sits open past its clock Sev-3 · capture degrades, frames route to triage

Affected slices

A good baseline says nothing about the night shift

Start from the baseline: daylight structure work from surveyed positions misses least, and the aggregate inherits that. Nestack reports the missed-hazard rate by slice, alongside the false-positive rate that produces it.

Slice performance — reported separately, not only in aggregateIllustrative example
SliceFailure rateLift Lift vs. thresholdStatus
Night, low light and heavy occlusion9.9%2.9× Review
Fitout and wet trades7.5%2.2× Review
Structure phase, daylight capture5.1%1.5× Watch
Repeat typologies, BIM baseline1.7%0.5× Normal
Bar: missed-hazard-rate lift vs. an all-frame baseline · scale 0–4.0× · tick marks the 2.0× review threshold 2 of 4 slices over threshold

Evidence-linked improvement

A closed cycle looks like a new test

An explanation closes nothing. The cycle ends with a case the next release has to clear.

Improvement cycle · five stagesSwitchback — the path turns at Improve and returns at Learn
01Detect

Missed-hazard rate rises in a capture slice.

02Diagnose

The frames, the rule set and the routing log are read side by side until the cause is one of them.

03Improve

The change is stamped to a version, with the frames that produced it attached.

04Verify

Re-run the affected cases; a fail holds the release.

05Learn

A standing test, plus a rule change in the detection set.

Learn → DetectThe return edge. Each turn hands the next one a longer suite to beat.

Typical build scope

Twelve workstreams across six weeks

The build scope read against the delivery timeline. Week structure follows the six-week plan — discovery, capture, detection workflow, evaluation, integration, then production validation and handover.

Workstream Week 1Week 2Week 3Week 4Week 5Week 6
01Capture workflow discovery and boundary definition.
02Capture-source and site-system assessment.
03Jurisdiction, notice and recognition-gate mapping.
04Capture ingestion and de-identification.
05Detection logic and baseline-model binding.
06Confidence scoring and observation routing.
07Safety review workflow.
08Site-system and observation-log integration.
09Paired-frame regression cases.
10Guardrails and publication controls.
11Observation-trail instrumentation.
12Deployment, documentation and Agent Care handover.
12 workstreams · 6 weeks · bar shows the weeks a workstream is active — several run in parallel Final scope and sequence confirmed in discovery

Engagement tiers

What each tier includes

Rows are the capabilities named in each tier's scope. Higher tiers include everything below them.

Capability✓ in scope · — not at this tier PilotOne site, one capture cadence ProductionProduction site systems AdvancedMultiple sites / capture modes
Introduced at Pilot
Ranking to your site rule set
Safety review and escalation
Detection baseline
Introduced at Production
Reporting by capture zone
Escalation clock in your systems
Approved write-back
Dashboard and BI integration
Introduced at Advanced
Multi-jurisdiction capture rules
Multi-stage site review
High capture volume
Enterprise capture controls
Build price From $5,000 From $8,000 Custom quote
Final build priceConfirmed after discovery based on integrations, workflow complexity, transaction volume, approval controls and deployment requirements.
Separate from buildBuild pricing is separate from recurring Agent Care, which covers managed monitoring, evaluations, incidents and verified improvements after launch.

What we need from you

What you bring, and what we build with it

Each input maps to a piece of build scope and a week in the delivery timeline.

You bringWe build with it
01Your site rule set and capture cadence Capture ingestion and zone mappingWeek 1
02Representative captures from live levels Detection baseline, zone mapping and baseline-model bindingWeek 2
03Your surveillance notices and consent records Jurisdiction, notice and recognition-gate mappingWeek 1
04Access to relevant APIs, feeds or exports Capture-source and site-system assessment, then integration setupWeek 2
05Captures where the hazard was there and unflagged Detection cases, paired frames and the evaluation suiteWeek 4
06What an observation must reach before it is closed Confidence scoring, routing, guardrails and escalation controlsWeek 3
07Named owners with authority to abate Safety review workflow, then pilot and production validationWeeks 5–6
Nothing else is required Deployment, documentation and Agent Care handover are ours.

Delivery timeline

Four phases across six weeks

Phases are drawn over the weeks they occupy. Week 5 carries evaluation and pilot capture together.

Phase W1W2W3W4W5W6
Discovery W1
Build W2 – W3
Evaluate W4 – W5
Pilot & Launch W5 – W6
Week focus W1Capture workflow discovery, jurisdiction mapping and the boundary W2Capture-source integration and the detection baseline W3Detection workflow, confidence logic and routing controls W4Evaluation suite, guardrails and failure-mode testing W5Site-system integration, pilot capture runs and targeted corrections W6A month of capture reviewed by the site team, then handover
Reading the bandBars stop where the named work stops. The week 5 overlap is scheduled, not padding.
At the end of W6Hand-over happens against a verified capture run, not a demo.
DurationSix-week plan shown · typical delivery 4–6 weeks depending on scope confirmed in discovery.

Next step · Construction AI agent

Build a site-vision agent around who closes the observation.

Show us how you capture, who owns an observation and where the imagery goes. If your queue already outlives its clock, we fix the closure loop before we add a single detector.

Nestack Agents · Site vision & progress captureAGT-CN-07 · Agent Care available after launch