doc: Nidus Reveal design document and implementation plan #110

Merged

eliribble merged 1 commit from feature/nidus-reveal-design-doc into main

2026-07-15 18:02:31 +00:00

ned commented

2026-07-15 17:25:49 +00:00

Member

This PR adds two documents to doc/nidus-reveal/ covering the full architecture and implementation strategy for the Nidus Reveal computer vision pipeline, as discussed in issue #108.

Design Document (`doc/nidus-reveal/design.md`)

Covers:

System architecture (nidus-sync ↔ GPU workers via pull-based task queue)
Process flow diagrams for both pool identification and status monitoring
Tile server protocol with 4-band GeoTIFF support
Task queue API (poll, submit, fail, batch complete, status)
Worker management API (register, list, detail, shutdown)
Data models for pool identification and status tasks+results
HMAC authentication with per-worker secrets
Full PostGIS schema (vision_workers, vision_task_queue, vision_pools)
Satellite source details (PlanetScope, 4-band RGB+NIR)
Priority queue design (status checks > initial identification)

Implementation Plan (`doc/nidus-reveal/implementation.md`)

Nine independently testable phases:

Database schema & migrations
GeoTIFF + multi-band tile server support
Worker registration CRUD API
HMAC auth middleware for workers
Task queue creation & polling
Task result submission & failure handling
Operator dashboard UI (Vue.js)
Task creation automation (onboarding + scheduler)
Metrics & cost tracking

Each phase includes deliverables, test plans, and dependency mapping. The plan also covers rollback strategy, feature flagging, and a mock worker script for integration testing.

Closes #108

This PR adds two documents to `doc/nidus-reveal/` covering the full architecture and implementation strategy for the Nidus Reveal computer vision pipeline, as discussed in issue #108. ## Design Document (`doc/nidus-reveal/design.md`) Covers: - System architecture (nidus-sync ↔ GPU workers via pull-based task queue) - Process flow diagrams for both pool identification and status monitoring - Tile server protocol with 4-band GeoTIFF support - Task queue API (poll, submit, fail, batch complete, status) - Worker management API (register, list, detail, shutdown) - Data models for pool identification and status tasks+results - HMAC authentication with per-worker secrets - Full PostGIS schema (vision_workers, vision_task_queue, vision_pools) - Satellite source details (PlanetScope, 4-band RGB+NIR) - Priority queue design (status checks > initial identification) ## Implementation Plan (`doc/nidus-reveal/implementation.md`) Nine independently testable phases: 1. Database schema & migrations 2. GeoTIFF + multi-band tile server support 3. Worker registration CRUD API 4. HMAC auth middleware for workers 5. Task queue creation & polling 6. Task result submission & failure handling 7. Operator dashboard UI (Vue.js) 8. Task creation automation (onboarding + scheduler) 9. Metrics & cost tracking Each phase includes deliverables, test plans, and dependency mapping. The plan also covers rollback strategy, feature flagging, and a mock worker script for integration testing. Closes #108

ned referenced this pull request

2026-07-15 17:26:01 +00:00

Design of pool location computer vision system #108

eliribble force-pushed feature/nidus-reveal-design-doc from c91dcf906e

/ golint (push) Failing after 1m6s

Details

/ pnpm-build (push) Successful in 30s

Details

to b1225f8ea3

/ golint (push) Failing after 54s

Details

/ pnpm-build (push) Successful in 30s