The cloud portion of Nidus
Find a file
2026-02-04 23:57:44 +00:00
api Move Twilio-specific parsing to twilio incoming API 2026-01-29 22:36:16 +00:00
arcgis-go@09fda12abb Bunch of work around assigning reports to districts 2026-01-22 03:27:32 +00:00
auth Wire in agent to the reporter texting system 2026-01-27 19:56:26 +00:00
background Fix email sending for report notification confirmation 2026-02-02 17:00:48 +00:00
cmd Add command to hash password directly 2026-01-26 18:42:30 +00:00
comms Save the template ID and email type in email_log 2026-02-02 23:58:51 +00:00
config Get Voip.ms working again in the text system 2026-01-29 21:53:49 +00:00
db Add report ID suggestion to status page 2026-02-04 16:07:36 +00:00
debug Begin work on debugging user behavior in early setup 2026-01-06 14:46:31 +00:00
go-geojson2h3@c2ff1a96ab Add mocks for data entry 2025-12-10 17:06:27 +00:00
h3utils Finish green pool report submission 2026-01-09 19:43:19 +00:00
html Make checkboxes hide map layers 2026-02-04 23:57:44 +00:00
label-studio WIP migration of API from fieldseeker-sync 2025-12-16 16:37:53 +00:00
llm Clean up old SMS callback endpoints 2026-01-28 14:57:50 +00:00
minio WIP migration of API from fieldseeker-sync 2025-12-16 16:37:53 +00:00
notification Rip apart several new packages for inter-dependence 2026-01-07 16:07:51 +00:00
platform Fix error message for text job 2026-02-02 06:59:28 +00:00
rmo Make checkboxes hide map layers 2026-02-04 23:57:44 +00:00
scss Show pools and nuisances in separate layers on status search 2026-02-04 17:12:46 +00:00
sync Fix svg pipeline to not need an explicit list 2026-01-30 20:11:17 +00:00
tools Begin process of getting text responses from an LLM. 2026-01-26 20:30:06 +00:00
userfile Bunch of work around assigning reports to districts 2026-01-22 03:27:32 +00:00
.air.toml Shorten the time waiting for air to kill my webserver 2025-11-07 08:46:26 +00:00
.gitattributes Add a basic main page with login 2025-11-03 22:13:19 +00:00
.gitignore Rename htmlpage to html 2026-01-30 19:32:01 +00:00
.gitmodules Build custom SCSS as part of nix package 2026-01-29 02:11:04 +00:00
default.nix Rename htmlpage to html 2026-01-30 19:32:01 +00:00
flake.lock Move to nixos pkg 25.11 base 2026-01-06 14:27:19 +00:00
flake.nix Switch to dart-sass 2026-01-30 16:32:13 +00:00
go.mod Update vendors and hash 2026-01-29 17:46:15 +00:00
go.sum Update vendors and hash 2026-01-29 17:46:15 +00:00
lefthook.yml Attempt to check if I have an SSH identity before committing 2026-01-23 20:37:55 +00:00
LICENSE Initial commit 2025-11-03 05:12:02 -07:00
main.go Remove redundant request logging 2026-01-30 16:34:58 +00:00
query.go Add ability to make LLM agent forget the conversation history 2026-01-27 18:44:02 +00:00
README.md Rename htmlpage to html 2026-01-30 19:32:01 +00:00
start-air.sh Read secrets when running air 2026-01-06 14:46:54 +00:00

Nidus Sync

This is the software that powers Nidus Cloud Sync.

Building from source

First, you'll need Nix.

Then:

nix develop
go build .

Building Custom Theme

We're using a customized Bootstrap theme for this site. You'll need to build the SCSS into CSS:

nix develop
cd scss
scss custom.scss > ../html/static/css/bootstrap.css

Running

You'll need a number of environment variables for configuring things;

  • ARCGIS_CLIENT_ID - The client ID for ArcGIS oauth, configured with esri.
  • ARCGIS_CLIENT_SECRET - The client secret for ArcGIS oauth, configured with esri.
  • BASE_URL - The URL the site is hosted at, used for forming callback URLs. Should be complete like 'https://foo.bar'
  • BIND - The address and port to bind to. Use ':9001' for 'any address, port 9001'
  • ENVIRONMENT - either 'PRODUCTION' or 'DEVELOPMENT'. It's used to set things like oauth token length.
  • MAPBOX_TOKEN - The token to use with mapbox which is important for rendering maps.
  • POSTGRES_DSN - The DSN for connecting to the postgres database.
  • FIELDSEEKER_SCHEMA_DIRECTORY - The directory to write fieldseeker schema files for debugging.
  • USER_FILES_DIRECTORY - The directory for writing uploaded user data files (audio, images).
> BASE_URL=https://sync.nidus.cloud ARCGIS_CLIENT_ID=foo ARCGIS_CLIENT_SECRET=bar POSTGRES_DSN='postgresql://?host=/var/run/postgresql&dbname=nidus-sync' ./nidus-sync

Districts

There's a table containing district information in the database, import.district. It was created with:

psql
CREATE SCHEMA import;
shp2pgsql -s 3857 -c -D -I CA_districts.shp import.district | psql -d nidus-sync
psql
ALTER TABLE import.district ADD COLUMN geom_4326 geometry(MultiPolygon,4326) GENERATED ALWAYS AS (ST_Transform(geom, 4326)) STORED;

Hacking

air

This project uses air for fast compile-and-test loops. You can run it with:

> BASE_URL=https://sync.nidus.cloud ARCGIS_CLIENT_ID=foo ARCGIS_CLIENT_SECRET=bar POSTGRES_DSN='postgresql://?host=/var/run/postgresql&dbname=nidus-sync' air

bob

This uses the bob query framework. You can regenerate the models for bob with:

PSQL_DSN="postgresql://dbname?host=/var/run/postgresql&sslmode=disable" go run github.com/stephenafamo/bob/gen/bobgen-psql@latest"
PSQL_DSN="postgresql://?host=/var/run/postgresql&sslmode=disable&dbname=nidus-sync" go run github.com/stephenafamo/bob/gen/bobgen-psql@latest

This will generate a bunch of files. They're already committed, you only need this if you change the database schema in some way.

goose

This uses goose. You can use the goose command line to check status and make changes

> cd migrations
> GOOSE_DRIVER=postgres GOOSE_DBSTRING="dbname=nidus-sync sslmode=disable" goose status
> GOOSE_DRIVER=postgres GOOSE_DBSTRING="dbname=nidus-sync sslmode=disable" goose down
> GOOSE_DRIVER=postgres GOOSE_DBSTRING="dbname=nidus-sync sslmode=disable" goose up

watchexec

For iterating on styles

watchexec -e *.scss sass --style=compressed scss/custom.scss:html/static/css/bootstrap.css