Building a pipeline

Stub

Final content will be a step-by-step prose walkthrough of driving acid from the command line — no Python — to produce a nightly crossmatch table.

Topics planned:

  1. Sketching the query in a .sql file (crossmatch.sql).
  2. Pointing acid validate -f crossmatch.sql --db datasets/ at it to catch mistakes before launching anything heavy.
  3. Running it: acid query -f crossmatch.sql --db datasets/ --out results/ --workers 32.
  4. Inspecting the output with acid inspect results/.
  5. Re-running incrementally as new data arrives (the output is itself a valid HATS catalog, so it can be the input of the next stage).
  6. A minimal make target / cron entry that wires it together.

Until this lands, the Quickstart §5 shows the shape; the same flags work for arbitrarily large queries.