Skip to main content

Module pipeline_spec

Module pipeline_spec 

Source
Expand description

Load shared pipeline + schema JSON from a fixture bundle (e.g. tests/fixtures/ghcn/).

Bundles are language-neutral: Java, Python, and Rust tests read the same files. Use {{PLACEHOLDER}} in pipeline templates for paths resolved at runtime.

§Layout

tests/fixtures/<bundle>/
  schemas/*.schema.json          — serde [`crate::types::Schema`] JSON
  pipelines/*.pipeline.json      — `rdp_run_pipeline_json` control plane
  payloads/*.payload.json        — `rdp_ingest_ordered_paths_json` bodies

Bundles: ghcn, jvm_contract, student_etl, people, watermark, deep, file_transfer, …

Pipelines may use "schema_ref": "schemas/foo.schema.json" (relative to the bundle root) instead of an inline "schema" object.

Structs§

PipelineBundle
Root directory for a fixture bundle (tests/fixtures/ghcn, etc.).

Functions§

bind_placeholders
Replace {{NAME}} in every string leaf of value.