Data Pipelines

SDL Data Pipelines allow users to develop, create, and manage complex data transformations at scale. These transformations can work on batch or streaming data in a variety of formats and protocols.

See the Transformer Reference for a listing of available transformers.

Pipeline Health explains how to diagnose pipeline failures and open scoped evidence without direct cluster access.

Geospatial Pipelines explains geospatial pipeline workflows for publishing raster COGs, GeoServer filesystem-backed files, and GeoJSON-backed GeoServer layers.

Transformer Guide contains a step-by-step guide to each part of a Transformer as it’s represented in SDL.