Processing Engine
IngestCore is the backend processing engine that powers data pipeline platforms. Accept data from upstream services, transform it through configurable stages, and route results to downstream consumers. Designed for high-throughput, low-latency data flows.
Ingest
Accept data from platform integrations via REST API. Supports batch and streaming ingestion with automatic schema validation.
Transform
Apply processing pipelines: filtering, enrichment, aggregation, and format conversion. Configurable per data source.
Route
Deliver processed data to storage backends, analytics systems, and downstream APIs. Rule-based routing with failover.
Monitor
Real-time processing metrics. Prometheus-compatible /metrics endpoint. Grafana dashboards included.
Integration API
GET /api/v1/pipelines — List processing pipelines
GET /api/v1/health — Engine health status
GET /metrics — Prometheus metrics endpoint
Integration docs: /docs | Status: /api/v1/health