Workspace · acme-data-prod
Pipelines
All8
Running5
Idle1
Paused1
Failed1
| Pipeline | Source | Target | Mode | Schedule | Throughput | Lag | Activity (7d) | Success | Owner | Last run | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| running | orders_postgres → iceberg_lake Order events from production Postgres into the Iceberg catalog with PII redaction | pgPostgreSQL | icApache Iceberg | CDC | continuous | 1,843 rps | 220ms | 99.94% | Rina Wong | 2s ago | ||
| running | users_mysql → snowflake_dw Customer master, dim model, soft-delete handled | myMySQL | snSnowflake | CDC | continuous | 412 rps | 480ms | 99.87% | Marcus Hale | 4s ago | ||
| running | kafka_clickstream → delta_lake Web/app events, Avro decode, hourly compaction | kfKafka | ΔDelta Lake | Stream | continuous | 12,480 rps | 80ms | 100% | Priya Shah | 1s ago | ||
| idle | salesforce → bigquery_revops Accounts, opportunities, line items — daily | sfSalesforce | bqBigQuery | Batch | 0 2 * * * | — | — | 99.21% | Marcus Hale | 6h ago | ||
| failed | sqlserver_legacy → motherduck Read-only replica of legacy ERP for analyst sandbox | msSQL Server | mdMotherDuck | CDC | continuous | — | — | 96.12% | Rina Wong | 12m ago | ||
| running | logs_s3 → hudi_observability Application logs, Hudi MOR, partitioned by day | s3Amazon S3 | huApache Hudi | Batch | */15 * * * * | 218 rps | 1100ms | 99.55% | Priya Shah | 8s ago | ||
| paused | inventory_oracle → redshift_supply Stock movements, lot codes, FIFO accounting | orOracle | rsRedshift | CDC | continuous | — | — | 99.91% | Marcus Hale | 2d ago | ||
| running | partner_api → bigquery_partners 3rd-party partner feeds, paginated REST, retried | apiREST / API | bqBigQuery | Batch | 0 */4 * * * | 56 rps | — | 99.78% | Rina Wong | 24m ago |