Pipeline · orders_postgres → iceberg_lake
Schema mapping
Field mapping13
Normalizer rules4
Evolution policy
Sample preview
pgv3 · 47 fields
Source schema
orders_postgres.public.orders
icv3 · 38 fields
Target schema
iceberg_lake.analytics.orders
| Source field | Source type | Transform | Target field | Target type | Tags | |||
|---|---|---|---|---|---|---|---|---|
| order_id | bigint | identity | order_id | BIGINT | PK | |||
| customer_id | bigint | identity | customer_id | BIGINT | FK | |||
| order_total_cents | integer | cents → dollars | order_total | DECIMAL(12,2) | ||||
| currency_code | varchar(3) | upper() | currency | STRING | ||||
| customer_email | varchar(255) | sha256() | customer_email_hash | STRING | PII | |||
| shipping_address | jsonb | $.country | shipping_country | STRING | ||||
| created_at | timestamptz | utc | created_at | TIMESTAMP | ||||
| updated_at | timestamptz | utc | updated_at | TIMESTAMP | ||||
| status | order_status_enum | lower() | status | STRING | ||||
| region | varchar(8) | identity | region | STRING | partition | |||
| metadata | jsonb | json → struct | metadata | STRUCT | ||||
| _op | — | cdc.op (i/u/d) | _op | STRING | cdc | |||
| _lsn | — | cdc.lsn | _lsn | BIGINT | cdc |