console: dataflow visualizer rebuild (drill-down navigator)#37487

Draft

antiguru wants to merge 45 commits into

MaterializeInc:mainfrom

antiguru:moritz/dataflow-visualizer-rebuild

Commits on Jul 8, 2026

console: design doc for dataflow visualizer rebuild

antiguru
and
claude
committed
console: address spec review for dataflow visualizer rebuild

antiguru
and
claude
committed
console: implementation plan for dataflow visualizer rebuild

antiguru
and
claude
committed
Add @xyflow/react and elkjs, and the dataflow graph model

antiguru
and
claude
committed
Derive the visible dataflow graph from collapse state, add the elk layout worker/hook

antiguru
and
claude
committed
console: add dataflow graph data hook keyed by dataflow id

antiguru
and
claude
committed
console: React Flow dataflow graph view with collapsible regions

antiguru
and
claude
committed
Add the dataflow detail page behind a flag, with phase-1 gate fixes

antiguru
and
claude
committed
Add the cluster dataflows list page, deep-link, and manual refresh

antiguru
and
claude
committed
console: node detail panel for dataflow visualizer

antiguru
and
claude
committed
console: dataflow visualizer filters and toolbar

antiguru
and
claude
committed
Add the LIR operator panel, error states, and CNS-109 regression test

antiguru
and
claude
committed
console: delete graphviz dataflow visualizer and d3-graphviz dep

antiguru
and
claude
committed
Drop dangling channels and route external-to-region channels through ports

antiguru
and
claude
committed
console: reroute connectivity around hidden idle runs

antiguru
and
claude
committed
Add click-to-inspect for edges/ports and a dataflow switcher

antiguru
and
claude
committed
Render the LIR panel as a navigable tree, link entries to their operators

antiguru
and
claude
committed
console: fit all LIR members into view, sticky multi-pin, per-LIR summary

antiguru
and
claude
committed
console: peer-port jump, skew heatmap, layout and drill-down fixes

antiguru
and
claude
committed
console: drop dataflow visualizer implementation plan doc

antiguru
and
claude
committed
console: update dataflow visualizer design doc for drill-down + skew

antiguru
and
claude
committed
Fix review findings: empty-dataflow crash, stale search index, dead Visualize links, stale pins

antiguru
and
claude
committed
Put drill-down scope in the URL, recenter on empty canvas, minimap stroke, edge highlight

antiguru
and
claude
committed
console: design doc for LIR grouping boxes

antiguru
and
claude
committed
console: implementation plan for LIR grouping boxes

antiguru
and
claude
committed
Add LIR grouping: groupByLir, elk compound nesting, LirGroupNode component

antiguru
and
claude
committed
Wire LIR grouping into the view, add toolbar toggle and summary-click, fix viewport bug

antiguru
and
claude
committed
Fix skew heatmap: log2 domain over real worker count, MAX rollup, hash-based coloring

antiguru
and
claude
committed
Add edge-to-endpoint jump navigation, fix port-keyed landings at deep nesting

antiguru
and
claude
committed
Add collapsible LIR/detail panels, link node LIR ids to their group, default LIR groups on

antiguru
and
claude
committed
Put selection in the URL alongside scope, and fit the viewport on history navigation

antiguru
and
claude
committed
Add schedule count/skew metric and per-region overhead

antiguru
and
claude
committed
Add schedules heatmap, unfiltered own skew, and a region's own stats to the detail panel

antiguru
and
claude
committed
Remove superseded LIR-grouping-boxes design doc and plan

antiguru
and
claude
committed
dataflowGraph: replace non-null assertions with mustGet, tidy doc comments

antiguru
and
claude
committed
clusters: narrow props.cluster once instead of asserting it at each use

antiguru
and
claude
committed
dataflows: read colors through the theme instead of hardcoded values

antiguru
and
claude
committed
dataflows: reuse TextLink and the shared Alert component

antiguru
and
claude
committed
NodeDetailPanel: reuse TextLink/icons, extract named prop interfaces

antiguru
and
claude
committed
Extract useLastGoodByKey, dedup the last-good-result pattern

antiguru
and
claude
committed
Disable skew heatmap options on single-worker replicas

antiguru
and
claude
committed
Add isInsufficientPrivilegeError, use it for the dataflows permission check

antiguru
and
claude
committed
DataflowDetailPage: wire up mustGet, isInsufficientPrivilegeError, workerCount

antiguru
and
claude
committed
Align dataflow node/panel styling with the workflow graph's visual language

antiguru
and
claude
committed
Fix unreadable node text on dark hashed palette colors

antiguru
and
claude
committed