Skip to content

Commit 1bf782e

Browse files
sean-zlaitechniqken-zlai
authored
Lineage DAG (#252)
## Summary ## Checklist - [ ] Added Unit Tests - [ ] Covered by existing CI - [ ] Integration tested - [ ] Documentation update <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit - **New Features** - Added interactive transformation controls for chart zooming, resetting, and scroll modes. - Introduced a detailed join configuration view and enhanced node graph visualization with tooltips and collapsible details. - Implemented a new component for displaying configuration properties related to joins in a tabular format. - Added new dependencies to enhance functionality and updated existing ones for better performance. - Introduced a new method for retrieving edges in the node graph and improved lineage data handling. - Added a new `StatusBar` component for job status representation. - Introduced sample data structures for lineage and job tracking responses. - Implemented a new function for managing expandable row states in job tracking tables. - **UI Improvements** - Refined chart layouts with updated padding and legend styling. - Improved navigation headers and tabs for clearer page organization. - Enhanced visual feedback for missing drift or distribution data. - Allowed interaction with previously disabled elements for improved user experience. - **Bug Fixes** - Improved error handling for data fetching and display logic. - **Chores** - Upgraded underlying dependencies and animations for smoother performance. - Removed obsolete files and functions related to job tracking data management. <!-- end of auto-generated comment: release notes by coderabbit.ai --> <!-- av pr metadata This information is embedded by the av CLI when creating PRs to track the status of stacks when using Aviator. Please do not delete or edit this section of the PR. ``` {"parent":"main","parentHead":"","trunk":"main"} ``` --> --------- Co-authored-by: Sean Lynch <[email protected]> Co-authored-by: Ken Morton <[email protected]>
1 parent 2f7990b commit 1bf782e

38 files changed

+2669
-963
lines changed

frontend/package-lock.json

Lines changed: 94 additions & 21 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

frontend/package.json

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -62,12 +62,14 @@
6262
"dependencies": {
6363
"@creditkarma/thrift-server-core": "^1.0.4",
6464
"@creditkarma/thrift-typescript": "^3.7.6",
65+
"@layerstack/svelte-actions": "^0.0.11",
6566
"@layerstack/utils": "^0.0.7",
6667
"clsx": "^2.1.1",
6768
"d3": "^7.9.0",
6869
"dotenv": "^16.4.7",
69-
"layerchart": "^0.95.0",
70+
"layerchart": "^0.99.1",
7071
"lodash": "^4.17.21",
72+
"svelte-inspect-value": "^0.1.3",
7173
"tailwind-merge": "^2.6.0",
7274
"tailwind-variants": "^0.3.1"
7375
},
@@ -79,6 +81,9 @@
7981
"nanoid": "^3.3.8",
8082
"svelte-headless-table": {
8183
"svelte": "^5.0.0"
84+
},
85+
"svelte-inspect-value": {
86+
"svelte": "^5.0.0"
8287
}
8388
},
8489
"optionalDependencies": {

frontend/src/app.css

Lines changed: 42 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -101,25 +101,49 @@
101101

102102
--ring: 0 0% 83.1%;
103103

104-
--job-running-bg: 249 32% 56%;
105-
--job-running-border: 249 54% 72%;
106-
--job-running-active-border: 250 100% 86%;
107-
--job-waiting-bg: 250 30% 24%;
108-
--job-waiting-border: 250 30% 40%;
109-
--job-waiting-active-border: 250 89% 70%;
110-
--job-failed-bg: 10 24% 20%;
111-
--job-failed-border: 10 30% 34%;
112-
--job-failed-active-border: 10 46% 56%;
113-
--job-completed-bg: 160 40% 17%;
114-
--job-completed-border: 160 40% 28%;
115-
--job-completed-active-border: 160 32% 47%;
116-
--job-invalid-bg: 44 80% 14%;
117-
--job-invalid-border: 44 68% 24%;
118-
--job-invalid-active-border: 44 62% 40%;
119-
--job-queued-bg: 0 0% 16%;
120-
--job-queued-border: 0 0% 24%;
121-
--job-queued-active-border: 0 0% 40%;
104+
/* Base colors for reuse */
105+
--color-failed: 10 24% 20%;
106+
--color-failed-border: 10 30% 34%;
107+
--color-failed-active: 10 46% 56%;
122108

109+
--color-running: 250 30% 24%;
110+
--color-running-border: 250 30% 40%;
111+
--color-running-active: 250 48% 62%;
112+
113+
/* Job status colors using base variables */
114+
--job-RUNNING-bg: var(--color-running);
115+
--job-RUNNING-border: var(--color-running-border);
116+
--job-RUNNING-active-border: var(--color-running-active);
117+
118+
--job-WAITING_FOR_UPSTREAM-bg: 210 30% 20%;
119+
--job-WAITING_FOR_UPSTREAM-border: 210 30% 34%;
120+
--job-WAITING_FOR_UPSTREAM-active-border: 210 46% 56%;
121+
122+
--job-FAILED-bg: var(--color-failed);
123+
--job-FAILED-border: var(--color-failed-border);
124+
--job-FAILED-active-border: var(--color-failed-active);
125+
126+
--job-SUCCESS-bg: 160 40% 17%;
127+
--job-SUCCESS-border: 160 40% 28%;
128+
--job-SUCCESS-active-border: 160 32% 47%;
129+
130+
--job-UPSTREAM_FAILED-bg: var(--color-failed);
131+
--job-UPSTREAM_FAILED-border: var(--color-failed-border);
132+
--job-UPSTREAM_FAILED-active-border: var(--color-failed-active);
133+
134+
--job-QUEUED-bg: 0 0% 16%;
135+
--job-QUEUED-border: 0 0% 24%;
136+
--job-QUEUED-active-border: 0 0% 40%;
137+
138+
--job-UPSTREAM_MISSING-bg: 38 30% 20%;
139+
--job-UPSTREAM_MISSING-border: 38 30% 34%;
140+
--job-UPSTREAM_MISSING-active-border: 38 46% 56%;
141+
142+
--job-WAITING_FOR_RESOURCES-bg: var(--color-running);
143+
--job-WAITING_FOR_RESOURCES-border: var(--color-running-border);
144+
--job-WAITING_FOR_RESOURCES-active-border: var(--color-running-active);
145+
146+
/* Scrollbar colors */
123147
--scrollcolor: hsla(0, 0%, 13%, 1);
124148
--scrollbackground: transparent;
125149
scrollbar-color: var(--scrollcolor) var(--scrollbackground);

0 commit comments

Comments
 (0)