Skip to content

Commit 4c7df79

Browse files
authored
Use Flink bazel artifacts for uploads (#344)
## Summary Tested on the our clients side and we've fixed some things in the Flink bazel deps which requires us to move off sbt. ## Checklist - [ ] Added Unit Tests - [ ] Covered by existing CI - [X] Integration tested - [ ] Documentation update <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit - **Chores** - Updated the stream processing job configuration to reference a production-ready deployment artifact. - Streamlined the artifact generation process with an improved build mechanism for more robust deployments. <!-- end of auto-generated comment: release notes by coderabbit.ai -->
1 parent 82c80f0 commit 4c7df79

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

api/py/ai/chronon/repo/run.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -132,7 +132,7 @@
132132
DATAPROC_ENTRY = "ai.chronon.integrations.cloud_gcp.DataprocSubmitter"
133133
ZIPLINE_ONLINE_JAR_DEFAULT = "cloud_gcp_lib_deploy.jar"
134134
ZIPLINE_ONLINE_CLASS_DEFAULT = "ai.chronon.integrations.cloud_gcp.GcpApiImpl"
135-
ZIPLINE_FLINK_JAR_DEFAULT = "flink-assembly-0.1.0-SNAPSHOT.jar"
135+
ZIPLINE_FLINK_JAR_DEFAULT = "flink_assembly_deploy.jar"
136136
ZIPLINE_DATAPROC_SUBMITTER_JAR = "cloud_gcp_submitter_deploy.jar"
137137

138138

distribution/build_and_upload_gcp_artifacts.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -39,15 +39,15 @@ fi
3939

4040
echo "Building jars"
4141
sbt clean
42-
sbt flink/assembly
4342
sbt service/assembly
4443

4544
bazel build //cloud_gcp:cloud_gcp_lib_deploy.jar
4645
bazel build //cloud_gcp:cloud_gcp_submitter_deploy.jar
46+
bazel build //flink:flink_assembly_deploy.jar
4747

4848
CLOUD_GCP_JAR="$CHRONON_ROOT_DIR/bazel-bin/cloud_gcp/cloud_gcp_lib_deploy.jar"
4949
CLOUD_GCP_SUBMITTER_JAR="$CHRONON_ROOT_DIR/bazel-bin/cloud_gcp/cloud_gcp_submitter_deploy.jar"
50-
FLINK_JAR="$CHRONON_ROOT_DIR/flink/target/scala-2.12/flink-assembly-0.1.0-SNAPSHOT.jar"
50+
FLINK_JAR="$CHRONON_ROOT_DIR/bazel-bin/flink/flink_assembly_deploy.jar"
5151
SERVICE_JAR="$CHRONON_ROOT_DIR/service/target/scala-2.12/service-0.1.0-SNAPSHOT.jar"
5252

5353
if [ ! -f "$CLOUD_GCP_JAR" ]; then

0 commit comments

Comments
 (0)