Add support for running fetcher in docker & publishing image (#422)

## Summary
Add support to run the fetcher service in docker. Also add rails to
publish to docker hub as a private image -
[ziplineai/chronon-fetcher](https://hub.docker.com/repository/docker/ziplineai/chronon-fetcher)

I wasn't able to sort out logback / log4j2 logging as there's a lot of
deps messing things up - Vert.x supports JUL configs and that is
seemingly working so starting with that for now.

Tested with:
```
docker run -v ~/.config/gcloud/application_default_credentials.json:/gcp/credentials.json \
 -p 9000:9000 \
 -e "GCP_PROJECT_ID=canary-443022" \
 -e "GOOGLE_CLOUD_PROJECT=canary-443022" \
 -e "GCP_BIGTABLE_INSTANCE_ID=zipline-canary-instance" \
 -e "STATSD_HOST=127.0.0.1" \
 -e GOOGLE_APPLICATION_CREDENTIALS=/gcp/credentials.json \
 ziplineai/chronon-fetcher
```

And then you can `curl http://localhost:9000/ping`

On Etsy side just need to swap out the project and bt instance id and
then can curl the actual join:
```
curl -X POST http://localhost:9000/v1/fetch/join/search.ranking.v1_web_zipline_cdc_and_beacon_external -H 'Content-Type: application/json' -d '[{"listing_id":"632126370","shop_id":"53908089","shipping_profile_id":"235561688531"}]'
{"results":[{"status":"Success","entityKeys":{"listing_id":"632126370","shop_id":"53908089","shipping_profile_id":"235561688531"},"features":{...
```

## Checklist
- [ ] Added Unit Tests
- [ ] Covered by existing CI
- [X] Integration tested
- [ ] Documentation update



<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Added an automation script that streamlines the container image build
and publication process with improved error handling.
- Introduced a new container configuration that installs essential
dependencies, sets environment variables, and incorporates a health
check for enhanced reliability.
- Implemented a robust logging setup that standardizes console and file
outputs with log rotation.
- Provided a startup script for the service that verifies required
settings and applies platform-specific options for seamless execution.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

Author: piyush-zlai

distribution/publish_gcp_docker_images.sh

@@ -0,0 +1,67 @@
+#!/bin/bash
+
+
+if [[ -n $(git diff HEAD) ]]; then
+    echo "Error: You have uncommitted changes. Please commit and push them to git so we can track them."
+    exit 1
+fi
+
+# Get current branch name
+local_branch=$(git rev-parse --abbrev-ref HEAD)
+
+# Fetch latest from remote
+git fetch origin $local_branch
+
+# Check if local is behind remote
+if [[ -n $(git diff HEAD..origin/$local_branch) ]]; then
+    echo "Error: Your branch is not in sync with remote"
+    echo "Please push your local changes and sync your local branch $local_branch with remote"
+    exit 1
+fi
+
+set -e
+
+SCRIPT_DIRECTORY=$(dirname -- "$(realpath -- "$0")")
+CHRONON_ROOT_DIR=$(dirname "$SCRIPT_DIRECTORY")
+
+echo "Working in $CHRONON_ROOT_DIR"
+cd $CHRONON_ROOT_DIR
+
+echo "Building jars"
+
+bazel build //cloud_gcp:cloud_gcp_lib_deploy.jar
+bazel build //service:service_assembly_deploy.jar
+
+CLOUD_GCP_JAR="$CHRONON_ROOT_DIR/bazel-bin/cloud_gcp/cloud_gcp_lib_deploy.jar"
+SERVICE_JAR="$CHRONON_ROOT_DIR/bazel-bin/service/service_assembly_deploy.jar"
+
+if [ ! -f "$CLOUD_GCP_JAR" ]; then
+    echo "$CLOUD_GCP_JAR not found"
+    exit 1
+fi
+
+if [ ! -f "$SERVICE_JAR" ]; then
+    echo "$SERVICE_JAR not found"
+    exit 1
+fi
+
+# We copy to build output as the docker build can't access the bazel-bin (as its a symlink)
+echo "Copying jars to build_output"
+mkdir -p build_output
+cp bazel-bin/service/service_assembly_deploy.jar build_output/
+cp bazel-bin/cloud_aws/cloud_aws_lib_deploy.jar build_output/
+cp bazel-bin/cloud_gcp/cloud_gcp_lib_deploy.jar build_output/
+
+echo "Kicking off a docker login"
+docker login
+
+docker buildx build \
+  --platform linux/amd64,linux/arm64 \
+  -f docker/fetcher/Dockerfile \
+  -t ziplineai/chronon-fetcher:$(git rev-parse --short HEAD) \
+  -t ziplineai/chronon-fetcher:latest \
+  --push \
+  .
+
+# Clean up build output dir
+rm -rf build_output

docker/fetcher/Dockerfile

@@ -0,0 +1,53 @@
+# Start from a Debian base image
+FROM openjdk:17-jdk-slim
+
+# We expect jars to be copied to the build_output directory as docker can't read from bazel-bin as that's a symlink
+# https://stackoverflow.com/questions/31881904/docker-follow-symlink-outside-context
+ENV CLOUD_AWS_JAR_PATH=build_output/cloud_aws_lib_deploy.jar
+ENV CLOUD_GCP_JAR_PATH=build_output/cloud_gcp_lib_deploy.jar
+ENV FETCHER_SVC_JAR_PATH=build_output/service_assembly_deploy.jar
+ENV FETCHER_LAUNCH_SCRIPT=docker/fetcher/start.sh
+ENV GCP_ONLINE_CLASS=ai.chronon.integrations.cloud_gcp.GcpApiImpl
+ENV AWS_ONLINE_CLASS=ai.chronon.integrations.aws.AwsApiImpl
+
+# Update package lists and install necessary tools
+RUN apt-get update && apt-get install -y \
+    curl \
+    python3 \
+    python3-dev \
+    python3-setuptools \
+    vim \
+    wget \
+    procps \
+    python3-pip
+
+ENV SCALA_VERSION 2.12.18
+
+RUN curl https://downloads.lightbend.com/scala/${SCALA_VERSION}/scala-${SCALA_VERSION}.deb -k -o scala.deb && \
+    apt install -y ./scala.deb && \
+    rm -rf scala.deb /var/lib/apt/lists/*
+
+ENV SCALA_HOME="/usr/bin/scala"
+ENV PATH=${PATH}:${SCALA_HOME}/bin
+
+WORKDIR /srv/zipline
+
+ENV CLOUD_AWS_JAR=${CLOUD_AWS_JAR:-"/srv/zipline/cloud_aws/cloud_aws.jar"}
+ENV CLOUD_GCP_JAR=${CLOUD_GCP_JAR:-"/srv/zipline/cloud_gcp/cloud_gcp.jar"}
+ENV FETCHER_JAR=${FETCHER_JAR:-"/srv/zipline/fetcher/service.jar"}
+ENV LOG_PATH=${LOG_PATH:-"/srv/zipline/fetcher/logs"}
+
+COPY $CLOUD_AWS_JAR_PATH "$CLOUD_AWS_JAR"
+COPY $CLOUD_GCP_JAR_PATH "$CLOUD_GCP_JAR"
+COPY $FETCHER_SVC_JAR_PATH "$FETCHER_JAR"
+COPY $FETCHER_LAUNCH_SCRIPT /srv/fetcher/start.sh
+COPY docker/fetcher/logging.properties /srv/zipline/fetcher/logging.properties
+
+ENV FETCHER_PORT=9000
+
+HEALTHCHECK --start-period=2m --retries=4 CMD curl --fail http://localhost:$FETCHER_PORT/ping || exit 1
+
+RUN mkdir -p $LOG_PATH && \
+    chmod 755 $LOG_PATH
+
+CMD /srv/fetcher/start.sh

docker/fetcher/logging.properties

@@ -0,0 +1,23 @@
+# Handlers - both console and file
+handlers=java.util.logging.ConsoleHandler,java.util.logging.FileHandler
+
+# Common formatter for both handlers
+java.util.logging.SimpleFormatter.format=%1$tY-%1$tm-%1$td %1$tH:%1$tM:%1$tS.%1$tL [%4$s] %2$s: %5$s%6$s%n
+
+# Console handler configuration
+java.util.logging.ConsoleHandler.level=INFO
+java.util.logging.ConsoleHandler.formatter=java.util.logging.SimpleFormatter
+
+# File handler configuration
+java.util.logging.FileHandler.pattern=/srv/zipline/fetcher/logs/zipline-fs.%g.log
+java.util.logging.FileHandler.limit=104857600
+java.util.logging.FileHandler.count=30
+java.util.logging.FileHandler.formatter=java.util.logging.SimpleFormatter
+java.util.logging.FileHandler.level=INFO
+
+# Root logger configuration
+.level=INFO
+
+# Package-specific levels
+io.vertx.level=INFO
+ai.chronon.level=INFO

docker/fetcher/start.sh

@@ -0,0 +1,35 @@
+#!/bin/bash
+set -e
+
+# Required environment variables
+required_vars=("FETCHER_JAR" "STATSD_HOST" "FETCHER_PORT")
+for var in "${required_vars[@]}"; do
+  if [ -z "${!var}" ]; then
+    echo "Error: Required environment variable $var is not set"
+    exit 1
+  fi
+done
+
+if [[ $USE_AWS == true ]]; then
+  ONLINE_JAR=$CLOUD_AWS_JAR
+  ONLINE_CLASS=$AWS_ONLINE_CLASS
+else
+  ONLINE_JAR=$CLOUD_GCP_JAR
+  ONLINE_CLASS=$GCP_ONLINE_CLASS
+fi
+
+JMX_OPTS="-XX:MaxMetaspaceSize=1g -XX:MaxRAMPercentage=70.0 -XX:MinRAMPercentage=70.0 -XX:InitialRAMPercentage=70.0 -XX:MaxHeapFreeRatio=100 -XX:MinHeapFreeRatio=0"
+
+echo "Starting Fetcher service with online jar $ONLINE_JAR and online class $ONLINE_CLASS"
+
+if ! java -Dvertx.logger-delegate-factory-class-name=io.vertx.core.logging.JULLogDelegateFactory \
+  -Djava.util.logging.config.file=/srv/zipline/fetcher/logging.properties \
+  -jar $FETCHER_JAR run ai.chronon.service.FetcherVerticle \
+  $JMX_OPTS \
+  -Dserver.port=$FETCHER_PORT \
+  -Donline.jar=$ONLINE_JAR \
+  -Dai.chronon.metrics.host=$STATSD_HOST \
+  -Donline.class=$ONLINE_CLASS; then
+  echo "Error: Fetcher service failed to start"
+  exit 1
+fi