feat: bump spark to 3.5.4 (#392)

## Summary
- Release Notes:
https://spark.apache.org/releases/spark-release-3-5-4.html
- https://issues.apache.org/jira/browse/SPARK-49791 is a good one for
us.
## Checklist
- [ ] Added Unit Tests
- [ ] Covered by existing CI
- [ ] Integration tested
- [ ] Documentation update


<!-- av pr metadata
This information is embedded by the av CLI when creating PRs to track
the status of stacks when using Aviator. Please do not delete or edit
this section of the PR.
```
{"parent":"main","parentHead":"","trunk":"main"}
```
-->


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
- Upgraded underlying Apache Spark libraries to version 3.5.4,
delivering enhanced performance, stability, and compatibility. This
update improves processing efficiency and backend reliability, ensuring
smoother and more secure data operations. End-users may notice more
robust and responsive interactions as a result of these improvements,
further enhancing overall system performance.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->

Co-authored-by: Thomas Chow <[email protected]>

Author: tchow-zlai

tools/build_rules/dependencies/spark_repository.bzl

@@ -8,10 +8,10 @@ spark_repository = repository(
     provided = True,
     artifacts = [
         # Spark artifacts - for scala 2.12
-        "org.apache.spark:spark-sql_2.12:3.5.1",
-        "org.apache.spark:spark-hive_2.12:3.5.1",
-        "org.apache.spark:spark-streaming_2.12:3.5.1",
-        "org.apache.spark:spark-avro_2.12:3.5.1",
+        "org.apache.spark:spark-sql_2.12:3.5.4",
+        "org.apache.spark:spark-hive_2.12:3.5.4",
+        "org.apache.spark:spark-streaming_2.12:3.5.4",
+        "org.apache.spark:spark-avro_2.12:3.5.4",
 
         # Hive dependencies
         "org.apache.hive:hive-metastore:2.3.9",