Add rowRestriction when fetching BQ schema

[joy91227]

Issue: When using the BQ to Parquet flex template on partitioned BQ tables, we encounter error [2]

Analysis:

• The stack trace [3] suggests the issue is when we try to create a read session.
• It seems that we missed setting rowRestrictions [1]

[1] https://cloud.google.com/java/docs/reference/google-cloud-bigquerystorage/3.11.4/com.google.cloud.bigquery.storage.v1.ReadSession.TableReadOptions.Builder#com_google_cloud_bigquery_storage_v1_ReadSession_TableReadOptions_Builder_setRowRestriction_java_lang_String_

[2] INVALID_ARGUMENT: request failed: Query error: Cannot query over table 'xxxx' without a filter over column(s) 'xxxx' that can be used for partition elimination

[3]
... at com.google.cloud.bigquery.storage.v1beta1.BigQueryStorageClient.createReadSession(BigQueryStorageClient.java:239)
.... at com.google.cloud.teleport.v2.templates.BigQueryToParquet.run(BigQueryToParquet.java:253)

[shunping]

Thanks for the fix @joy91227 , and it looks promising to me.

Could you also add a test to verify that it works?

[codecov]

Codecov Report

Attention: Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.

Project coverage is 48.97%. Comparing base (42c951e) to head (c35d9fd).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
...cloud/teleport/v2/templates/BigQueryToParquet.java	0.00%	2 Missing ⚠️

❌ Your patch check has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files

@@            Coverage Diff            @@
##               main    #2273   +/-   ##
=========================================
  Coverage     48.97%   48.97%           
  Complexity     4515     4515           
=========================================
  Files           911      911           
  Lines         55232    55234    +2     
  Branches       5892     5893    +1     
=========================================
+ Hits          27051    27053    +2     
+ Misses        26263    26262    -1     
- Partials       1918     1919    +1     

Components	Coverage Δ
spanner-templates	70.05% <ø> (-0.01%)	⬇️
spanner-import-export	68.04% <ø> (-0.02%)	⬇️
spanner-live-forward-migration	78.42% <ø> (ø)
spanner-live-reverse-replication	80.31% <ø> (ø)
spanner-bulk-migration	88.65% <ø> (ø)

Files with missing lines	Coverage Δ
...cloud/teleport/v2/templates/BigQueryToParquet.java	1.58% <0.00%> (-0.06%)	⬇️

... and 2 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[joy91227]

The integration test involves creating a time partitioned table. Currently BigqueryResourceManager, the testing util in Beam for BQ tables, does not support this.

I opened a PR to add this feature
apache/beam#34471