[Enhancement] Support Paimon manifest cache

[mxdzs0612]

Why I'm doing:

Paimon enables CachingCatalog by default from 0.9.0. This PR optimizes Paimon metadata cache usage, default params are as follows:

        // cache expire time, set to 2h
        this.paimonOptions.set("cache.expiration-interval", "7200s");
        // max num of cached partitions of a Paimon catalog
        this.paimonOptions.set("cache.partition.max-num", "1000");
        // max size of cached manifest files, 10m means cache all since files usually no more than 8m
        this.paimonOptions.set("cache.manifest.small-file-threshold", "10m");
        // max size of memory manifest cache uses
        this.paimonOptions.set("cache.manifest.small-file-memory", "1g");

Users can change this options by adding propeties like paimon.option.xxxx when creating the paimon catalog.

What I'm doing:

Fixes #issue

What type of PR is this:

• BugFix
• Feature
• Enhancement
• Refactor
• UT
• Doc
• Tool

Does this PR entail a change in behavior?

• Yes, this PR will result in a change in behavior.
• No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

• Interface/UI changes: syntax, type conversion, expression evaluation, display information
• Parameter changes: default values, similar parameters but with different default values
• Policy changes: use new policy to replace old one, functionality automatically enabled
• Feature removed
• Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

• I have added test cases for my bug fix or my new feature
• This pr needs user documentation (for new or modified features or behaviors)
  • I have added documentation for my new feature or new function
• This is a backport pr

Bugfix cherry-pick branch check:

• I have checked the version labels which the pr will be auto-backported to the target branch
  • 3.4
  • 3.3
  • 3.2
  • 3.1
  • 3.0

[mxdzs0612]

Waiting for #55785 to be merged first.

[sonarqubecloud]

Quality Gate failed

Failed conditions
C Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

[github-actions]

[Java-Extensions Incremental Coverage Report]

✅ pass : 0 / 0 (0%)

[github-actions]

[FE Incremental Coverage Report]

✅ pass : 81 / 96 (84.38%)

file detail

	path	covered_line	new_line	coverage	not_covered_line_detail
🔵	com/starrocks/connector/hive/ConnectorTableMetadataProcessor.java	30	40	75.00%	[179, 180, 194, 196, 197, 198, 199, 200, 207, 208]
🔵	com/starrocks/connector/paimon/PaimonMetadata.java	39	44	88.64%	[169, 637, 638, 647, 648]
🔵	com/starrocks/common/Config.java	1	1	100.00%	[]
🔵	com/starrocks/catalog/PaimonTable.java	2	2	100.00%	[]
🔵	com/starrocks/server/GlobalStateMgr.java	1	1	100.00%	[]
🔵	com/starrocks/connector/paimon/PaimonConnector.java	8	8	100.00%	[]

[github-actions]

[BE Incremental Coverage Report]

✅ pass : 0 / 0 (0%)

[github-actions]

@Mergifyio backport branch-3.4

[mergify]

backport branch-3.4

✅ Backports have been created

• #56804 [Enhancement] Support Paimon manifest cache (backport #55788) has been created for branch branch-3.4