Compaction: Stabilize picker by refactoring the picker's restriction logic

[Li0k]

In hummock, we define different compaction policies for different levels of compaction to achieve the goals of eliminating sub_levels, limiting write amplification, and so on. For example:

• Tier Compaction
• Base Level Compaction
• Other Level Compaction

However, different policies have different constraints. In the current implementation, the restriction logic is implemented in separate pickers. This code is not conducive to maintenance and subsequent development. Moreover, when the compaction does not behave as expected, or even falls into a write stop, adjusting the configuration will be a difficult task.

In order to facilitate code iteration and configuration adjustment, this refactor will be divided into two parts.

1. Extract the restriction codes of different pickers. (refactor(storage): seperate validator logic from picker #11984)
   2. Make picker limits switchable for easy adjustment

[hzxa21]

Any updates?

[Li0k]

Any updates?

There are no plans. Let's close this issue first.