Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure that compaction continues for block with incomplete time-range #4771

Merged

Conversation

harry671003
Copy link
Contributor

@harry671003 harry671003 commented Jul 5, 2022

Signed-off-by: 🌲 Harry 🌊 John 🏔 [email protected]

What this PR does:
This PR tries to address an edge case where compaction stops when a tenant stops ingesting samples. The blocks with incomplete maxTime will never be compacted.

Which issue(s) this PR fixes:
Fixes #4770

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@harry671003 harry671003 force-pushed the fix_compactor_group_issue branch from 812f708 to 42f0e63 Compare July 5, 2022 16:28
@alanprot
Copy link
Member

alanprot commented Jul 5, 2022

Thanks for looking into this!

@alvinlin123
Copy link
Contributor

LGTM

@alvinlin123
Copy link
Contributor

@alanprot @friedrichg what are your opinions about merging this into 1.13 release branch?

@alvinlin123 alvinlin123 merged commit f7a9d27 into cortexproject:master Jul 6, 2022
@alanprot
Copy link
Member

alanprot commented Jul 6, 2022

I think we can pick... seems a safe change.

alvinlin123 pushed a commit that referenced this pull request Jul 6, 2022
…#4771)

* Ensure that compaction continues for block with incomplete time-range

Signed-off-by: 🌲 Harry 🌊 John 🏔 <[email protected]>

* Ensure that compaction continues for block with incomplete time-range

Signed-off-by: 🌲 Harry 🌊 John 🏔 <[email protected]>

* Ensure that compaction continues for block with incomplete time-range

Signed-off-by: 🌲 Harry 🌊 John 🏔 <[email protected]>

* Ensure that compaction continues for block with incomplete time-range

Signed-off-by: 🌲 Harry 🌊 John 🏔 <[email protected]>
Copy link
Member

@friedrichg friedrichg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice find.
👍 to the cherry pick

@harry671003 harry671003 deleted the fix_compactor_group_issue branch July 6, 2022 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Compactor with shuffle sharding doesn't compact blocks with maxTime != blockRange
4 participants