Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload blocks no compaction marks to the global location and introduce a new cortex_bucket_blocks_marked_for_no_compaction_count metric #4729

Merged
merged 9 commits into from
May 19, 2022

Conversation

alanprot
Copy link
Member

@alanprot alanprot commented May 5, 2022

What this PR does:
Follow up of #4707.

  • Upload the no-compact marks to the global marks location
  • Introduce a new metric to show how many blocks are marked for no compact on store.

Which issue(s) this PR fixes:
Fixes: #4727

Checklist

  • Tests updated
  • [] Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@alanprot alanprot force-pushed the non-compact-blocks-gauge branch from e10b9bb to cd9707c Compare May 5, 2022 01:10
@alanprot alanprot changed the title Non compact blocks gauge Upload blocks no compaction marks to the global location and introduce a new cortex_bucket_blocks_marked_for_no_compaction_count metric May 6, 2022
@alanprot alanprot force-pushed the non-compact-blocks-gauge branch from 3ef3251 to 5563e2b Compare May 6, 2022 19:43
@alanprot alanprot marked this pull request as ready for review May 6, 2022 19:46
}
for mark, globalFilePath := range marks {
// Look up mark (if any).
reader, err := userBucket.Get(ctx, path.Join(blockID.String(), mark))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

who is mark?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mark can be now both, the deletion and no-compact mark.

@alvinlin123 alvinlin123 merged commit d5ce6f4 into cortexproject:master May 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Current cortex_compactor_blocks_marked_for_no_compaction_total value is lost upon redeployment
2 participants