-
Notifications
You must be signed in to change notification settings - Fork 2.7k
[processor/logstransform]: Logstransform processor does not properly drain data #31159
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
This also seems related to #31074, since stanza adapter code is shared with this component. |
This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
This issue has been closed as inactive because it has been stale for 120 days with no activity. |
Component(s)
processor/logstransform
What happened?
Description
The logstransform processor does not drain log data that it has accepted in ConsumeLogs.
This means that when the collector is stopped, some log data may be lost.
I noticed this when I was writing a test to reproduce #31139 that I was getting 0 logs half the time, 500 logs the other half here:
975a39d#diff-2de55e867acbc6d11c6db4e7470806017e911f59d334e99352f19f7c18ed35b6R287
There are a couple of places where we bail out early when stopping, but I think it's preferable to keep going in these areas so we don't drop any logs on shutdown, e.g.:
opentelemetry-collector-contrib/pkg/stanza/adapter/frompdataconverter.go
Lines 108 to 124 in 8ccadc3
Collector version
8ccadc3
Environment information
No response
OpenTelemetry Collector configuration
No response
Log output
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: