Skip to content

Infinite loop on authenticcation error with AWS MSK AIM #201

Open
@sergeykad

Description

@sergeykad

If no security parameters are specified when connecting to Amazon MSK with Identity and Access Management enabled, the Kafka client will repeatedly attempt the connection in a loop.

The following messages are printed repeatedly:

INFO  [kafka-producer-network-thread | producer-4] [o.a.k.c.NetworkClient.:] [Producer clientId=producer-4] Node -2 disconnected.
INFO  [kafka-producer-network-thread | producer-4] [o.a.k.c.NetworkClient.:] [Producer clientId=producer-4] Cancelled in-flight API_VERSIONS request with correlation id 1465 due to node -2 being disconnected (elapsed time since creation: 60ms, elapsed time since send: 60ms, throttle time: 0ms, request timeout: 30000ms)
WARN  [kafka-producer-network-thread | producer-4] [o.a.k.c.NetworkClient.:] [Producer clientId=producer-4] Bootstrap broker b-1.mskkafka.ionepq.11.kafka.region.amazonaws.com:9098 (id: -2 rack: null) disconnected

I suspect the issue occurs because org.apache.kafka.clients.NetworkClient cannot detect the reason for the disconnection as authentication-related in the processDisconnection method, but I did not debug it.

Using aws-msk-iam-auth:2.2.0 and org.apache.kafka:kafka-clients:3.4.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions