File tree 1 file changed +6
-6
lines changed
1 file changed +6
-6
lines changed Original file line number Diff line number Diff line change 1
1
Manual commit
2
2
=============
3
3
4
- When processing more sensitive data ``enable_auto_commit=False `` mode of
5
- Consumer can lead to data loss in cases of critical failure. To avoid it we
6
- can commit offsets manually after they were processed. Note, that this is a
7
- tradeoff from * at most once * to *at least once * delivery, to achieve
8
- * exactly once * you will need to save offsets in the destination database and
9
- validate those yourself.
4
+ When processing sensitive data, using ``enable_auto_commit=True `` (default) for the
5
+ Consumer can lead to data loss in the event of a critical failure. To avoid
6
+ this, set `` enable_auto_commit=False `` and commit offsets manually only after
7
+ messages have been processed. Note, that this is a tradeoff from *at most once *
8
+ to * at least once * delivery, to achieve * exactly once * you will need to save
9
+ offsets in the destination database and validate those yourself.
10
10
11
11
More on message delivery: https://kafka.apache.org/documentation.html#semantics
12
12
You can’t perform that action at this time.
0 commit comments