fix(datastore): Reconcile batch process optimization bug #2727

[joon-won]

• [✅] PR title and description conform to Pull Request guidelines.

Issue #, if available:
#2727

Description of changes:

How did you test these changes?
(Please add a line here how the changes were tested)

Documentation update required?

• [✅] No
• Yes (Please include a PR link for the documentation update)

General Checklist

• [] Added Unit Tests
• Added Integration Tests
• Security oriented best practices and standards are followed (e.g. using input sanitization, principle of least privilege, etc)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 90.00000% with 1 lines in your changes are missing coverage. Please review.

Project coverage is 43.01%. Comparing base (30a288e) to head (c83cb32).

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2749      +/-   ##
==========================================
+ Coverage   43.00%   43.01%   +0.01%     
==========================================
  Files         905      905              
  Lines       29178    29183       +5     
  Branches     4152     4153       +1     
==========================================
+ Hits        12548    12554       +6     
+ Misses      15271    15269       -2     
- Partials     1359     1360       +1     

[tylerjroach]

This is a good first attempt. This looks like it may be logically correct but there are no tests to assert correct result.

Suggestion for the test: Create a scenario that will remove duplicates as expected. The end result should assert against an expected list.