v0.24.7

[simulot]

This release focuses on improving the handling of potential file duplication sources to minimize duplicate uploads to the Immich server. The goal is to reduce internal errors and bad requests.

The duplication check has been refactored to use files' checksums, which requires Immich-go to read files entirely before uploading. This may slow down the process.

Changelog

• 310cab3 feat: Add --include-type for from-immich and from-google-photos (Google Photos album import with Read-only Gallery #16)
• c08fabf feat: Implement unit tests for setIncludeExtensionType (photos with same name into the year folder #12)
• 8ed7098 feat: add checksum header for asset uploads
• 1390fbe feat: add support for tracking already processed assets by checksum
• c5c86d4 feat: enhance asset handling to record already processed files and improve duplicate detection
• 5f3a337 feat: implement checksum calculation for assets
• 72a0c60 feat: update NewCacheReader to return SHA1 checksum along with CacheReader
• cc68d3c feat:implement-include-type (having a dedicated option to import Apple Photos #10)
• d7c4609 fix: ensure Checksum is set only if SHA1 is provided
• 411635a fix: ignore error from saveFn and reset newItems to avoid retrying failed assets
• e2daa7a fix: improve clarity in log message for duplicate file uploads
• 637e730 fix: include IsTrashed and IsArchived in debug log for Immich assets
• 5fae6af fix: prevent managing albums and tags for duplicate assets during upload
• de51610 fix: replace the gopher image file used for end-to-end tests
• a66e426 refactor: Format code
• fa717c4 refactor: remove BulkTagManager and associated tests
• d16c85d refactor: remove unused getByChecksum method and clean up code formatting

New Contributors

• @hugo-saci made their first contribution in feat: Add --include-type flag to upload command #796

Full Changelog: v0.24.6...v0.24.7

---

This discussion was created from the release v0.24.7.

[bibinisacmohan]

Immich read 39%, Assets found: 72865, Upload errors: 0, Uploaded 0 panic: asset checksum already exists

goroutine 53 (running]:
github.com/simulot/immich-go/app/cmd/upload. (*immichIndex).add(0xc000097e30, 0xc011588a80, 0x0)
github.com/simulot/immich-go/app/cmd/upload/advice.go:125 +0x2f8
github.com/simulot/immich-go/app/cmd/upload. (*immichIndex).addImmichAsset (0xc00009730,
jithub.com/simulot/immich-go/app/cmd/upload/advice.go:91 +0x16c
0xc010ff4000)
github.com/simulot/immich-go/app/cmd/upload. (*UpCmd) -getImmichAssets.func1(0x010ff4000)
github.com/simulot/immich-go/app/cmd/upload/run.go:203 +0x97
10g tune (exc8201148089)
github.com/simulot/immich-go/immich.(*ImmichClient).callSearchMetadata(0xc00008f900, {0xa055b0,
data (0xc00008f900, {0xa055b0, 0x0000a2b90}, 0x00008100, 0x0065f2bc0)
github.com/simulot/immich-go/immich/metadata.go:49 +0x31b
github.com/simulot/immich-go/immich.(*ImmichClient).GetAllAssetsWithFilter(0xc00008f900?,
{0xa055b0?, @xc0000a2b902), 0x0?,
0xc0065f2bc0?)
github.com/simulot/immich-go/immich/metadata.go:82 +0x71
github.com/simulot/immich-go/app/cd/upload. (*UpCmd) -getImmichAssets(0x00009a7e0, {0xa055b0, 0xc0000a2b90}, 0xc000080d60)
github.com/simulot/immich-go/app/cmd/upload/run.go:197 +0x198
github.com/simulot/immich-go/app/cmd/upload. (*UpCmd) .runNoUI.func4.1()
github.com/simulot/immich-go/app/cmd/upload/noui.go:84 +0x2c
golang.org/x/sync/errgroup. (*Group).Go.func1()
golang.org/x/[email protected]/errgroup/errgroup-go:78 +0x50
created by golang.org/x/sync/errgroup. (*Group).Go in goroutine 52
sh-4.4$
golang. oxg/x/synceve.12.0/errgroup/errgroup.go:75 +9x93

[simulot]

Immich-go got 2 files with the same checksum. Are you using the external library feature?

[bibinisacmohan]

Yes, I keep the same files in the external library as a backup/failsafe. Should I disable the external library for now?

[simulot]

It is an option.
I don't know yet what should be done in your case.

[simulot]

Another user got the same error. It was due to the partner sharing. You can disable the feature to let immich-go running.

A fix is on its way.