Releases v1.6.0

What's Changed - Brief Version

New features

• Changed supported Python version range (>=3.9, <=3.11)
  (#1269)
• Support MMDetection COCO format
  (#1213)
• Develop JsonSectionPageMapper in Rust API
  (#1224)
• Add Filtering via User-Provided Python Functions
  (#1230, #1233)
• Remove supporting MacOS platform
  (#1235)
• Support Kaggle image data (KaggleImageCsvBase, KaggleImageTxtBase, KaggleImageMaskBase, KaggleVocBase, KaggleYoloBase)
  (#1240)
• Add __getitem__() for random accessing with O(1) time complexity
  (#1247)
• Add Data-aware Anchor Generator
  (#1251)
• Support bounding box import within Kaggle extractors and add KaggleCocoBase
  (#1273)

Enhancements

• Optimize Python import to make CLI entrypoint faster
  (#1182)
• Add ImageColorScale context manager
  (#1194)
• Enhance visualizer to toggle plot title visibility
  (#1228)
• Enhance Datumaro data format detect() to be memory-bounded and performant
  (#1229)
• Change RoIImage and MosaicImage to have np.uint8 dtype as default
  (#1245)
• Enable image backend and color channel format to be selectable
  (#1246)
• Boost up CityscapesBase and KaggleImageMaskBase by dropping np.unique
  (#1261)
• Enhance RISE algortihm for explainable AI
  (#1263)
• Enhance explore unit test to use real dataset from ImageNet
  (#1266)
• Fix each method of the comparator to be used separately
  (#1290)
• Bump ONNX version to 1.16.0
  (#1376)
• Print the color channel format (RGB) for datum stats command
  (#1389)
• Add ignore_index argument to Mask.as_class_mask() and Mask.as_instance_mask()
  (#1409)

Bug fixes

• Fix wrong example of Datumaro dataset creation in document
  (#1195)
• Fix wrong command to install datumaro from github
  (#1202, #1207)
• Update document to correct wrong datum project import command and add filtering example to filter out items containing annotations.
  (#1210)
• Fix label compare of distance method
  (#1205)
• Fix Datumaro visualizer's import errors after introducing lazy import
  (#1220)
• Fix broken link to supported formats in readme
  (#1221)
• Fix Kinetics data format to have media data
  (#1223)
• Handling undefined labels at the annotation statistics
  (#1232)
• Add unit test for item rename
  (#1237)
• Fix a bug in the previous behavior when importing nested datasets in the project
  (#1243)
• Fix Kaggle importer when adding duplicated labels
  (#1244)
• Fix input tensor shape in model interpreter for OpenVINO 2023.3
  (#1251)
• Add default value for target in prune cli
  (#1253)
• Remove deprecated MediaManager
  (#1262)
• Fix explore command without project
  (#1271)
• Fix enable COCO to import only bboxes
  (#1360)
• Fix resize transform for RleMask annotation
• (#1361)
• Fix import YOLO variants from extractor when urls is not specified
  (#1362)

What's Changed- Full Version

• Adjust pr-check on condition by @yunchu in #1146
• Infra/mergeback 1.5.0 by @yunchu in #1152
• Bump version string by @yunchu in #1156
• Modify coco to export annotations without media by @jihyeonyi in #1158
• fix github link in docs by @smidm in #1159
• Fix broken YOLO ultralytics links by @daniilpastukhov in #1161
• Upgrade openvino to 2023.1 by @yunchu in #1167
• Add SAMAutomaticMaskGeneration transform by @vinnamkim in #1168
• Mergeback 1.5.1rc2 by @yunchu in #1181
• Optimize Python import to make CLI entrypoint faster by @vinnamkim in #1182
• Add ImageColorScale context manager by @vinnamkim in #1194
• Fix wrong example of Datumaro dataset creation in document by @sooahleex in #1195
• Mergeback 1.5.1 to develop by @yunchu in #1200
• update document regarding installation command from github by @jihyeonyi in #1202
• hotfix indent of installation document by @jihyeonyi in #1207
• correct datum project import examples by @jihyeonyi in #1210
• Fix label compare of distance method by @sooahleex in #1205
• Add MMDetection COCO format importer by @wonjuleee in #1213
• Update code scanning wf for reporting bandit detection as eror by @yunchu in #1215
• Update version constraint for dvc and tfds by @yunchu in #1218
• Upgrade OpenVINO by @sovrasov in #1196
• fix broken link to supported formats by @jihyeonyi in #1221
• Fix Datumaro visualizer's import errors after introducing lazy import by @vinnamkim in #1220
• Enable fuzzing to the CLI by @yunchu in #1222
• Develop JsonSectionPageMapper in Rust API by @vinnamkim in #1224
• Add nosec B311 directives by @vinnamkim in #1226
• Enhance visualizer to toggle plot title visibility by @vinnamkim in #1228
• Move Rust API unit tests to a separate directory by @vinnamkim in #1227
• [Bug] Fix Kinetics format to have media by @wonjuleee in #1223
• Enhance Datumaro data format detect() to be memory-bounded and performant by @vinnamkim in #1229
• Add Filtering via User-Provided Python Functions by @vinnamkim in #1230
• Handling undefined labels at the annotation statistics by @jihyeonyi in #1232
• Update filtering skill up page by @vinnamkim in #1233
• Upgrade CI to MACOS-12 by @vinnamkim in #1234
• Remove supporting MacOS platform by @yunchu in #1235
• Bump version string by @yunchu in #1236
• Add unit test for item rename by @sooahleex in #1237
• Fix filtering skill up doc by @vinnamkim in #1238
• Add Kaggle data supports by @wonjuleee in #1240
• Fix a bug in the previous behavior when importing nested datasets in the project by @vinnamkim in #1243
• Fix duplicated label import for Kaggle importer by @wonjuleee in #1244
• Change RoIImage and MosaicImage to have np.uint8 dtype as default by @vinnamkim in #1245
• Enable image backend and color channel format to be selectable by @vinnamkim in #1246
• Implement dm.Dataset index access by @itrushkin in #1247
• Add data-aware anchor generator by @wonjuleee in #1251
• Add default value for target in prune cli by @sooahleex in #1253
• Add notebook for Kaggle importers by @wonjuleee in #1254
• Fix files not found with find_files function by @imyhxy in #1255
• Fix kaggle importer with media ordering by @wonjuleee in #1258
• Mergeback changes for 1.5.2 to develop by @yunchu in #1257
• Prioritize using imagesize library to get image size for ImageFromFile by @imyhxy in #1259
• Allow empty label on Ultralytics YOLO dataset by @imyhxy in #1264
• Remove deprecated MediaManager by @vinnamkim in #1262
• Fix RISE algorithm for explain function by @wonjuleee in #1263
• Enhance unit test for explore by @wonjuleee in #1266
• Fix DataAwareAnchorGenerator cuda device by @wonjuleee in #1267
• Boost segmentation import performance by @wonjuleee in #1261
• Remove python 3.8 supporting by @yunchu in #1269
• Fix explore command without project by @sooahleex in #1271
• Add importers grouping by file extensions by @itrushkin in #1268
• Fix code-scanning wf issue by @yunchu in #1272
• Fix RISE unit test by @wonjuleee in #1274
• Add KaggleCoco and Bbox capability in KaggleImageCsv and KaggleImageTxt by @wonjuleee in #1273
• Add OpenSSF scorecard workflow by @yunchu in #1275
• Fix typo to the action hash by @yunchu in #1277
• Fix pinned-dependency issues for docker by @yunchu in #1280
• docs: change infos to info in datumaro format json file by @chbroecker in #1283
• Update dockerfile to resolve remained pin-deps issue by @yunchu in #1282
• Bump scorecard action to 2.3.1 by @yunchu in #1285
• Add metadata to automatic specs.json generation by @itrushkin in #1284
• Mark xfail to randomly failed test by @vinnamkim in #1288
• Create codeql.yml by @yunchu in #1286
• Fix each method of the comparator to be used separately by @sooahleex in #1290
• Implement Datumaroapp GUI for datumaro by @sooahleex in #1279
• Add dependabot configuration by @yunchu in #1289
• Set OV version upper limit to <2024.0.0 by @vinnamkim in #1312
• Bump isort from 5.11.5 to 5.13.2 in /tests by @dependabot in #1294
• Bump pozil/auto-assign-issue from 1.11.0 to 1.13.0 by @dependabot in #1293
• Bump ruff from 0.0.258 to 0.3.2 by @dependabot in #1309
• Bump black from 23.1.0 to 24.2.0 by @dependabot in #1295
• Bump black from 23.1.0 to 24.2.0 in /tests by @dependabot in #1296
• Bump github/codeql-action from 3.24.5 to 3.24.6 by @dependabot in #1297
• Bump actions/setup-python from 3 to 5 by @dependabot in #1299
• Bump codecov/codecov-action from 3 to 4 by @dependabot in #1301
• Bump actions/download-artifact from 3 to 4 by @dependabot in #1303
• Bump dvc from 3.30.1 to 3.48.3 in /docs by @dependabot in #1300
• Bump dvc from 3.30.1 to 3.48.3 by @dependabot in #1305
• Update dependabot.yml to add pip path for gui modules by @yunchu in #1313
• Bump pydata-sphinx-theme from 0.12.0 to 0.15.2 by @dependabot in #1326
• Update pydantic requirement from ~=1.10.12 to ~=2.6.3 by @dependabot in #1298
• Bump nbqa[toolchain] from 1.6.3 to 1.8.4 in /docs by @dependabot in #1311
• Bump pre-commit/action from 3.0.0 to 3.0.1 by @dependabot in #1320
• Bump pypa/gh-action-pypi-publish from 1.7.1 to 1.8.14 by @dependabot in #1319
• Bump sphinx from 5.3.0 to 7.2.6 by @dependabot in #1324
• Update docs_latest to support test building via manual trigger by @yunchu in #1333
• Bump markupsafe from 2.0.1 to 2.1.5 in /docs by @dependabot in #1316
• Upgrade streamlit version and match apis by @sooahleex in #1334
• Fix ContextVar into DatumaroApp by @sooahleex in #1327
• Resolve vulnerabilities for release 2.0.0 by @yunchu in #1343
• Bump PyYAML to 6.0.1 to remedy GHSA-8q59-q68h-6hv4 by @yunchu in #1341
• Bump actions/upload-artifact from v3 to v4 by @yunchu in #1342
• Bump github/codeql-action from 3.24.6 to 3.24.7 by @dependabot in #1340
• Bump black from 24.2.0 to 24.3.0 in /tests by @dependabot in #1349
• Bump ruff from 0.3.2 to 0.3.3 in /tests by @dependabot in #1348
• Remove pydantic by @sooahleex in #1354
• Add documentations for DatumaroApp by @sooahleex in #1345
• Update streamlit config for localhost and secured data by @wonjuleee in #1357
• Update streamlit config by @yunchu in #1358
• Update version string, changelog, and release note by @yunchu in #1355
• Enable coco format to import bbox annotations by @wonjuleee in #1360
• Update trivy scanning workflow by @yunchu in #1359
• Fix resize transform for RleMask annotation by @sooahleex in #1361
• Fix wrong documentation for filtering example by @vinnamkim in #1363
• Add DatasetImportError for yolo variants by @wonjuleee in #1362
• Mergeback/2.0.0 by @yunchu in #1364
• Bump github/codeql-action from 3.24.7 to 3.24.8 by @dependabot in #1356
• Bump black from 24.2.0 to 24.3.0 in /docker/segment-anything by @dependabot in #1366
• Pin vulnerable dependencies to latest by @yunchu in #1372
• Bump ruff from 0.3.3 to 0.3.4 by @dependabot in #1369
• Bump github/codeql-action from 3.24.8 to 3.24.9 by @dependabot in #1373
• Bump lxml from 4.9.4 to 5.1.0 by @dependabot in #1375
• Mergeback/2.0.0 part2 by @yunchu in #1395
• Bump aquasecurity/trivy-action from 0.18.0 to 0.19.0 by @dependabot in #1386
• Bump opencv-python-headless to 4.9.0.80 by @yunchu in #1400
• Bump pillow from 10.2.0 to 10.3.0 by @dependabot in #1407
• Bump streamlit from 1.32.0 to 1.32.2 by @dependabot in #1346
• Bump dvc from 3.48.3 to 3.49.0 by @dependabot in #1381
• Bump nbqa[toolchain] from 1.8.4 to 1.8.5 by @dependabot in #1380
• Bump lxml from 5.1.0 to 5.2.0 by @dependabot in #1396
• Bump pillow from 10.2.0 to 10.3.0 in /docker/segment-anything by @dependabot in #1406
• Bump orjson from 3.9.15 to 3.10.0 by @dependabot in #1387
• Bump ruff from 0.3.4 to 0.3.5 in /tests by @dependabot in #1397
• Update issue assigner by @wonjuleee in #1404
• Add ignore_index argument to Mask.as_class_mask() and Mask.as_instance_mask() by @vinnamkim in #1409
• Remove all GUI codes by @wonjuleee in #1419
• Remove gui related things by @yunchu in #1420
• Update version string to 1.6.0rc1 by @yunchu in #1421
• Update for release 1.6.0 by @yunchu in #1427

New Contributors

• @smidm made their first contribution in #1159
• @daniilpastukhov made their first contribution in #1161
• @sovrasov made their first contribution in #1196
• @itrushkin made their first contribution in #1247
• @imyhxy made their first contribution in #1255
• @chbroecker made their first contribution in #1283

Full Changelog: v1.5.2...v1.6.0