Skip to content

Check dataset version when loading LeRobot dataset #9233

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Mar 10, 2025

Conversation

oxkitsune
Copy link
Member

@oxkitsune oxkitsune commented Mar 7, 2025

Related

What

The loader now explicitly validates the dataset version, preventing unexpected behavior or silent failures due to unsupported dataset versions.

@oxkitsune oxkitsune added 📺 re_viewer affects re_viewer itself include in changelog labels Mar 7, 2025
Copy link

github-actions bot commented Mar 7, 2025

Web viewer built successfully. If applicable, you should also test it:

  • I have tested the web viewer
Result Commit Link Manifest
17d331c https://rerun.io/viewer/pr/9233 +nightly +main

Note: This comment is updated whenever you push a commit.

@teh-cmc teh-cmc self-requested a review March 10, 2025 09:23
return false;
}

["meta_data", "data"].iter().all(|subdir| {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs a comment pointing out the difference with v2 -- this took me a while lol.

Also, is there really nothing better we can do here? 😭

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added a comment.

I can't really think of any other method that doesn't require us to parse the actual dataset info file. The schema is a bit different between v1 and v2 datasets, so we'd have to parse it differently.

@oxkitsune oxkitsune force-pushed the gijs/check-lerobot-version branch from 0788b2e to a4024f9 Compare March 10, 2025 13:55
@Wumpf Wumpf self-requested a review March 10, 2025 15:01
@oxkitsune oxkitsune merged commit bd29230 into main Mar 10, 2025
36 checks passed
@oxkitsune oxkitsune deleted the gijs/check-lerobot-version branch March 10, 2025 15:04
@emilk emilk mentioned this pull request Apr 11, 2025
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Explicit version checking for LeRobot datasets
3 participants