Skip to content

[FEATURE] Inconsistent Video Playback Timing in DROID pi0 inference script #431

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Everloom-129 opened this issue Apr 13, 2025 · 0 comments

Comments

@Everloom-129
Copy link

Hi! Here is Tony from GRASP Lab@UPenn.
When we are evaluating the pi0, we notice current implementation of examples/droid/main.py for pi0 only records frames at policy inference intervals. This results in inconsistent video playback speeds. The delays (~750ms–1s) inherent to inference and environment steps lead to misleading visualizations that roughly appear as real-time but do not precisely reflect true action timing.

**Expected Feature: **
Videos should play back consistently at real-time speed (e.g., 10 FPS), accurately representing agent behavior.

  • Implement timestamp-based frame recording
  • Alternatively, continuously record frames independently at a fixed frame rate (e.g., client-side recording).

Hope this could help future benchmark & evaluation!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant