Skip to content

Some tasks in the Android world seem to be impossible to complete, even for humans. #289

Open
@LYXFOREVER

Description

@LYXFOREVER

Recently, I’ve started attempting to manually complete some tasks in Android World and save the trajectories. However, I’ve encountered numerous difficulties. Many tasks have various issues that prevent them from being completed. For example:

"MarkorTranscribeVideo": {
"task_name": "MarkorTranscribeVideo",
"task_goal": "Transcribe the contents of video ZwUN_moment_70_.mp4 by watching it in VLC player (located in Download) and writing the sequence of strings shown on each frame to the text file ZwUN_moment_70__transcription.txt in Markor as a comma-separated list. For example, if the first frame shows the text 'edna' and the second frame shows the text 'pineapple', then the text file should contain only the following text: 'edna, pineapple'.",
"agent_max_steps": 20
}

In this task, I can’t find the video. It seems that the video simply doesn’t exist, making the task impossible to complete.
There are many similar tasks where the required files do not exist, leading to task failures. Some tasks require copying a piece of text to the clipboard. I tried using the long press action in Android World to copy the text, but nothing happened. However, when I manually long-pressed the text using the mouse in the AVD (Android Virtual Device) visualization interface, it worked. It seems like the code is unable to automatically perform the long press action. These kinds of issues have caused many tasks to fail.
I suspect that these problems might be related to my AVD configuration. However, I followed all the steps as described in the documentation. Could it be that some network issues prevented the automated AVD configuration from being completed? Is there anyone who can provide an answer or upload a perfect AVD file that can fully execute the tasks in Android World?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions