[Browsing]: Make a richer set of web browsing actions

[neubig]

What problem or use case are you trying to solve?

Currently OpenDevin can perform browsing on the web, but not a wider variety of web tasks. It would be good if it could do more things, such as scrolling through pages, potentially clicking on things, etc.

Do you have thoughts on the technical implementation?

Fortunately, we are in the process of incorporating BrowserGym, which should make this relatively easy. To fix this issue we can:

• Reference the implementation of the BrowseURLAction.
• Reference the set of browsing actions provided by BrowserGym.
• Implement the set of browsing actions in BrowserGym in a similar way to BrowseURLAction

[mikanfactory]

Hi, may I work on this task?

[neubig]

Hi, we'd love to have help in general, but for this particular task @frankxu2004 is probably going to work on it so we have it covered. We'll plan on getting this implemented in the next week or two I think. If there are other issues that interest you we'd love to have your help though!

[mikanfactory]

Understood. I'll look for other issues!

[frankxu2004]

Now arbitrary actions are supported through BrowseInteractiveAction via #1807