Skip to content

[Feat] [firecrawl-py] Add support for controlling retry behaviour in FirecrawlApp and AsyncFirecrawlApp #1528

Open
@m-roberts

Description

@m-roberts

Problem Description
It would be nice to have more control over retry logic. Currently, the internal methods use this, but they are not available to extract, etc.

Proposed Feature
Add these as optional parameters to top-level functions, or as constructor parameters to allow for more precise control.

Alternatives Considered
Not sure that an alternative is required.

Implementation Suggestions
Both approaches would suit my needs, though a thorough implementation would support both, opting to take those passed into the method invocations over the defaults.

Use Case
For me, this is particularly useful when developing a prompt and response structure against a dataset, which requires many calls - however, I think this would be useful in any case where there's a spike in traffic that may require more control over retry behavior.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions