Skip to content

Spider Search / Scrape as a Tool #2972

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Aug 9, 2024

Conversation

toi500
Copy link
Contributor

@toi500 toi500 commented Aug 8, 2024

This PR introduces two new tool templates into Flowise using the spider.cloud API.

capture_240808_001145

1. Spider Web Scraper:

  • This tool scrapes and extracts the latest web page content using spider.cloud API for data analysis, providing up-to-date information

capture_240808_015557
capture_240808_015617

2. Spider Web Search & Scrape:

  • This tool allows us to perform a metasearch for any user-provided topic, scrape all found URLs, and aggregate the results for comprehensive LLM response generation

image
image

@toi500 toi500 changed the title Spider Search / Scrape as a Tools Spider Search / Scrape as a Tool Aug 8, 2024
@HenryHengZJ HenryHengZJ merged commit bf7a7f8 into FlowiseAI:main Aug 9, 2024
2 checks passed
@toi500 toi500 deleted the feature/SearchAndScrapeTools branch August 17, 2024 15:39
patrickreinan pushed a commit to patrickreinan/Flowise that referenced this pull request Sep 3, 2024
patrickreinan pushed a commit to patrickreinan/Flowise that referenced this pull request Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants