Update how credential data is saved in db when using aws secrets manager #4271
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
HenryHengZJ
reviewed
Apr 9, 2025
HenryHengZJ
approved these changes
Apr 9, 2025
Yshayy
pushed a commit
to Yshayy/Flowise
that referenced
this pull request
Apr 23, 2025
…ger (FlowiseAI#4271) * Update how credential data is saved in db when using aws secrets manager * Run lint-fix and update env example
ct3685
pushed a commit
to the-answerai/theanswer
that referenced
this pull request
Jun 27, 2025
* Add Sequential Thinking MCP tool for structured problem-solving (FlowiseAI#4143) * Chore/update pnpm run dev (FlowiseAI#4154) update pnpm run dev * Chore/update vite config (FlowiseAI#4158) update vite config * [Fix] Change S3 logger to accept more authorization methods for AWS (FlowiseAI#4114) * Change S3 logger to accept more authorization methods for AWS * Lint fix * Add support for GPT-4.5-preview model in OpenAI Assistant Dialog (FlowiseAI#4147) * Bugfix/S3 Credentials (FlowiseAI#4166) only set s3 credentials when access key and secret key exist * feat: Add SSL configuration option for Postgres connections (FlowiseAI#4130) Update README files for Postgres Record Manager and Vector Store to include a new SSL environment variable, allowing optional SSL configuration for database connections * Weaviate - expose Hybrid Search (FlowiseAI#4127) Hybrid Search for Weaviate * Fix Agent Chat History Retrieval (FlowiseAI#4163) fixed agents history from api * Bugfix/arbitrary create attachemnt file upload (FlowiseAI#4171) fix arbitrary create attachemnt file upload * Add an Ollama baseUrl in chatflow configuration for Follow-up prompts (FlowiseAI#4169) Add abn Ollama baseUrl in chatflow configuration for Follow-up prompts * Bugfix/Validate URL for postCore (FlowiseAI#4172) validare url for postCore * Chore/update bullmq version (FlowiseAI#4174) update bullmq version * Release/2.2.7-patch.1 (FlowiseAI#4180) [email protected] * Add curl in docker image for native healthchecks (FlowiseAI#4170) * Add curl in docker image for native healthchecks Fixes this issue: FlowiseAI#4126 * fix: add container-native healthcheck - Added curl utility in dockerfile - Added healthcheck configuration in docker compose * fix: exclude ping endpoint from logging * NVIDIA NIM fixes (FlowiseAI#4215) * fix: udpate label to "NVIDIA NIM API Key" * test: update tag from ":latest" to ":1.8.0-rtx" * test: add image URL path "nvcr.io/nim/" * fix/nvidia-nim-2 (FlowiseAI#4208) * fix: update nim-container-manager * feat: add "DeepSeek R1 Distill Llama 8B" * fix/nidia-nim-3 (FlowiseAI#4209) * chore: add error message NVIDIA NIM is not installed. * chore: standardize NVIDIA NGC API Key * chore: capitalize Nvidia to NVIDIA * chore: generalize error message for chat models * fix/nvidia-nim-4-yau (FlowiseAI#4212) * test: nimRelaxMemConstraints and hostPort * test: add logger for hostPort and nimRelaxMemConstraints * test: nim-container-manager version 1.0.9 * test: parseInt nimRelaxMemConstraints * test: update nim-container-manager version to 1.0.10 * chore: update nim-container-manager version to 1.0.11 * Update start container behaviour - show existing containers and give users the choice * Go back to previous step when clicking start new so user can change port number * Update condition for showing existing container dialog * Fix start new in different port not working * Update get container controller * Update again * fix: generalize error message for chat models * Update getContainer controller * Fix incorrect image check in getContainer controller * Update existing container dialog text * Fix styles in container exists dialog for nvidia nim --------- Co-authored-by: chungyau97 <[email protected]> Co-authored-by: Ong Chung Yau <[email protected]> * Adds Mem0 Memory Node (FlowiseAI#4213) * Adds Mem0 Memory Node * fix: update pnpm-lock.yaml --------- Co-authored-by: Ong Chung Yau <[email protected]> Co-authored-by: chungyau97 <[email protected]> * Update README.md (FlowiseAI#4229) Use Chinese Simplified * Improve Error Messaging for Missing LLM Node Input Variables and Optimize Lodash Imports (FlowiseAI#4167) enhance input error logging * Add Detailed Streaming to the Tool Agent (FlowiseAI#4155) * Add Detailed Streaming to the Tool Agent * lint fix --------- Co-authored-by: Henry <[email protected]> * feat: Enterprise Github (FlowiseAI#4221) * [fix 4206]: fix the empty array return for getBaseClasses when using typeorm driver and not the PGVectorStore (FlowiseAI#4225) fix the empty array return for getBaseClasses when using typeorm driver and not the PGVectorStore Co-authored-by: Aman Agarwal <[email protected]> * feature/export-import-3 (FlowiseAI#4234) * fix: add ASSISTANT chatflow * feat: add mvp export import for chatMessage, chatFeedback, customTemplate, documentStore * feat: add function to handle duplicate ids during import * chore: typo 'orginalData' to 'originalData' * feat: add import conditions for chatMessage and chatMessageFeedback * feat: reduce spacing before saving chatflows * feat: Add Opik Tracer integration (FlowiseAI#4194) This update adds support for Opik tracer in Flowise. It includes new credential components, analytic nodes, and UI assets for both tracers. The changes enhance observability by allowing users to integrate Opik for better model monitoring, analysis and evaluation. * Feature/Add remove on age and count to bullmq (FlowiseAI#4249) add remove on age and count to bullmq * Bugfix/Prevent transforming double curly brackets (FlowiseAI#4252) prevent transforming double curly brackets * feat(Mem0): Add option to use Flowise Chat ID (FlowiseAI#4257) * feat(Mem0): Add option to use Flowise Chat ID * refactor(Mem0): Simplify prependMessages handling in getChatMessages * Bugfix - Validating IDs for all imports (FlowiseAI#4226) * Bugfix/Prevent duplicated metrics on prometheus and opentel (FlowiseAI#4269) prevent duplicated metrics on prometheus and opentel * feature/export-import-4 (FlowiseAI#4272) * feat: seperate assistant export-import into custom, openai and azure * chore: update assistant names in export data to maintain consistency * Update how credential data is saved in db when using aws secrets manager (FlowiseAI#4271) * Update how credential data is saved in db when using aws secrets manager * Run lint-fix and update env example * Add new Llama 4 model options to Groq (FlowiseAI#4278) Add new Groq model options to `groqChat` section in `models.json` * Add `meta-llama/llama-4-maverick-17b-128e-instruct` * Add `meta-llama/llama-4-scout-17b-16e-instruct` * Bugfix/Prevent empty user message when using STT (FlowiseAI#4280) prevent empty user message when using STT * Feat: Support Google Cloud Storage (FlowiseAI#4061) * support google cloud storage * update example and docs for supporting google cloud storage * recover the indent of pnpm-lock-yaml * populate the logs to google logging * normalize gcs storage paths --------- Co-authored-by: Ilango <[email protected]> Co-authored-by: Henry <[email protected]> * Support `getNumTokens` for ChatGoogleGenerativeAI (FlowiseAI#4149) * Support cache system instructs for Google GenAI (FlowiseAI#4148) * Support cache system instructs for Google GenAI * format code * Update FlowiseGoogleAICacheManager.ts --------- Co-authored-by: Henry Heng <[email protected]> * Fix(FlowiseChatGoogleGenerativeAI): Prevent "parts must not be empty" API error in Seq Agents (FlowiseAI#4292) * Fix(FlowiseChatGoogleGenerativeAI): Prevent "parts must not be empty" API error in Seq Agents * Fix: Update pnpm-lock.yaml to resolve CI issues * convert role function and tool to function * remove comment --------- Co-authored-by: Henry <[email protected]> * Fix(FlowiseChatGoogleGenerativeAI): 400 Bad Request errors from Gemini API when converting tool schemas - MCP tools. (FlowiseAI#4294) * fix: 400 Bad Request errors from Gemini API when converting tool schemas (MCP tools). * Update FlowiseChatGoogleGenerativeAI.ts --------- Co-authored-by: Henry Heng <[email protected]> * FIXED Document path error & simplified Chinese font is incorrect (FlowiseAI#4224) [fix] Document path error & simplified Chinese font is incorrect [fix] Document path error & simplified Chinese font is incorrect * Bugfix/vector store config not saving (FlowiseAI#4299) fix vector store config not saving * Update README (FlowiseAI#4297) * fix: Correct typos in Prompt Engineering Team.json (FlowiseAI#4286) fix: correct typos Co-authored-by: faisal rafiuddin <[email protected]> * feat(feedback): add validation for feedback creation and update (FlowiseAI#4260) * feat(feedback): add validation for feedback creation and update Introduced validation functions for feedback creation and update in the new validation service. Updated feedback controller to utilize these validation functions before processing requests. * refactor(feedback): update validation to return feedback object - Modified validateFeedbackExists to return the ChatMessageFeedback object instead of a boolean. - Updated validateFeedbackForUpdate to utilize the returned feedback object for setting default values. * add history chat timestamp in mongodb (FlowiseAI#4296) * feat: Add GPT-4.1 series models support (FlowiseAI#4305) * feat: add GPT-4.1 series models support to OpenAI Assistant Dialog * Update models.json --------- Co-authored-by: Henry Heng <[email protected]> * [FEATURE] Show time with date for last modified date for chatflow/agentflow/credentials/variables (FlowiseAI#4300) feat(ui): show time with date for last modified date for chatflow/agentflow/credentials/variables Co-authored-by: coolpengwing <[email protected]> * feat: add "Jira" document loader (FlowiseAI#4247) (FlowiseAI#4248) * feat: add "Jira" document loader (FlowiseAI#4247) * chore: Remove console.log * Update Jira.ts --------- Co-authored-by: Henry Heng <[email protected]> * Fix: Default vision model overriding custom model name for AWS Chat Bedrock. (FlowiseAI#4309) fix condition to not default to claude haiku when custom model name is provided * adding cost values to models.json file (FlowiseAI#4330) * updating cost values to models.json file * Update models.json --------- Co-authored-by: Henry Heng <[email protected]> * changes & fixes for various issues in chatflow config (FlowiseAI#4314) * Chatflow config - rate limit and override config were overwriting changes. * prevent post processing JS function from escaping as JSON... * non-streaming follow up prompts need to be escaped twice * prevent post processing JS function from escaping as JSON... * Adding file mimetypes for full file upload... * lint.. * fixing the issue with storing only filtered nodes.. * return doc store processing response without await when queue mode and request is from UI --------- Co-authored-by: Henry <[email protected]> * Adding cost metrics for mistral range of models (FlowiseAI#4338) * Feature: Upgrade MCP version and support SSE mode. (FlowiseAI#4329) Upgrade MCP version and support SSE mode. Co-authored-by: guwenjia <[email protected]> * Support custom base URL for ChatGoogleGenerativeAI (FlowiseAI#4347) feat: Support custom base URL for ChatGoogleGenerativeAI * Better Error reporting for document store operations. (FlowiseAI#4350) * Better Error reporting for document store operations. * Update packages/ui/src/ErrorBoundary.jsx Co-authored-by: Copilot <[email protected]> * Update index.ts --------- Co-authored-by: Copilot <[email protected]> Co-authored-by: Henry Heng <[email protected]> * feature: add additional parameters to Tavily API tool (FlowiseAI#4353) * feat: add additional parameters to Tavily API tool * update descirption * fix version * lint fix --------- Co-authored-by: Henry Heng <[email protected]> * Feature/Add Cheerio Web Scraper node (FlowiseAI#4337) * feat: add Free Web Scraper tool * fix: remove unused variable 'finalCount' * feat(tools): Add configurable timeout to handle edge scenarios * add sitemap mode and rename Cheerio Web Scraper node * refactor: simplify tool description for broader LLM compatibility * Release/2.2.8 (FlowiseAI#4354) [email protected] * added_o4mini_model (FlowiseAI#4365) * added_o4mini_model * fix: pnpm run lint-fix --------- Co-authored-by: Ong Chung Yau <[email protected]> * fix(nodes): Correct path and case sensitivity for Cheerio Web Scraper icon (FlowiseAI#4359) * fix Cheerio Web Scraper for online deployments * fix: change node name * fix: update correct label for InputLabel component (FlowiseAI#4371) * Feature/add enable bull dashboard env var (FlowiseAI#4373) add enable bull dashboard env var * feature/add-perplexity-node (FlowiseAI#4376) * added perplexity node * last stable release * Update ChatPerplexity.ts * update * Update ChatPerplexity.ts * Update ChatPerplexity.ts * pnpm lint fix * feat: update @langchain/community from 0.3.24 to 0.3.29 --------- Co-authored-by: Marvin <[email protected]> * Chore/Close mcp connection (FlowiseAI#4375) * close mcp connection * update file types * Feature/added litellm component (FlowiseAI#4327) * feat: add ChatLitellm component and LitellmApi credential * fix: lint errors * Update LLMFilterCompressionRetriever.ts --------- Co-authored-by: Henry Heng <[email protected]> * Updated the Groq chat node and also Llama Index Groq node. FlowiseAI#4383 (FlowiseAI#4384) * adding DeepSeekr1 distill to groq * Added max_tokens to groq.ts and chatGroqLlamaindex.ts plus updated groq models removing the outdated models and adding new models such as compound-beta * Patched OpenAI typo on ChatGroq_LLamaIndex.ts * Patching groq llamaindex * Patched pnpm lint error * Removed retundant image * Update ChatGroq_LlamaIndex.ts --------- Co-authored-by: Henry Heng <[email protected]> * Fix(PostgresRecordManager): Handle time correctly and ensure schema creation (FlowiseAI#4381) added pgvector check and time handling for postgresql record manager * fix/import-missing-chat-data (FlowiseAI#4401) fix: add missing imports for messages and feedbacks in AgentFlow and AssistantFlow * Feature/agentflow v2 (FlowiseAI#4298) * agent flow v2 * chat message background * conditon agent flow * add sticky note * update human input dynamic prompt * add HTTP node * add default tool icon * fix export duplicate agentflow v2 * add agentflow v2 marketplaces * refractor memoization, add iteration nodes * add agentflow v2 templates * add agentflow generator * add migration scripts for mysql, mariadb, posrgres and fix date filters for executions * update agentflow chat history config * fix get all flows error after deletion and rename * add previous nodes from parent node * update generator prompt * update run time state when using iteration nodes * prevent looping connection, prevent duplication of start node, add executeflow node, add nodes agentflow, chat history variable * update embed * convert form input to string * bump openai version * add react rewards * add prompt generator to prediction queue * add array schema to overrideconfig * UI touchup * update embedded chat version * fix node info dialog * update start node and loop default iteration * update UI fixes for agentflow v2 * fix async drop down * add export import to agentflowsv2, executions, fix UI bugs * add default empty object to flowlisttable * add ability to share trace link publicly, allow MCP tool use for Agent and Assistant * add runtime message length to variable, display conditions on UI * fix array validation * add ability to add knowledge from vector store and embeddings for agent * add agent tool require human input * add ephemeral memory to start node * update agent flow node to show vs and embeddings icons * feat: add import chat data functionality for AgentFlowV2 * feat: set chatMessage.executionId to null if not found in import JSON file or database * fix: MariaDB execution migration script to utf8mb4_unicode_520_ci --------- Co-authored-by: Ong Chung Yau <[email protected]> Co-authored-by: chungyau97 <[email protected]> * Update README.md * Bugfix/Update agentflow v2 events to redis subscriber (FlowiseAI#4415) update agentflow v2 events to redis subscriber * Chore/update i18n readme (FlowiseAI#4418) * update i18n readme * update server README * Feature/add Deep Research V2 Template (FlowiseAI#4422) add new V2 template * Bugfix/ui streaming when model streaming is off (FlowiseAI#4424) fix ui streaming when model streaming is off * Fix: Add keep-alive options to Redis clients to prevent idle timeouts and socket closing. (FlowiseAI#4377) * redis keepalive mechanism for all redis * removed offline queue commands * Simplified changes for consistency. Added REDIS_KEEP_ALIVE env variable. * update redis socket alive env variable * lint fix --------- Co-authored-by: Henry <[email protected]> Co-authored-by: Henry Heng <[email protected]> * Bugfix/Update file loader (FlowiseAI#4420) * update file loader * delete temp for o1 * fix tavily * bugfix: fix the presentation of the source (FlowiseAI#4400) fix: add case to source handler * update fav icons * Chore/disable telemetry by default (FlowiseAI#4427) disable telemetry by default * Release/3.0.0 (FlowiseAI#4425) [email protected] * Bugfix/pass execute custom function to worker (FlowiseAI#4432) pass execute custom function to worker * Bugfix/execute custom function to worker (FlowiseAI#4440) * pass execute custom function to worker * update execute function * Feature/add remove button to edge (FlowiseAI#4444) add remove button to edge * bugfix: change field to be optional (FlowiseAI#4446) fix: make customModelName field as optional * Bugfix/correctly retrieve past images in agentflowv2 (FlowiseAI#4453) correctly retrieve past images in agentflowv2 * Bugfix/throw error on agent tool call error (FlowiseAI#4464) throw error on agent tool call error * Bugfix/add missing imports (FlowiseAI#4476) add missing imports * Chore/Claude 4 (FlowiseAI#4488) * add gemini flash * add gemin flash to vertex * add gemin-1.5-flash-preview to vertex * add azure gpt 4o * add claude 3.5 sonnet * add mistral nemo * add groq llama3.1 * add gpt4o-mini to azure * o1 mini * add groq llama 3.2 * update anthropic models * add 3.5 haiku * update vertex embedding models * add azure o1 models * add o3 mini * add wolframalpha tool * Update pnpm-lock.yaml * add claude sonnet 3.7 to vertex and bedrock * Update pnpm-lock.yaml * Chore/Gemini 2.5 Flash (FlowiseAI#4489) * add gemini flash * add gemin flash to vertex * add gemin-1.5-flash-preview to vertex * add azure gpt 4o * add claude 3.5 sonnet * add mistral nemo * add groq llama3.1 * add gpt4o-mini to azure * o1 mini * add groq llama 3.2 * update anthropic models * add 3.5 haiku * update vertex embedding models * add azure o1 models * add o3 mini * add wolframalpha tool * Update pnpm-lock.yaml * add claude sonnet 3.7 to vertex and bedrock * Update pnpm-lock.yaml * update gemini * feat: add user and organization tracking to node data interface and executions menu * chore: update dependencies for v3.0.3 compatibility * fix: update TypeScript configs and core interfaces for v3.0.3 compatibility * fix: update node components for enhanced agent flow and compatibility * fix: update server controllers and services for v3.0.3 compatibility * fix: update UI components and navigation for improved user experience * feat: update sidekick studio pages for enhanced functionality * docs: update API documentation and OpenAPI specs for v3.0.3 * feat: add user and organization tracking to executions * docs: add git phased commit process rule to prevent interactive command mistakes * docs: add development rules for flowise resource patterns and git commit process * fix: correct user parameter passing in agent flow execution * fix: update marketplace page import paths from MarketplaceLanding to index * fix: update remaining marketplace page imports to use correct index path * feat: refactor marketplace canvas to use location state and improve navigation handling * feat: add marketplace to member actions and update icon in AppDrawer * added pages for the assistants and fixed marketplace bug * saving user with assistants * added seed script * fix: duplicate chatflow visibility issue * agent flows docs * updated gitignore * udpated gitignore * upated the homepage * normalize the jira creds to flowise version * fix: prevent event propagation in sidekick clone button to fix incorrect redirect * fix: AAI-352 Fix document store loader deletion by using correct file.id parameter * feat: improve image handling in Message component - Add responsive image sizing - Update image layout properties - Remove direct link wrapper * feat: enhance markdown image rendering - Add download link for images - Improve image container styling - Add download icon * feat: remove AnswerAI and Marketplace visibility options * Update lockfile * fix: resolve ItemCard merge conflicts after staging integration * feat: enhance markdown image component with Next.js optimization and fallbacks * remove commented AnswerAI and Marketplace visibility options * remove comment * feat: enhance Google Drive document loader with improved file handling * feat: improve Google Drive picker UI and canvas node handling * fix: enhance credentials service and generic helpers for Google Drive integration * fix: address PR review feedback for Google Drive improvements - Remove Spanish console logs from token refresh - Add IGoogleDriveFile interface for better type safety - Move SUPPORTED_MIME_TYPES to shared constants file - Add JSDoc comments to custom React hooks These changes improve code quality and maintainability without affecting functionality. * fix: correct chatflow name handling in duplication feature - Fix CanvasHeader.jsx to use chatflow.name instead of flowData.name when duplicating - Improve fallback logic in canvas/index.jsx for more robust name handling - Ensure duplicated chatflows get proper 'Copy of [original name]' naming Fixes issue where duplicated chatflows would get incorrect names due to attempting to read name from flowData instead of chatflow object. * fix: improve error handling and add missing fields in export flow data function --------- Co-authored-by: Asharib Ali <[email protected]> Co-authored-by: Henry Heng <[email protected]> Co-authored-by: Daniel D'Abate <[email protected]> Co-authored-by: Michael Young <[email protected]> Co-authored-by: Gene Ruebsamen <[email protected]> Co-authored-by: Egor Kopylov <[email protected]> Co-authored-by: Sarge Joseph <[email protected]> Co-authored-by: Saqib Ahmed <[email protected]> Co-authored-by: Ilango <[email protected]> Co-authored-by: chungyau97 <[email protected]> Co-authored-by: Ong Chung Yau <[email protected]> Co-authored-by: Saket Aryan <[email protected]> Co-authored-by: Acaibrid <[email protected]> Co-authored-by: jonSuits <[email protected]> Co-authored-by: Henry <[email protected]> Co-authored-by: Michael Vonrueden <[email protected]> Co-authored-by: Aman Agarwal <[email protected]> Co-authored-by: Aman Agarwal <[email protected]> Co-authored-by: Boris Feld <[email protected]> Co-authored-by: toi500 <[email protected]> Co-authored-by: Vinod Kiran <[email protected]> Co-authored-by: Sunny Modi <[email protected]> Co-authored-by: allen <[email protected]> Co-authored-by: Ilango <[email protected]> Co-authored-by: Hans <[email protected]> Co-authored-by: Miico <[email protected]> Co-authored-by: Carson Yang <[email protected]> Co-authored-by: faisal.rafi <[email protected]> Co-authored-by: faisal rafiuddin <[email protected]> Co-authored-by: Mehdi <[email protected]> Co-authored-by: Arif Romadhan <[email protected]> Co-authored-by: Zubair Khalid <[email protected]> Co-authored-by: coolpengwing <[email protected]> Co-authored-by: Shibin Das <[email protected]> Co-authored-by: Nick Wong <[email protected]> Co-authored-by: Zero Gu <[email protected]> Co-authored-by: guwenjia <[email protected]> Co-authored-by: Copilot <[email protected]> Co-authored-by: May Ramati Kroitero <[email protected]> Co-authored-by: Aditya Addanki <[email protected]> Co-authored-by: Anoop P <[email protected]> Co-authored-by: Marvin <[email protected]> Co-authored-by: patrickreinan <[email protected]> Co-authored-by: Adolfo Usier <[email protected]> Co-authored-by: nikitas-novatix <[email protected]> Co-authored-by: k-santos <[email protected]> Co-authored-by: Brad Taylor <[email protected]> Co-authored-by: Aalishan Jami <[email protected]> Co-authored-by: Diego Costa <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Also accounts for existing users using AWS Secrets Manager to store credentials data.