Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async Memory Client Support for self-hosted #2495

Open
hayescode opened this issue Apr 2, 2025 · 2 comments
Open

Async Memory Client Support for self-hosted #2495

hayescode opened this issue Apr 2, 2025 · 2 comments

Comments

@hayescode
Copy link

🚀 The feature

I use Azure AI Search for mem0 and it's working great, however the mem0.memory.Memory client is syncronous and is blocking my flow adding latency. It seems the AsyncMemroyClient is only for the hosted version which I cannot use at my company. Azure AI Search can be async and I could make a PR to add it but there would need to be an AsyncMemory class in mem0.memory.main.py to use this. This situation seems like a common use case so I'm wondering if it's planned or there is some other reason it does not already exist?

Motivation, pitch

Async is critical for high concurrency and scalability. There should be an option to choose Sync/Async for self-hosted memory.

@deshraj
Copy link
Collaborator

deshraj commented Apr 2, 2025

Thanks for the feature request @hayescode. The team is already working on this and we plan to release it really soon.

cc @Dev-Khant

@hayescode
Copy link
Author

Awesome thank you! Looking forward to it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants