Skip to content

Any plans to update this example for Jetstream? #142

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gwollman opened this issue Apr 5, 2025 · 0 comments
Open

Any plans to update this example for Jetstream? #142

gwollman opened this issue Apr 5, 2025 · 0 comments

Comments

@gwollman
Copy link

gwollman commented Apr 5, 2025

I find that the example code, at least running on my cloud, is unable to keep up with the firehose. There is not a network issue -- 30 Mbit/s is not enough for me to even notice (I run the network). I see that the node process has pegged the CPU, and the generator's subscription processing is running about 24h behind real time. The generator is able to process about 450 events per second by my measurements (most of which, of course, will be ignored -- I already modified the code to reduce the amount of garbage generated for like and follow events, which the generator doesn't examine). It would seem that using the recently introduced Jetstream would greatly reduce the amount of wasted processing performed in the underlying subscription processing, and might allow my poor cloud VM to actually perform the real-time service it was intended to. I suspect that many people who are starting from this example code are in a similar situation, banging their head against the wall because it doesn't appear to work, when in fact it's just getting more and more backlogged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant