Micro-benchmark Results for version 2.0

[Christoph-Denzel]

Hello, I just wanted to note that this is a non-issue.
I just did not know where else to put it, since there is no discussion tab.

In the paper from 2014, there was a reported maximum throughput of roughly 80,000 requests for a 0/0 micro-benchmark.
I did some performance tests on more powerful machines and a fast network, but in general, the performance was worse than reported.
I did achieve roughly 40 to 50k requests per second.
The difference, I think, is latency, where even for a single client, it takes 4ms to receive an answer, even after some warm-up time.
This is a lot higher than the reported 1ms from back then.
The round-trip time for the network is 0.2 - 0.3ms using ICMP pings.

As far as I understand, the biggest difference is the use of TLS for replica communication and signatures for client communication.
Has something else changed since then that could have impacted performance?

Did you make any new measurements with version 2.0, and if so, could you report them?

Thanks in advance :)

[rvassantlal]

Hello,

Can you let me know how many clients you experimented with?

The last measurements that I have are for f=1 and requests 1024/0. I got throughput around 16.5k req/s, which is consistent with the paper.

I will run some tests for 0/0 and get back to you.

[Christoph-Denzel]

Thanks,

these are my results for 0/0 and 4kb/4kb.

I couldn't get more clients to work, since the system detected replay leader attacks or threw other errors and got stuck by repeating this message.
-- Last regency: 0, next regency: 1
-- Re-transmitting STOP message to install regency 1

I already increased the system.totalordermulticast.timeout to 60000.
Fair batching is used, if that makes a difference.