How does the Commit Queue Scale?

[eric.gu]

Does the commite queue use 1 worker or many worker processes as well as if any benchmarks have been done on load testing?

Given # of CPUs and Memory, can the commit queue scale? 100 concurrent I/O threads or maybe even 1000 - 5000 concurrent requests.

Any thoughts?

We have a similar northbound setup as below:

https://doordash.engineering/2021/01/19/scaling-efficienc-of-a-python-service-with-gevent/

[Alexander Stevenson · Accepted solution]

Hi @eric.gu,

The following discussion is a couple of years old but gives some statistics which may help to serve as a baseline:

NSO memory usage and scaling

"There is a rough estimate floating around that says:

100 devices, 5000 services = 32 GB RAM 4vCPU

5000 devices, 20000 services = 64 GB RAM 6vCPU

20000 devices, 150000 services = 96 GB RAM 8vCPU

It is an old estimate so take it with a grain of salt as NSO went through considerable changes since then."   -  uavsec001