Profile memory usage requirements of RPC and archival nodes in stateless validation about nearcore HOT 1 OPEN

@tayfunelmas

I tried to design a way how to estimate the requirements, but there are too many unknowns.
Let's have a look at the existing requirements
https://near-nodes.io/rpc/hardware-rpc
Is it for mainnet? For testnet? What's about localnet? What if I have localnet 10 times more congested than mainnet?
What if I want to make millions of queries per second? Will it change the requirements?

Instruction says that recommended configuration is 8 cores, 20 GB RAM. The minimum is 8 cores, 12 GB RAM.
TBH, I find these numbers useless.
For tiny localnet, 1 core and 4 GB RAM would be more than enough.

Let's assume it's for mainnet, and let's look at the use cases.
In reality, Pagoda runs each mainnet regular node on 32 vCPU and 128 GB memory.
I know that some of our partners run even beefier machines.
Should we update the recommended configuration with these numbers? Why don't we use the recommended configuration?

I can suggest 2 options:

1. Redesign this doc from 0, suggesting different configurations for different use cases
2. Leave everything as it is and bump the numbers if the users will complain

I personally vote for the second option, because otherwise we should update the doc each time we have yet another network congestion

If we decide to redesign the doc from 0, we need to start from defining audience for this doc. It's now unclear for me, who we're trying to help.

from nearcore.