And what ISP will give you a connection with terabits in upload speed?
Probably you’re thinking about placing the machine in a data center, I’m not familiar with that.
However with that price I wouldn’t say that “it’s nothing”. Even just the hardware, where I live it’s the price of a house, and people barely afford it even with a loan.
It’s probably not much to well running companies, but here we are speaking about individuals and relatively smaller groups, ran by donations and not for profit.
And the main bottleneck there is, is it really the RAM? How? Are they not touching storage and keeping everything in a ramdisk?
Yeah, video streaming can’t really be run on donations like Lemmy, that’s true.
I think the presentation discusses it, but basically, if you have 20+ ssds in your server, trying to read them all and process the file system will mean you’re copying around too much data at once in your ram. A 1gb file might require like 5-10gb of data traffic in ram while the CPU is processing it due to copies and checks, etc. Ram can’t handle the resulting 10tbps of ram bandwidth needed. The optimization that Netflix is doing is to use pcie to send files directly over the pcie bus from the ssd to the network cards, skipping the cpu and ram altogether.
And what ISP will give you a connection with terabits in upload speed?
Probably you’re thinking about placing the machine in a data center, I’m not familiar with that.
However with that price I wouldn’t say that “it’s nothing”. Even just the hardware, where I live it’s the price of a house, and people barely afford it even with a loan.
It’s probably not much to well running companies, but here we are speaking about individuals and relatively smaller groups, ran by donations and not for profit.
And the main bottleneck there is, is it really the RAM? How? Are they not touching storage and keeping everything in a ramdisk?
Yeah, video streaming can’t really be run on donations like Lemmy, that’s true.
I think the presentation discusses it, but basically, if you have 20+ ssds in your server, trying to read them all and process the file system will mean you’re copying around too much data at once in your ram. A 1gb file might require like 5-10gb of data traffic in ram while the CPU is processing it due to copies and checks, etc. Ram can’t handle the resulting 10tbps of ram bandwidth needed. The optimization that Netflix is doing is to use pcie to send files directly over the pcie bus from the ssd to the network cards, skipping the cpu and ram altogether.