Guessing router has 4 network ports on it. Plug a cable into each one and into each put on the wall.

Plug something in the plug in each room.

Certainly looks like it, though it’s a pity they aren’t labeled. If the router doesn’t have 4 open ports, you’ll need a decent switch. Most can mount to a wall, so it should still be a nice clean install.