nah, they successfully colonized all along the coast of middle earth from the northwest to harad. caused untold ecological damage too. abused the natives.

their numbers were never very great, so the populations of the realms they ended up ruling after the fall of numenor were mostly non-numenorean everywhere. there were pockets of numenoreans here and there (around lake evendim, around minas tirith, in ithilien before it was overrun, in belfalas and around umbar at least).