While true, I would add that a big reason is that freight is prioritised by rail companies, causing large and frequent delays for passengers. Amtrak owns some of its own rail, mostly in the northeast, which is perhaps less-than-coincidentally the part of the US that has the most people taking trains.