You are correct, buying a used one will be a gamble. Especially if it has some miles on it and was neglected. Very few have been problem free, there's no arguing it.
I felt the same way for years about the 6.0 and I avoided the idea of owning one completely.
I aquired a nice one due to a client owing me money. I ended up keeping the truck rather then selling it as we needed the truck more then the cash at the time.
We've experienced most of the typical 6.0 issues ourselves. Fortunately the issues very rarely result in a catastrophic failure, unlike the 6.4.
Once a guy learns the details and gains an understanding of why and how they fail and how to prevent the issues they usually change their mind.