If prayer is to be defined as talking with God, perhaps some don't spend that much time in what would be considered formalized prayer rather than simply contemplating about God because God doesn't really reply back all that much directly.