Let's all stop talking past each other and face up to the contradiction.What song do you refer to?
The main issue (for me) is with what is included and what isn't, and who made those decisions. I think the process is corruptible, so I look at The Bible with some pause.
Putting that aside though, there is also the question of how to interpret the words. I've thought for a long time that literal interpretations of The Bible (for example when it comes to creation) are not compatible with science, from evolution to cosmology. So, when The Bible is quoted, the text and the interpretation are both 'in question' for me. This is especially true when I consider how ungodly many Christians can be, how giddy and ready they seem to be to tell others they will burn in hell, how this has been repeatedly twisted to control and extract profits from people. A super important example involves Martin Luther and the question of indulgences.
I think the main trait of a Christian is a love for Jesus and His message, which I have always thought to be one centered on empathy and love for others, 'love thy neighbor as thyself', so I call myself a Christian. Before finding genuine faith in God, I thought a lot about (I still do) the role and purpose of animal and human suffering in the world, and it was in this line of thinking that I eventually managed to find genuine faith that God exists.
In this thread I feel I can relate to both sides a lot, and I think ideally the believers should try to encourage and be understanding of a respectful critique or question from a nonbeliever, since it often stems from a good place. But we are all so ready to get defensive, I think we end up talking past each other most of the time.