Agreed.
Religion basicaly says that one should act a certain way because a particular deity wants you to and will punish you if you don't.
The ethical standpoint of morality basicaly says that one should avoid causing suffering to others. There are several reasons for this, one is remorse, causing the suffering of others can lead you to experience uncomfortable emotional responses. Another is that of revenge/reciprocation, if you cause another to suffer, he/she, or others, may in turn wish to cause you to suffer.
Interestingly, one thing that is almost universal in religion is the 'Golden Rule', which is based upon reciprocation and in it's basic form states that you should treat others as you wish to be treated yourself.
Ancient Egyptian religion.
"Now this is the command: Do to the doer to cause that he do thus to you." (From the story of 'The Eloquent Peasant', estimated time of writing 2040–1650 BC)
Hinduism
"Let no man do to another that which would be repugnant to himself." (Mahabharata, bk. 5, ch. 49, v. 57. estimated writing 1400 BC)
Judaism
"Love your neighbor as yourself" (Torah, Leviticus 19:18. estimated writing 1240 BC)
Confucianism
"Do not impose on others what you do not desire others to impose upon you." (Analects XV.24. estimated writing 500 BC)
Buddhism
"Putting oneself in the place of another, one should not kill nor cause another to kill." (Dhammapada 10. estimated writing 480 BC)
Christianity
"Therefore all things whatsoever ye would that men should do to you, do ye even so to them" (Matthew 7:12. estimated writing 30 AD)
Islam
"That which you want for yourself, seek for mankind." (Sukhanan-i-Muhammad, 63. estimated writing 630 AD)
Bahá'í Faith
"And if thine eyes be turned towards justice, choose thou for thy neighbour that which thou choosest for thyself." (The Hidden Words of Bahá'u'lláh – Part II, 19th century)
The Golden Rule is one thing that religion got right. It's a formula for universal peace that's elegant in it's simplicity, if everyone followed it, there would be no crime, no abuse and no wars, but one doesn't
need religion in order to learn this very simple lesson. Many ancient philosophers came to exactly the same conclusion without turning to religion.
"Do not do to your neighbor what you would take ill from him." – Pittacus
"Avoid doing what you would blame others for doing." – Thales
"What you do not want to happen to you, do not do it yourself either. " – Sextus the Pythagorean
"Do not do to others what would anger you if done to you by others." – Isocrates
"Expect from others what you did to them" - Seneca.