Credit cards are not a victimless crime. It can take months of stress and heartache for the unlucky person as well as harm their credit report. Not everyone has the time/resources to deal with it correctly and some customer support is better than others. It is a pain in the ass and certainly not something to feel good about doing.
I wouldn't card because of moral reasons. Also, you're in a whole different hot seat if you're caught carding and there's a lot more drive to catch carders than more ambiguous activities like refunding and SEing.