It doesn't matter what else you adopt -- if you don't deal in PayPal you're going to lose 50-60% of the sellers (unscientific but in my opinion, at a bare minimum, a simple majority.) To deal with the ones who are left you will need eleventy different payment processors, because most of them will either be "PayPal or X" or "PayPal or Y" and not take whatever you're using.
I hate -- have always hated -- PayPal, and feel I have pretty good reasons. Same with GoDaddy. I use both because I'd rather make money on domains now, and fritter around trying to convince people to use other service providers in my spare time.
Frank