Panhandling in public places is protected speech in the US. To ban panhandling would be to ban expression based on its content. That's never a good idea, no matter how uncomfortable that expression of views makes us feel.