If you don't give it to him, he may mobilize and do something with his life.
This is one of the main reasons I don't like to give to beggars.
I think we should still be kind to people who are struggling, but there are more ways to assist than just giving them your money.