Did Jesus Tell Us to Give to Every Panhandler?

Jesus tells us to give to those who ask, but Paul warns the church against giving to the lazy. How might we apply these teachings when we meet a panhandler?