Does My Sexual Past Disqualify Me from Pastoring?

If a man has a history of fornication, is he disqualified from the office of pastor — or can he still be considered “the husband of one wife”?