Ad Hominem is only a fallacy when the speaker's personal qualities are irrelevant to the topic at hand. When one man has unilateral control over a project, you have to consider it as an extension of their personality.