No, he should not be one of them, if they're all that bad. Though perhaps if Varric is among them, they're not evil. Maybe misunderstood, like any of the mages from their world.

"I'm not fond of the idea of taking up arms in a war I don't fully understand. What will you do? Stay here?"