Agree with comments so far. I see Jigsaw and Riddler as near enough cancelling each other out, so it'll come to Joker or Hannibal to sway the fight.
Now Hannibal is an expert on crazy and a genius in his own right, but I don't think he could manage the sheer level of lunacy that Joker would bring to the fight. Joker is smart, and far too unpredictable for Hannibal to properly diagnose and figure out.
And finally, the Batman team have the financial and physical advantage which helps as well.