Mangers get 1 challenge in the first 6 innings; 2 from the 7th inning on. You get your challenge back if you are successful and the play is overturned. It's only supposed to take less than 2 minutes. The average argument is longer than that. It might actually speed up the game a little.

Though it might not be as fun with fewer arguments.