I had to look up the changes from normal to challenge mode. The only differences are an increase in level (5 at most) and an additional Pokemon on Gym Leaders and Elite Four. More grinding =! more difficult, as such I'd probably do it once and then stick to assist or normal for farming events/legendaries to rng and get through the game faster.
I would be all over this if the puzzles and such were more difficult, though.