Where? Is he in certain places. Or is he in any place where a usual Gyarados is?
The easiest way is probably to use the Old Rod and wait until a shiny Magikarp appears.
Trading is also an option, and probably much easier, but catching a shiny yourself is always better! <--- I'm starting to sound... weird... =))