I ditched mine as soon as I caught something else. I think it was harder (especially since you're really skimped for choice outside of Riolu until you get to Virbank) but more rewarding. The main problem is the lack of good water-types available pre-E4. I don't think you can find the Water Stone until really late in the game, which basically leaves you with Azumarill and Jellicent (and the Water starter) as your only usable options.
I know what you mean, though. All the starters in this gen really start to fall behind near the end of the game. My Samurott in White was really only an HM Slave with Megahorn at the end.
If I were to restart my game, I'd do it again. It's a lot harder in the beginning of the game, though.