Not on my first playthroughs and only if say I'm doing a challenge (say a monotype run on HGSS) or just really want to try different Pokemon than the starters and need to remove something to make it fit in the team.
This was my Pearl/Platinum in the beginning:
-Received Starter
-Caught a Startly
-Starter goes in box never to be touched again.