Back in GS times, my mother thought i was addicted because i was playing Pokemon more than the 30 minutes per day i was allowed, so she sold all my Pokemon Games, but no one wanted to buy my gameboy pocket, so i got it back, but without games. Maybe two years later, i saw some Pokemon games in some local store when i wanted to buy me a new pencil (or whatever) there, i bought me new Yellow, Gold and Silver versions there. Sadly, all of them were faked, but at least they were playable. In the next years i was playing Pokemon again quite often - until my Gameboy Pocket broke, which was some days before the DP release. So maybe just a weak later, i had a DS and a Pearl version, which i played for some month and then let it dust on the shelf. After maybe about a year without Pokemon later, i got back to it again some months ago, and still playing it.
So i short, yes, i had quite a lot of times when i didn't play Pokemon.