I haven't swam in a good few years. I don't even have a bathing suit anymore. While the actual swimming/being in the water part is fun, and I enjoyed swimming as a kid, everything else really isn't, and nowadays I find it not to be worth it anymore.
I don't like being in a swimsuit because I have to look at the skin on my legs (which is also why I don't wear shorts at all, either). I don't like being cold getting out of a pool, and chlorine dries out my skin horribly and makes it uncomfortable.