I'm kind of mixed when it comes to caves. On one hand, there's something genuinely exciting about them. There are so many paths to explore, and every unnecessary step taken is sort of a risk since you only have so many items going in and you're bound to encounter a lot of wild Pokémon (and a surprising number of trainers.) Most importantly, though, due to all of the branching paths and similar decorative set pieces, you never really know how far you actually are into a cave until you come out the other end.
On the other hand, exploring caves can be really annoying and stressful for all of the same reasons. All of the trainer battles inside caves will slowly chip away at your health and your healing items, and I'm always afraid to use an escape rope when I consider that I could be almost all the way through.
What's worse is that almost every time I went into a cave, I ran into a trainer with Sawk, which for some reason was the one Pokémon that could completely mess up my team.