Each previous character has 5 pieces of clothing to give. One for the first meeting, one for your birthday (the one in the in-game profile, not the one in the DS menu), one for a DLC quest, one for being a certain vocation, and the last for having a fully expanded inn, meaning you've met 30 people in Tag mode.
So yeah, only one piece needs that.