Filler isn't good! Minimalism is key to writing good stories, minimalist yet efficient. You don't want too much prose but you don't want things left plain and bland. A good balance usually yields good story-telling!
It's difficult to help without any examples, maybe provide a paragraph or two of your writing so we can better assist you? c: