Well if I'm understanding your question correctly, chalk pastels usually are extremely broad so you're not going to get the same amount of detail as you do drawing anime with a pencil. Not only that, but pastels have a different feel in your hand, which kind of eliminates the muscle memory you have for drawing.