Well yeah, kinda.
You know how them other people captured Erza and asked why she betrayed him? I'm guessing Jeral just told them that so to trick them, since he said he would tell them everything about Zeref as well. Furthermore, Zeref needs hatred, so perhaps it's their hatred of Erza that allows them to use ~magic~