I was level 5 in my neutral run (and I had help from tem armor!!), maybe that's why I didn't find it too hard. :P Mage also told me Asgore was really tough, but I didn't have problems with him either.
I did love that part when the souls turned on him though. Also when I realized that all the items I had picked up belonged to the other children - that was a nice touch.