Nope! Not really. One hit with the axe kills you just the same as one hit with a bat. The only advantage of the axe is that it can kill 2 walkers (or equivalent) with one hit!

I've not tasted Fey meat, so couldn't really comment on that. Perhaps you will get the chance to tell us! LOL