I had not done that task but from surfing around EQ sites on the net, I see people saying that if the person who got the task leaves the area by the "Statue Of Eternity" the Fanatics may poof and you get a message saying so, and also that your mission has failed. Some say the rest of the group should fight them at the nearby bridge but the task getter always stays near the Statue. Also, they say that if you unequip the Baton or Skull it will also cause the mission to fail.
I have an alternative walkthrough linked that you could check out:
https://naroggsplace.wordpress.com/eq-handmaiden/ And EQ resources walkthrough:http://tbm.eqresource.com/thehandmaiden.php
Good luck and hope it helps.
Edited, Mar 14th 2016 5:25pm by hexeez