Do not follow too close! Every so often he will stop and throw out some kind of Detection spell, and if you are within it's radius you are busted!