Yes, you need to keep your Spellfire tailoring specialisation to wear the Spellfire set.
However, you can wear the Spellstrike Pants and Spellstrike Hood whichever specialistion you choose tho you need at least 350 in tailoring to get the set bonus.
Lots of people get the Spellfire and Spellstrike stuff mixed up. Hope this helps.