The game is made to be played with x-factors and there are certain animations that only activates with x-factors (like wrist shots), that are in my opinion even more important then the perks themself.
Playing without perks feels actually well balanced and you cant win games by only spamming backhand beauties, but I have to be afraid that it will affect too much to the style of play.
It can make game even more dependent about fast breaks and broken play situations then it is already. Just waiting in front of your goalie and making it impossible to pass to middle is going to be pretty common playstyle then. Of course good players find a way and skill cap still matters. But does it make playing more boring in long sight?
For me I would like to find something in between, like only using golden x-factors. I think they dont affect and boost too much to the players stats but still gives you the animations to shooting or poke checking! In my opinion it would kinda give the best out of both sides of the table. No advantige for only relying on x-factors.