It wont affect the deer in my opinion because the deer are used to hearing turkeys all the time,espessially around here.Just last weekend I had 4 deer and 8 turkeys in the same field in front of me.The hens were clucking away and the deer went abou there business.
Also, I have called turkeys while bowhunting and still had deer walk by shortly later. Go for it and GOOD LUCK