I'm ***uming your using the shape tool (I think I remember seeing a line there!) I think that if you rasterize it...it goes away. I always just use the eliptical marquee and hold down the shift button to make a perfect circle. Much easier!