Hair restoration surgery needs the hands of an artist to optimal results.
While asymmetry on a tiny patch in hairline will not affect the final looks; perhaps it may complement the natural pattern of hairline.
However, on the other hand, if the asymmetry is significant the flaw will be visible. Such a significant change in orientation of hairline gives unnatural appearance too.
Solution: I believe a good hair restoration surgeon can help you by redistributing the grafts evenly with appropriate angle and direction.