I had that too! Strangely enough it disappeared after a few days.
I recall having this issue whenever I screwed with the zoom settings in Chrome and Firefox. Restoring the zoom back to default SHOULD make the arrows go away, but I'm not entirely sure.