You can definitely go overboard. I usually re-read a story because I often catch typos or missing words after publishing. But once it is typo free, it is probably best to just leave it alone and concentrate on writing, new, better stories.