I wonder if its the direction of the side mic. see if its Clean do not put anything in to clean it. and if its being blocked.
Since my original post I have not been able to repeat the issue and have been using the GoPro in exactly the same manner. Fingers are crossed.