An entertaining, end-to-end game could have gone either way, but striker Liam Shotton gave Grove a 36th-minute lead and then made the points safe by rounding the keeper to score again in the last minute.
The victory leaves Kidsgrove three points behind once runaway leaders Barwell, who have two games in hand.