The Glassboys drew first blood after just 5 minutes when Kayelden Brown capitalised on a poor defensive header and deftly flicked a left-foot shot into the far corner, but there were few other clear chances in a first half which gave little clue as to the mayhem to come.
With only 4 minutes played after the break, Jordan Fitzpatrick doubled the lead, picking his spot calmly from 8 yards after Ben Billingham had teed him up.
However, Ilkeston were back in the game on 66 minutes as Kane Richards somehow squeezed his shot home despite the attention of Dean Coleman and Drew Canavan, only for Leon Broadhurst to make it 3-1 four minutes later, heading home from close range after Brown had headed Billingham's corner back across goal.
Ilkeston refused to lie down, however, and Richards capped a fine move with a shot beyond Coleman to cut the deficit in half ten minutes from time, and a clumsy challenge from Will Richards on Chey Adams in the 88th minute left Rob Duffy with the chance he didn't waste to level from the spot.
A draw might have been a fair result, but in the first minute of stoppage time, substitute Chris Knight worked an opening on the edge of the area and fired into the bottom corner to seal the points.
Ilkeston can consider themselves a little unlucky, but it is Stourbridge who surge to the top of the table, at least for 24 hours.