After an opening 15 minutes which followed much the same pattern as Saturday's game - the Glassboys largely on top but unable to create clear openings - it was Kyle Haynes who settled the nerves with a low finish under the Blaby keeper at the near post, having been set up by a clever pass from Ben Billingham.
And Billingham himself doubled the advantage on 31 minutes. Matt Wood, starting for the first time since his pre-season injury, held off a defender in the penalty area and laid the ball off for Billingham to clip it into the net from 10 yards.
Stourbridge survived a scare just before the interval when a through ball seemed to have put Stuart Verrall in the clear but Will Richards got back to block his shot on goal.
A five-minute spell early in the second half looked to put the result beyond any doubt. First Blaby's centre-back, Ross Lavin clattered into Billingham to earn a straight red card, and then Louis Harris slid the ball through to an unmarked Kayelden Brown who took his time to pick his spot low into the corner of the net.
However, the Glassboys lost their way somewhat for a spell and Verrall capitalised on a mistake from Knight after 66 minutes to beat Dean Coleman and reduce the arrears, and Blaby went on to force a number of corners as Stourbridge briefly looked rattled.
But Jordan Fitzpatrick sealed victory on 76 minutes with the best goal of the night, volleying home Brown's knock-down from 20 yards after Drew Canavan had won the ball back tenaciously in midfield.