Modulating the temporal dynamics of nonlinear ultrafast plasmon resonances