A simple methodology is presented for modeling time variation in volatilities and other higher-order moments using a recursive updating scheme similar to the familiar RiskMetricsTM approach. We update parameters using the score of the forecasting distribution. This allows the parameter dynamics to adapt automatically to any nonnormal data features and robusties the subsequent estimates. The new approach nests several of the earlier extensions to the exponentially weighted moving average (EWMA) scheme. In addition, it can easily be extended to higher dimensions and alternative forecasting distributions. The method is applied to Value-at-Risk forecasting with (skewed) Student's t distributions and a time-varying degrees of freedom and/or skewness parameter. We show that the new method is competitive to or better than earlier methods in forecasting volatility of individual stock returns and exchange rate returns.