> ## Documentation Index
> Fetch the complete documentation index at: https://docs.fincept.in/llms.txt
> Use this file to discover all available pages before exploring further.

# Forecast evaluation

> Score forecasts against actuals: MAE, RMSE, MAPE, sMAPE, WAPE, MASE, RMSSE, bias, quantile and multi-quantile losses, CRPS, interval coverage, Winkler score and calibration, per series, window or aggregated (weighted); Pareto-optimal models; errors by step ahead; residual rectification.

Toolset `forecast_evaluation`: 2 tools.

| Tool | What it does | Notes |
| - | - | - |
| `forecast_evaluate` | Scores model forecasts against actuals with any of 25 metrics: point (MAE, MSE, RMSE, MAPE, sMAPE, WAPE, ND, bias, cumulative error, relative MAE), scaled by the seasonal naive (MASE, MSSE, RMSSE, scaled PIS), quantile (pinball, multi-quantile, scaled CRPS) and interval (coverage, Winkler, calibration). | |
| `forecast_rectify` | Learns how each model's backtest error (actual minus forecast) depends on the step ahead and on chosen features, with a correction regressor per step (or one using the step as a feature), and adds the predicted error to new forecasts. | |

Inputs, limits and outputs are described in [Fincept Forecast](/guides/fincept-forecast). Full schemas: `fincept_describe_tool`.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.