Evaluating Market Predictions: Insights from the Bank Participants Survey

Rishi Khiroya and Lydia Henning

The ability to accurately predict future market dynamics is highly coveted, particularly among those working in financial sectors. With the backdrop of unprecedented uncertainty and volatility following the pandemic, understanding how market predictions line up against actual occurrences is essential. The Bank’s Market Participants Survey (MaPS) serves as a valuable tool for this analysis, offering insights into the accuracy of these forecasts related to monetary policy.

The MaPS, initiated in mid-2020 and officially launched in February 2022, gathers expectations for monetary policy ahead of Monetary Policy Committee (MPC) meetings. Conducted within a two-week window before each meeting, the survey captures critical information regarding monetary policy decisions. Results from the survey are published shortly after each MPC meeting.

Near-Term Predictions and Accuracy

Examining the immediate outlook for the Bank Rate, a critical focus for market participants, Chart 1 illustrates the median ‘most likely’ Bank Rate predictions against actually realized rates for each MPC meeting. Remarkably, market participants have accurately forecasted the outcomes for 19 out of 22 meetings in the dataset, demonstrating a high level of accuracy in near-term predictions.

Chart 1: Realised Bank Rate against median expectations for the upcoming meeting

However, the precision of these predictions tends to decline as the forecast horizon extends. Chart 2 displays the percentage of respondents accurately forecasting the Bank Rate across different time frames—one, two, and three announcements ahead compared to those predicting the immediate meeting. It’s evident that predictions tend to be more accurate closer to the actual decision date, where new information shapes expectations.

Chart 2: Predictive accuracy through the cycle

When assessing longer horizons, Chart 3 illustrates the expected Bank Rate profile over a year against what was eventually realized. Up until the peak rate was reached, expectations tended to be conservative. Interestingly, however, by September 2023, the median forecast predicted a slightly elevated peak compared to what was actually realized, marking a shift in predictive accuracy.

Chart 3: Realised Bank Rate against median profile recorded

Extending this examination, Chart 4 details the average accuracy of Bank Rate expectations when allowing for variability. When requiring an exact match, accuracy was 19%, but relaxing this threshold to ±25 basis points increased accuracy to 40%. Notably, demographic factors such as the trajectory of Bank Rate over time also play a significant role in predictability, with higher accuracy observed during periods of stability compared to those marked by rate changes.

Chart 4: Average accuracy of median Bank Rate expectations

The Relationship Between Bank Rate and Inflation

Turning attention to inflation, Chart 5 presents a similar comparative analysis from the MaPS. The average deviation of inflation expectations from the actual realized rates demonstrates a decreasing trend as the forecasting window narrows, suggesting market participants become more attuned to economic realities as they evolve.

Chart 5: Average absolute deviation from realised inflation prints

Chart 6 shows how this accuracy evolves over time, indicating substantial variability. Expectations for inflation have adjusted significantly—from overestimations to more accurate reflections of actual realizations, constituting a remarkable adaptation by participants to shifting inflation patterns.

Chart 6: Average absolute deviation in predictions through the cycle

Further analyzing expectations, Chart 7 correlates inflation profiles recorded over time with actual realizations. Here, expectations previously undervalued inflation rates until they reached a peak, subsequently improving as market pressures influenced sentiment.

Chart 7: Realised inflation against median profile recorded

In summation, the analysis of the MaPS underscores a nuanced understanding of market predictions—a blend of foresight and uncertainty that reflects the complexity of recent economic dynamics. The findings indicate that while some predictions hold more reliable accuracy than others, market actors demonstrate an adaptive learning process amid fluctuating conditions. This evolving capability serves as a reflection of participants' grasp of economic shifts, rather than a simple dichotomy of foresight versus guesswork.

Rishi Khiroya and Lydia Henning work in the Bank’s Market Intelligence and Analysis Division.

If you want to get in touch, please email us at [email protected] or leave a comment below.

Comments will only appear once approved by a moderator, and are only published where a full name is supplied. Bank Underground is a blog for Bank of England staff to share views that challenge – or support – prevailing policy orthodoxies. The views expressed here are those of the authors, and are not necessarily those of the Bank of England, or its policy committees.