Market Regime
Backtesting limitations are often observed across various market environments, including a crisis volatility regime. Historical data analysis shows that specific asset classes, such as crypto and FX assets, exhibit distinct behaviors during these periods. Understanding the market regime is a critical component of evaluating historical simulations, as past performance and backtest results do not indicate future outcomes. The analysis of these environments is based on specific historical datasets and market conditions.
Historical Pattern
Historical patterns reveal significant backtesting limitations, primarily driven by excessive drawdown. Across multiple cohorts, the observed survival rate was consistently 0.0 or 0.0%. For instance, a sample of 3,180 backtests showed a 1.0 probability of excessive drawdown. Similarly, a cohort of 405 strategies exhibited a 99.73% probability of excessive drawdown, while a group of 56 backtests showed a 96.85% probability of the same failure mode. In some cases, such as the cohort of 56 backtests, there is also a 3.01% probability of a low transaction count, which can affect statistical reliability. Other samples of 10 and 90 backtests also resulted in a 1.0 probability of failure due to excessive drawdown.
Workflow Pointer
When navigating the platform to review backtesting limitations, users can access specific methodology pages. The system currently supports 5 generated page families and a sku whitelist count of 6. The model identifier locked for this generation is gemini-3.1-pro-preview/answer_gen/v1. The platform explains observed behavior based on historical data and does not provide recommendations for parameter adjustments. Users reviewing these methodology pages should note that the probabilities shown are specific to the historical data and parameters used, and past performance in simulations does not predict future results.