“How did you determine which variables to incorporate in your mannequin, and which did you intentionally exclude?”
The worth of the query lies in what it reveals. You aren’t asking for an inventory of variables. You might be asking whether or not the inclusion and exclusion selections have been grounded in financial reasoning relatively than statistical match alone.
In my conversations with each allocators and managers, the responses fall into three distinct classes.
A robust reply: The supervisor explains the financial mechanism behind every variable’s inclusion. Crucially, they focus on variables they excluded and why, exhibiting that specification was a deliberate design alternative. They distinguish between variables that drive their goal issue and variables that consequence from it. The strongest managers hint a sequence of financial causality: how macro forces mission onto stock-level indicators, and why the mannequin displays these causal chains relatively than mining for correlations.
A normal reply: The supervisor cites statistical standards: info ratio, R-squared enchancment, significance exams. That is present business follow. It’s not improper, however it’s incomplete. Statistical match alone can not distinguish between a variable that belongs within the mannequin and one which introduces distortion whereas enhancing match metrics. That is precisely the entice within the opening story.
A regarding reply takes certainly one of two types: “We use all accessible variables and let the mannequin choose” indicators structural vulnerability to issue mirages. However, “Our variable choice course of is proprietary” could mirror authentic IP safety. However a supervisor who can not clarify the reasoning behind their specification, even with out disclosing particular variables, can not display that the reasoning exists.
