End-to-end, decision-based, cardinality-constrained portfolio optimization

Portfolios employing a (factor) risk model are usually constructed using a two step process: first, the risk model parameters are estimated, then the portfolio is constructed. Recent works have shown that this decoupled approach may be improved using an integrated framework that takes the downstream portfolio optimization into account during parameter estimation. In this work we implement an integrated, end-to-end, predict-&-optimize framework to the cardinality-constrained portfolio optimization problem. To the best of our knowledge, we are the first to implement the framework to a nonlinear mixed integer programming problem. Since the feasible region of the problem is discontinuous, we are unable to directly differentiate through it. Thus, we compare three different continuous relaxations of increasing tightness to the problem which are placed as an implicit layers in a neural network. The parameters of the factor model governing the problem's covariance matrix structure are learned using a loss function that directly corresponds to the decision quality made based on the factor model's predictions. Using real world financial data, our proposed end-to-end, decision based model is compared to two decoupled alternatives. Results show significant improvements over the traditional decoupled approaches across all cardinality sizes and model variations while highlighting the need of additional research into the interplay between experimental design, problem size and structure, and relaxation tightness in a combinatorial setting.