Publication:
Spectrally-corrected estimation for high-dimensional markowitz mean-variance optimization

Loading...
Thumbnail Image
Official URL
Full text at PDC
Publication Date
2017
Advisors (or tutors)
Editors
Journal Title
Journal ISSN
Volume Title
Publisher
Facultad de Ciencias Económicas y Empresariales. Instituto Complutense de Análisis Económico (ICAE)
Citations
Google Scholar
Research Projects
Organizational Units
Journal Issue
Abstract
This paper considers the portfolio problem for high dimensional data when the dimension and size are both large. We analyze the traditional Markowitz mean-variance (MV) portfolio by large dimension matrix theory, and find the spectral distribution of the sample covariance is the main factor to make the expected return of the traditional MV portfolio overestimate the theoretical MV portfolio. A correction is suggested to the spectral construction of the sample covariance to be the sample spectrally corrected covariance, and to improve the traditional MV portfolio to be spectrally corrected. In the expressions of the expected return and risk on the MV portfolio, the population covariance matrix is always a quadratic form, which will direct MV portfolio estimation. We provide the limiting behavior of the quadratic form with the sample spectrally-corrected covariance matrix, and explain the superior performance to the sample covariance as the dimension increases to infinity proportionally with the sample size. Moreover, this paper deduces the limiting behavior of the expected return and risk on the spectrally-corrected MV portfolio, and illustrates the superior properties of the spectrally-corrected MV portfolio. In simulations, we compare the spectrally-corrected estimates with the traditional and bootstrap-corrected estimates, and show the performance of the spectrally-corrected estimates are the best in portfolio returns and portfolio risk. We also compare the performance of the new proposed estimation with deferent optimal portfolio estimates for real data from S&P 500. The empirical findings are consistent with the theory developed in the paper.
Description
Unesco subjects
Keywords
Citation
Bai, Z.D., Chen, J. and Yao, J.F. (2010). On estimation of the population spectral distribution from a high dimensional sample covariance matrix. Australian & New Zealand Journal of Statistics, 52 423-437. Bai, Z.D., Liu, H.X. and Wong,W.K. (2009). Enhancement of the Applicability of Markowitz’s Portfolio Optimization by Utilizing Random Matrix Theory. Mathematical Finance, 19(4) 639-667. Bai, Z.D., Liu, H.X. andWong,W.K. (2011). Asymptotic properties of eigenmatrices of a large sample covariance matrix. Annals of Applied Probability, 1994-2015. Bai, Z.D.,Miao, B.Q. and Pan, G.M. (2007). On the asymptotics of eigenvectors of large sample covariance matrix. Annals of Probability, 35(4) 1532-1572. Bai, Z.D. and Silverstein, J.W. (2004), CLT for linear spectral statistics of large-dimensional sample covariance matrices. Annals of Probability, 32 553–605. Bai, Z.D. and Silverstein, J.W. (1998) No eigenvalues outside the support of the limiting spectral distribution of large-dimensional sample covariance matrices. Annals of Probability, 316-345. Bai, Z.D. and Silverstein, J.W.(1999) Exact separation of eigenvalues of large dimensional sample covariance matrices. Annals of Probability, 1536-1555. Bai, Z.D. and Yin, Y.Q. (1993) Limit of the smallest eigenvalue of a large dimensional sample covariance matrix. Annals of Probability, 1275–1294. Bickel, P. J. and Levina, E. (2008). Regularized estimation of large covariance matrices. Annals of Statistics, 36 199-227. Cass, David and Stiglitz, Joseph E. (1970). The structure of investor preferences and asset returns, and separability in portfolio allocation: A contribution to the pure theory of mutual funds. Cai, T. Tony and Zhou, Harrison H. (2012). Minimax estimation of large covariance matrices under l1 norm. Statistica Sinica, 22(4), 1319–1349. El Karoui, N. (2008). Spectrum estimation for large dimensional covariance matrices using random matrix theory. Annals of Statistics, 36(6) 2757-2790. Fan, J., Fan, Y. and Lv, J. (2008). High dimensional covariance matrix estimation using a factor model. Journal of Econometrics, 147 186-197. Frankfurter, G.M., Phillips, H.E. and Seagle, J.P. (1971). Portfolio selection: The e_ects of uncertain means, variances and covariances. Journal of Financial and Quantitative Analysis, 6 1251-1262. Green, J., Hand, J.R.M. and Zhang, X.F. (2013). The supraview of return predictive signals. Review of Accounting Studies, 18 692-730. Jacobs, B.J., Levy, K.N. and Markowitz, H.M. (2005). Portfolio optimization with factors, scenarios, and realistic short positions. Operations Research, 53, 586-599. Jorion, P. (1985). International portfolio diversification with estimation risk. Journal of Business, 58(3) 259-278. Konno, H. and Yamazaki, H. (1991). Mean-absolute deviation portfolio optimization model and its applications to Tokyo stock arket. Management Science, 37(5) 519-531. Korkie and Turtle, H.J. (2002). A mean-variance analysis of self-financing portfolios. Management Science, 48(3) 427-443. Kroll, Y. , Levy, H. and Markowitz, H.M. (1984). Mean-variance versus direct utility maximization. Journal of Finance, 39(1) 47-61. Laloux, L., Cizeau, P., Bouchaud, J.P. and Potters, M. (1999). Noise dressing of financial correlation matrices. Physical Review Letters, 83 1467-1470. Ledoit, O. and Wolf, M. (2004). A well-conditioned estimator for large-dimensional covariance matrices. Journal of Multivariate Analysis, 88(2) 365-411. Ledoit, O. andWolf, M. (2012). Nonlinear shrinkage estimation of large-dimensional covariance matrices. Annals of Statistics, 40(2) 1024-1060. Leung, P.L., Ng, H.Y. andWong,W.K. (2012). An improved estimation to make Markowitz’s portfolio optimization theory users friendly and estimation accurate with application on the US stock market investment. European Journal of Operational Research, 222 85-95. Li, W.M., Chen, J.Q., Qin, Y.L., Yao, J.F. and Bai, Z.D. (2013). Estimation of the population spectral distribution from a large dimensional sample covariance matrix. Journal of Statistical Planning and Inference, 143(11) 1887-1897. Li,W.M. and Yao, J.F. (2014). A local moment estimator of the spectrum of a large dimensional covariance matrix. Statistica Sinica, 24 919-936. Khare, K. and Rajaratnam, B. (2011). Wishart distributions for decomposable covariance graph models. Annals of Statistics, 39 514-555. Marcenko, V.A. and Pastur, L.A. (1967). Distribution for some sets of random matrices. Mathematics of the USSR-Sbornik, 1(4), 457-483. Markowitz, H.M. (1952). Portfolio Selection. Journal of Finance, 7 77-91. Markowitz, H.M. (1959). Portfolio Selection. New York: Wiley. Markowitz, H.M. and Perold, A.F. (1981). Portfolio analysis with factors and scenarios, Journal of Finance, 36(4), 871-877. Markowitz, H.M. (1991). Foundations of Portfolio Theory. Journal of Finance, 46(2) 469-77. Mestre, X. (2008). Improved estimation of eigenvalues and eigenvectors of covariance matrices using their sample estimates. Information theory, IEEE Transactions on, 54(11) 5113-5129. Menchero, J., Wang, J. and Orr, D.J. (2011). Eigen-adjusted covariance matrices. MSCI Barra Research Paper, No. 2011-14. Merton, R.C.(1972) An analytic derivation of the e_cient portfolio frontier. Journal of Financial and Quantitative Analysis, 7(04) 1851-1872. Michaud, R (1989). The Markowitz optimization enigma: Is optimized optimal?, Financial Analysts Journal, 45 31-42. Rajaratnam, B., Massam, H. and Carvalho, C.M. (2008). Flexible covariance estimation in graphical Gaussian models. Annals of Statistics, 36 2818-2849. Rao, N.R., Mingo, J.A., Speicher, R. and Edelman, A. (2008). Statistical eigen-inference from large Wishart matrices. Annals of Statistics, 36, 2850-2885. Ravikumar, P.,Wawinwright, M., Raskutti, G. and Yu, B. (2008). High-dimensional covariance estimation by minimizing 1-penalized log-determinant divergence Technical Report 797, Department of Statistics, University of California, Berkeley. Rohde, A. and Tsybakov, A.B. (2011). Estimation of high-dimensional low-rank matrices. Annals of Statistics, 39(2) 887-930. Simaan, Y. (1997). Estimation risk in portfolio selection: The mean variance model versus the mean absolute deviation model. Management Science, 43(10) 1437-1446. Siverstein, J.W. (1995). Strong convergence of the empirical distribution of eigenvalues of large dimensional random matrices. Journal of Multivariate Analysis, 5 331-339. Silverstein, J.W. and Bai, Z.D. (1995). On the empirical distribution of eigenvalues of a class of large dimensional random matrices. Journal of Multivariate Analysis, 54(2) 175-192. Siverstein, J.W. (1990). Weak convergence of random functions defined by the eigenvectors of sample covariance matrices. Annals of Probability, 8(18) 1174-1193. Siverstein, J.W. (1989). On the eigenvectors of large-dimensional sample covariance matrices. Journal of Multivariate Analysis, 30 1-16. Siverstein, J.W. (1984). Some limit theorems on the eigenvectors of large-dimensional sample covariance matrices. Journal of Multivariate Analysis, 15 295-324. Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society, Series B, 58 267-288. Wong, F., Carter, C.K. and Kohn, R. (2003). E_cient estimation of covariance selection models. Biometrika, 90 809-830. Yao, Jianfeng, Kammoun, Abla and Najim, Jamal.(2012). Eigenvalue estimation of parameterized covariance matrices of large dimensional data. IEEE Transactions on,Signal Processing. 60(11) 5893-5905.