Two-criteria Estimation of Linear Regression Models Using Least Absolute Deviations and Squares

Mikhail Bazilevskiy

Abstract


This article is devoted to the problem of estimating multiple linear regression models. Today many different methods have been developed to solve this problem. The most popular of them in the scientific community is ordinary least squares, which consists in solving the optimization problem of minimizing the sum of squared errors. The advantage of this method is that the optimization problem solution is reduced to solving a system of linear algebraic equations, and also that within the framework of the method, a whole system of various adequacy criteria has been developed that are responsible for measuring a variety of qualitative characteristics of the regression model. But least squares estimates are very sensitive to outliers. Estimates less sensitive to outliers are provided the least absolute deviations, which consists of solving the optimization problem of minimizing the sum of absolute deviations. Its solution is equivalent to solving a specially formulated linear programming problem, which is somewhat slower than solving a linear system when implementing the least squares. In addition, when implementing the least absolute deviations, it is impossible to use such adequacy criteria as the coefficient of determination, the Durbin-Watson criterion, etc. The debate about which of the two methods is better continues to this day. In this work, with certain assumptions, the problem of two-criteria estimation of linear regressions is formulated using the least absolute deviations and squares. Using linear convolution, the two-criteria problem is reduced to a single-criteria linear programming problem. Using data from a chemical experiment as an example, both known and new linear regression estimates were obtained, the properties of which require further study.

Full Text:

PDF (Russian)

References


Arkes J. Regression analysis: a practical introduction. Taylor & Francis, 2023.

Lakshmi K., Mahaboob B., Rajaiah M., Narayana C. Ordinary least squares estimation of parameters of linear model // Journal of Mathematical and Computational Science. 2021. Vol. 11. No. 2. P. 2015-2030.

Noskov S.I. Tekhnologiya modelirovaniya ob"ektov s nestabil'nym funktsionirovaniem i neopredelennost'yu v dannykh. Irkutsk : RITs GP «Oblinformpechat'», 1996. 320 p.

Dorfman R. Application of linear programming to the theory of the firm: including an analysis of monopolistic firms by non-linear programming. Univ of California Press, 2022.

Darst R. Introduction to linear programming: applications and extensions. CRC Press, 2020.

Tyrsin A.N. Algoritmy spuska po uzlovym pryamym v zadache otsenivaniya regressionnykh uravneniy metodom naimen'shikh moduley // Zavodskaya laboratoriya. Diagnostika materialov. 2021. Vol. 87. No. 5. P. 68-75.

Miller B.M., Kolosov K.S. Robastnoe otsenivanie na osnove metoda naimen'shikh moduley i fil'tra Kalmana // Avtomatika i telemekhanika. 2020. No.11. P. 72-92.

Avdyushev V.A., Mezentseva A.D. Metod naimen'shikh moduley i ego effektivnost' pri obrabotke izmereniy s oshibkami razlichnogo raspredeleniya // Izvestiya Vysshikh uchebnykh zavedeniy. Fizika. 2012. Vol. 55. No. 10/2. P. 68-76.

Starosta R.D. Primenenie metoda naimen'shikh moduley v ekonomicheskom analize : avtoref. dis. … kand. ekon. nauk. L., 1979. 22 p.

Smolyak S.A. Primenenie metoda maksimal'nogo pravdopodobiya dlya stoimostnoy otsenki // Ekonomika i matematicheskie metody. 2020. Vol. 56. No. 2. P. 114-126.

Noskov S.I., Perfil'eva K.S. Modelirovanie ob"ema pogruzki na zheleznodorozhnom transporte metodom smeshannogo otsenivaniya // Izvestiya Tul'skogo gosudarstvennogo universiteta. Tekhnicheskie nauki. 2021. No. 2. P. 148-153.

Noskov S.I., Bychkov Yu.A. Modifikatsiya nepreryvnoy formy metoda maksimal'noy soglasovannosti pri postroenii lineynoy regressii // Izvestiya Tul'skogo gosudarstvennogo universiteta. Tekhnicheskie nauki. 2022. No. 5. P. 88-94.

Noskov S.I., Baenkhaeva A.V. Mnozhestvennoe otsenivanie parametrov lineynogo regressionnogo uravneniya // Sovremennye tekhnologii. Sistemnyy analiz. Modelirovanie. 2016. No. 3 (51). P. 133-138.

Baenkhaeva A.V., Bazilevskiy M.P., Noskov S.I. Modelirovanie valovogo regional'nogo produkta Irkutskoy oblasti na osnove primeneniya metodiki mnozhestvennogo otsenivaniya regressionnykh parametrov // Fundamental'nye issledovaniya. 2016. No. 10-1. P. 9-14.

Demidenko E.Z. Lineynaya i nelineynaya regressii. M.: Finansy i statistika, 1981.

Noskov S.I., Bazilevskiy M.P. Mnozhestvennoe Lv-otsenivanie lineynykh regressionnykh modeley // Uspekhi kibernetiki. 2022. Vol. 3. No. 4. P. 32-40.


Refbacks

  • There are currently no refbacks.


Abava  Кибербезопасность MoNeTec 2024

ISSN: 2307-8162