• ISSN: 2148-2225 (online) # Comparison of Parametric and Non-Parametric Estimation Methods in Linear Regression Model

Tolga Zaman, Ph.D.

Kamil Alakuş, Ph.D.

Abstract

In this study, the aim was to review the methods of parametric and non-parametric analyses in simple linear regression model. The least squares estimator (LSE) in parametric analysis of the model, and Mood-Brown and Theil-Sen methods that estimates the parameters according to the median value in non-parametric analysis of the model are introduced. Also, various weights of Theil-Sen method are examined and estimators are discussed. In an attempt to show the need for non-parametric methods, results are evaluated based on real life data.

Keywords: Least Squares, Mean Absolute Deviation, Median, Mood-Brown Estimator, Outlier, Theil-Sen Estimator

Jel Classification: C40

# Doğrusal Regresyon Modelinde Parametrik ve Parametrik Olmayan Tahmin Yöntemlerinin Karşılaştırması

Öz

Bu çalışmada, basit doğrusal regresyon modelinde parametrik ve parametrik olmayan analiz yöntemlerinin karşılaştırmalı olarak incelenmesi amaçlanmıştır. Modelin parametrik analizinde EKK tahmini, parametrik olmayan analizinde ise medyana göre parametre tahmini yapan Mood-Brown ve Theil-Sen yöntemleri tanıtılmıştır. Ayrıca Theil-Sen yöntemine ait çeşitli ağırlıklar incelenerek parametre tahmin ediciler tartışılmıştır. Parametrik olmayan yöntemlere olan ihtiyacı göstermek amacı ile sonuçlar gerçek yaşam verisi üzerinde değerlendirilmiştir.

Anahtar Kelimeler: Aykırı Değerler, En Küçük Kareler Metodu, Medyan, Mood-Brown Tahmini, Ortalama Mutlak Sapma, Theil-Sen Tahmini

Suggested citation

Zaman, T., Alakuş, K. (2019). Comparison of Parametric and Non-Parametric Estimation Methods in Linear Regression Model. Alphanumeric Journal, 7(1), 13-24. http://dx.doi.org/10.17093/alphanumeric.346469

References

• Brown, G. W., & Mood, A. M. (1951). On median tests for linear hypotheses. In Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability. The Regents of the University of California.
• Candan, M. (1995). Robust estimators in linear regression analysis. Master Thesis. Hacettepe University. Graduate School of Sciences, Ankara, 47096.
• D’Abrera, H. J. M., & Lehmann, E. L. (1975). Nonparametrics: statistical methods based on ranks. Holden-Day.
• Daniel, C., & Wood, F. S. (1980). Fitting equations to data: computer analysis of multifactor data. John Wiley & Sons, Inc..
• Daniel, W. W. (1990). Applied Nonparametric Statistics, 2nd. Brooks/Cole.
• Hussain, S. S., & Sprent, P. (1983). Non‐parametric regression. Journal of the Royal Statistical Society: Series A (General), 146(2), 182-191.
• Kıroğlu, G. (2001). Applied Nonparametric Statistical Methods. Mimar Sinan University Faculty of Art and Sciences, Istanbul.
• Maritz, J. S. (1979). On Theil’s method in distribution‐free regression. Australian Journal of Statistics, 21(1), 30-35.
• Mood, A. M., & Graybill, F. A. (1950). Introduction to the Theory of Statistics, New York: Mc-Graw-I-Iill Book Co.
• Randles, R. H., & Wolfe, D. A. (1979). Introduction to the theory of nonparametric statistics. New York: John Willey & Sons.
• Rao, K. M., & Gore, A. P. (1982). Nonparametric tests for intercept in linear regression problems. Australian Journal of Statistics, 24(1), 42-50.
• Scholz, F. W. (1978). Weighted median regression estimates. The Annals of Statistics, 603-609.
• Sen, P. K. (1968). Estimates of the regression coefficient based on Kendall’s tau. Journal of the American statistical association, 63(324), 1379-1389.
• Sievers, G. L. (1978). Weighted rank statistics for simple linear regression. Journal of the American Statistical Association, 73(363), 628-631.
• Theil, H. (1950). A rank-invariant method of linear and polynomial regression analysis, Part 3. In Proceedings of Koninalijke Nederlandse Akademie van Weinenschatpen A (Vol. 53, pp. 1397-1412).
• Toka, O., Çetin M. & Altunay, S. A. (2011). Comparison of Robust and Theil Estimators in Simple Linear Regression. TUIK, Statistics Research Journal. Volume: 08. Issue: 03. Category: Page: 45-53. ISSN No. 1303-6319.
• Wang, X., & Yu, Q. (2005). Unbiasedness of the Theil–Sen estimator. Nonparametric Statistics, 17(6), 685-695.
• Yıldız, N. & Topal M., (2001). Investigation of Nonparametric Regression Methods. Atatürk University, Faculty of Agriculture Journal, 32(4), 429-435.
• Zaman, T. (2017). Contributions to the jackknife estimation and test problems in multiple linear regression analysis. Doctoral Thesis. Ondokuz Mayıs University. Graduate School of Sciences. Samsun 468099.
• Zaman, T., & Alakuş, K. (2016). Some Robust Estimation Methods and Their Applications. Alphanumeric Journal, 3(2), 73-82. 2019.07.01.STAT.02

alphanumeric journal

Volume 7, Issue 1, 2019

Pages 13-24

Accepted: March 22, 2019

Published: June 30, 2019

Full Text [678.2 KB]

• Share

2019 Zaman, T., Alakuş, K.

This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence, which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
{"ft_lang_label":"__label__en","ft_lang_prob":0.55484384,"math_prob":0.6499435,"size":2646,"snap":"2021-04-2021-17","text_gpt3_token_len":717,"char_repetition_ratio":0.11695685,"word_repetition_ratio":0.0,"special_character_ratio":0.21617536,"punctuation_ratio":0.1619256,"nsfw_num_words":0,"has_unicode_error":false,"math_prob_llama3":0.95346093,"pos_list":[0,1,2,3,4,5,6],"im_url_duplicate_count":[null,null,null,2,null,4,null],"WARC_HEADER":"{\"WARC-Type\":\"response\",\"WARC-Date\":\"2021-01-18T03:29:50Z\",\"WARC-Record-ID\":\"<urn:uuid:c5afa462-77d8-43ea-ba2b-f912cf58b492>\",\"Content-Length\":\"25850\",\"Content-Type\":\"application/http; msgtype=response\",\"WARC-Warcinfo-ID\":\"<urn:uuid:55a81239-f817-4420-a5cd-bd86fb5febd5>\",\"WARC-Concurrent-To\":\"<urn:uuid:82e46793-8338-4091-acb1-253815d3b4b1>\",\"WARC-IP-Address\":\"178.62.240.247\",\"WARC-Target-URI\":\"http://www.alphanumericjournal.com/article/comparison-of-parametric-and-non-parametric-estimation-methods-in-linear-regression-model/\",\"WARC-Payload-Digest\":\"sha1:4GEEEKHR7ZX7OR3ASGLR2HMP52GVPYQ5\",\"WARC-Block-Digest\":\"sha1:ZPDAXU2CREDLIMXRVO3IATXW7ZXDJHKV\",\"WARC-Identified-Payload-Type\":\"text/html\",\"warc_filename\":\"/cc_download/warc_2021/CC-MAIN-2021-04/CC-MAIN-2021-04_segments_1610703514121.8_warc_CC-MAIN-20210118030549-20210118060549-00230.warc.gz\"}"}