# Asymptotic Properties of M, ML, and Maximum A Posteriori Estimators

• Luc Pronzato
• Andrej Pázman
Chapter
Part of the Lecture Notes in Statistics book series (LNS, volume 212)

## Abstract

We consider the regression model (3.2) where the errors $$\varepsilon _{i}$$ are independently distributed, $$\varepsilon _{i}$$ having the p.d.f.$$\bar{\varphi }_{x_{i}}(\cdot )$$.

## Keywords

Independent Random Variable Exponential Family Fisher Information Matrix Finite Measure Asymptotic Efficiency
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

## References

1. Barndorff-Nielsen, O. (1978). Information and Exponential Families in Statistical Theory. Chichester: Wiley.
2. Beran, R. (1974). Asymptotically efficient rank estimates in location models. Ann. Statist. 2, 63–74.
3. Bickel, P. (1982). On adaptive estimation. Ann. Statist. 10, 647–671.
4. Bickel, P., C. Klassen, Y. Ritov, and J. Wellner (1993). Efficient and Adaptive Estimation for Semiparametric Models. Baltimore: Johns Hopkins Univ. Press.
5. Bierens, H. (1994). Topics in Advanced Econometrics. Cambridge: Cambridge Univ. Press.
6. Caines, P. (1988). Linear Stochastic Systems. New York: Wiley.
7. Cox, D. and D. Hinkley (1974). Theoretical Statistics. London: Chapman & Hall.
8. del Pino, G. (1989). The unifying role of iterative generalized least squares in statistical algorithms (with discussion). Statist. Sci. 4(4), 394–408.
9. Downing, D., V. Fedorov, and S. Leonov (2001). Extracting information from the variance function: optimal design. In A. Atkinson, P. Hackl, and W. Müller (Eds.), mODa’6 – Advances in Model–Oriented Design and Analysis, Proc. 6th Int. Workshop, Puchberg/Schneberg (Austria), pp. 45–52. Heidelberg: Physica Verlag.Google Scholar
10. Goodwin, G. and R. Payne (1977). Dynamic System Identification: Experiment Design and Data Analysis. New York: Academic Press.
11. Gorman, J. and A. Hero (1990). Lower bounds for parametric estimation with constraints. IEEE Trans. Information Theory 26, 1285–1301.
12. Green, P. (1984). Iteratively reweighted least squares for maximum likelihood estimation, and some robust and resistant alternatives (with discussion). J. Roy. Statist. Soc. B-46(2), 149–192.Google Scholar
13. Heyde, C. (1997). Quasi-likelihood and its Application. A General Approach to Optimal Parameter Estimation. New York: Springer.
14. Huber, P. (1981). Robust Statistics. New York: John Wiley.
15. Ibragimov, I. and R. Has’minskii (1981). Statistical Estimation. Asymptotic Theory. Heidelberg: Springer.Google Scholar
16. Jørgensen, B. (1997). Exponential dispersion models. J. Roy. Statist. Soc. B49, 127–167.Google Scholar
17. Le Cam, L. (1953). On some asymptotic properties of maximum likelihood estimates and related Bayes’ estimates. Univ. California Pub. in Stat. 1, 277–230.Google Scholar
18. Le Cam, L. (1960). Local asymptotically normal families of distributions. Univ. California Pub. in Stat. 3, 37–98.Google Scholar
19. Lehmann, E. and G. Casella (1998). Theory of Point Estimation. Heidelberg: Springer.
20. Liang, K.-Y. and S. Zeger (1995). Inference based on estimating functions in the presence of nuisance parameters. Statist. Sci. 10(2), 158–173.
21. Ljung, L. (1987). System Identification, Theory for the User. Englewood Cliffs: Prentice Hall.
22. Manski, C. (1984). Adaptive estimation of nonlinear regression models. Econometric Rev. 3(2), 145–194.
23. McCullagh, P. and J. Nelder (1989). Generalized Linear Models. London: Chapman & Hall. [2nd ed.].Google Scholar
24. Pázman, A. (2002b). Results on nonlinear least squares estimators under nonlinear equality constraints. J. Stat. Plann. Inference 103, 401–420.
25. Söderström, T. and P. Stoica (1981). Comparison of some instrumental variable methods—consistency and accuracy aspects. Automatica 17(1), 101–115.
26. Söderström, T. and P. Stoica (1983). Instrumental Variable Methods for System Identification. New York: Springer.
27. Söderström, T. and P. Stoica (1989). System Identification. New York: Prentice Hall.
28. Stein, C. (1956). Efficient nonparametric testing and estimation. In Proc. 3rd Berkeley Symp. Math. Stat. Prob., Volume 1, pp. 187–196. Berkeley: Univ. of California Press.Google Scholar
29. Stoica, P. (1998). On the Cramér-Rao bound under parametric constraints. IEEE Signal Proc. Lett. 5(7), 177–179.
30. Stoica, P. (2001). Parameter estimation problems with singular information matrices. IEEE Trans. Signal Proc. 49, 87–90.
31. Stone, C. (1975). Adaptive maximum likelihood estimators of a location parameter. Ann. Statist. 3(2), 267–284.
32. van de Geer, S. (2000). Empirical Processes in M-estimation. Cambridge: Cambridge Univ. Press.Google Scholar
33. van der Vaart, A. (1998). Asymptotic Statistics. Cambridge: Cambridge Univ. Press.
34. van der Vaart, A. (2002). The statistical work of Lucien Le Cam. Ann. Statist. 30(3), 631–682.
35. Walter, E. and L. Pronzato (1997). Identification of Parametric Models from Experimental Data. Heidelberg: Springer.
36. Zarrop, M. (1979). Optimal Experiment Design for Dynamic System Identification. Heidelberg: Springer.

## Authors and Affiliations

• Luc Pronzato
• 1
• Andrej Pázman
• 2
1. 1.French National Center for Scientific Research (CNRS)University of NiceSophia AntipolisFrance
2. 2.Department of Applied Mathematics and StatisticsComenius UniversityBratislavaSlovakia

## Personalised recommendations

### Citechapter
{"ft_lang_label":"__label__en","ft_lang_prob":0.54122883,"math_prob":0.7889414,"size":5923,"snap":"2019-26-2019-30","text_gpt3_token_len":1681,"char_repetition_ratio":0.18820746,"word_repetition_ratio":0.030789826,"special_character_ratio":0.26557487,"punctuation_ratio":0.28725314,"nsfw_num_words":0,"has_unicode_error":false,"math_prob_llama3":0.97951293,"pos_list":[0,1,2],"im_url_duplicate_count":[null,1,null],"WARC_HEADER":"{\"WARC-Type\":\"response\",\"WARC-Date\":\"2019-07-19T12:52:00Z\",\"WARC-Record-ID\":\"<urn:uuid:cf4973cf-bd52-4388-9efe-3985e774ba1a>\",\"Content-Length\":\"97450\",\"Content-Type\":\"application/http; msgtype=response\",\"WARC-Warcinfo-ID\":\"<urn:uuid:b86ff380-01a9-4f65-bb1e-780d84dcf65f>\",\"WARC-Concurrent-To\":\"<urn:uuid:14d2cfcf-f493-4632-b322-822c2b64a4de>\",\"WARC-IP-Address\":\"151.101.200.95\",\"WARC-Target-URI\":\"https://link.springer.com/chapter/10.1007/978-1-4614-6363-4_4\",\"WARC-Payload-Digest\":\"sha1:PSXQLUUNOD4Q7ECYHDQXVWGYO42NP3F6\",\"WARC-Block-Digest\":\"sha1:2QVFZMEBD36KLLD6ZGZXOAAORSKTYBYI\",\"WARC-Identified-Payload-Type\":\"text/html\",\"warc_filename\":\"/cc_download/warc_2019/CC-MAIN-2019-30/CC-MAIN-2019-30_segments_1563195526237.47_warc_CC-MAIN-20190719115720-20190719141720-00053.warc.gz\"}"}