SciELO - Scientific Electronic Library Online

 
vol.44 issue1Combining Interval Time Series Forecasts. A First Step in a Long Way (Research Agenda)A Review of Latent Space Models for Social Networks author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Revista Colombiana de Estadística

Print version ISSN 0120-1751

Rev.Colomb.Estad. vol.44 no.1 Bogotá Jan./June 2021  Epub Feb 27, 2021

https://doi.org/10.15446/rce.v44n1.83525 

Original articles of research

Elicitation of the Parameters of Múltiple Linear Models

Elicitación de los parámetros de un modelo de regresión lineal múltiple

Juan Carlos Correa-Morales1  a 

Carlos Barrera-Causil2  b 

1Escuela de Estadística, Facultad de Ciencias, Universidad Nacional de Colombia, Medellín, Colombia

2Grupo de Investigación Davinci, Facultad de Ciencias Exactas y Aplicadas, Instituto Tecnológico Metropolitano, Medellín, Colombia


Abstract

Estimating the parameters of a multiple linear model is a common task in all areas of sciences. In order to obtain conjugate distributions, the Bayesian estimation of these parameters is usually carried out using noninformative priors. When informative priors are considered in the Bayesian estimation an important problem arises because techniques are required to extract information from experts and represent it in an informative prior distribution. Elicitation techniques can be used for such purpose even though they are more complex than the traditional methods.

In this paper, we propose a technique to construct an informative prior distribution from expert knowledge using hypothetical samples. Our proposal involves building a mental picture of the population of responses at several specific points of the explanatory variables of a given model and indirectly eliciting the mean and the variance at each of these points. In addition, this proposal consists of two steps: the first step describes the elicitation process and the second step shows a simulation process to estimate the model parameters.

Key words: Bayesian statistics; Conjugate distribution; Elicitation; Informative distribution

Resumen

La estimación de los parámetros de un modelo de regresión lineal múltiple es una tarea común en todas las áreas de las ciencias. Con la idea de obtener distribuciones conjugadas, la estimación Bayesiana de estos parámetros se lleva a cabo usando distribuciones a priori no informativas. Un problema importante resulta cuando se incorporan distribuciones a priori informativas en la estimación Bayesiana, puesto que se hace necesario usar técnicas para extraer información de expertos, y representar dicha información en una distribución a prior informativa. Así, los métodos de elicitación pueden ser implementados para tal fin, a pesar de la complejidad de esta tarea en relación con las metodologías tradicionales.

En este paper, se propone un técnica para construir una distribución a priori informativa a partir de muestras hipotéticas usando información de expertos. Esta propuesta se basa en la construcción de un mapa mental de la población de respuestas en diferentes valores específicos de la variable explicativa en el modelo, y luego elicitar de forma indirecta la media y la varianza en cada uno de dichos valores de interés.

La propuesta es presentada en dos pasos, el primer paso describe el proceso de elicitación, y el segundo paso muestra un proceso de simulación para estimar los parámetros del modelo.

Palabras clave: Distribución conjugada; Distribución informativa; Elicitación; Estadística Bayesiana

Full text available only in PDF format

References

Aaron, R., DeWispelare, A. R., Herren, L. T. & Clemen, R. T. (1995), 'The use of probability elicitation in the high-level nuclear waste regulation program', International Journal of Forecasting 11, 5-24. [ Links ]

Andrade, J. A. A. & Gosling, J. P. (2011), 'Predicting rainy seasons: quantifying the beliefs of prophets', Journal of Applied Statistics 38(1), 183-193. [ Links ]

Andrade, J. A. A. & Gosling, J. P. (2018), 'Expert knowledge elicitation using item response theory', Journal of Applied Statistics 45(16), 2981-2998. [ Links ]

Barrera-Causil, C. J., Correa, J. C. & Marmolejo-Ramos, F. (2019), 'Experimental investigation on the elicitation of subjective distributions', Frontiers in Psychology 10, 862. [ Links ]

Biedermann, A., Bozza, S., Taroni, F. & Aitken, C. (2017), 'The consequences of understanding expert probability reporting as a decision', Science and Justice 57, 80-85. [ Links ]

Chaloner, K. & T., D. (1983), 'Assessment of a beta prior distribution: Pm elicitation', The Statistician 27, 174-180. [ Links ]

Christov, S. C., Marquard, J. L., S., G., Avrunin, G. S. & Clarke, L. A. (2017), 'Assessing the effectiveness of five process elicitation methods: A case study of chemotherapy treatment plan review', Applied Ergonomics 59, 364-376. [ Links ]

DeGroot, M. H. (1970), Optimal Statistical Decisions, McGraw Hill, New York. [ Links ]

Demuynck, T. (2013), 'A mechanism for eliciting the mean and quantiles of a random variable', Economics Letters 121(1), 121-123. [ Links ]

Fisher, R., O'Leary, R. A., Low-Choy, S., Mengersen, K. & Caley, M. J. (2012), 'A software tool for elicitation of expert knowledge about species richness or similar counts', Environmental Modelling and Software 30, 1-14. [ Links ]

Gavasakar, U. (1988), 'A comparison of two elicitation methods for a prior distribution for a binomial parameter', Managment Science 34(6), 784-790. [ Links ]

Gzyl, H., ter Horst, E. & Molina, G. (2017), 'Inferring probability densities from expert opinion', Applied Mathematical Modelling 43, 306-320. [ Links ]

Harrison, G. W., Martínez-Correa, J. & Swarthout, J. T. (2014), 'Eliciting subjective probabilities with binary lotteries', Journal of Economic Behavior& Organization 101, 128-140. [ Links ]

Holloway, C. A. (1979), Decison Making Under Uncertainty: Models and Choices, Prentince-Hall, Inc., Englewood Cliffs, NJ. [ Links ]

James, A., Choy, S. L. & Mengersen, K. (2010), 'Elicitator: An expert elicitation tool for regression in ecology', Environmental Modelling & Software 25, 129-145. [ Links ]

Johnson-Laird, P. (1980), 'Mental models in cognitive science', Cognitive Science 4(1), 71-115. [ Links ]

Johnson-Laird, P. N. (1994), 'Mental models and probabilistic thinking', Cognition 50, 189-209. [ Links ]

Johnson-Laird, P. N. (2010), 'Mental models and human reasoning', Proceedings of the National Academy of Sciences 107(43), 18243-18250. [ Links ]

Kadane, J. B. & Wolfson, L. J. (1998), 'Experiences in elicitation', The Statistician 47(1), 3-19. [ Links ]

Nemet, G. F., Baker, E. & Jenni, K. E. (2013), 'Modeling the future costs of carbon capture using experts? elicited probabilities under policy scenarios', Energy 53, 218-228. [ Links ]

O'Hagan, A. (2019), 'Expert knowledge elicitation: Subjective but scientific', The American Statistician 73(sup1), 69-81. [ Links ]

O'Hagan, A. & Oakley, J. E. (2004), 'Probability is perfect, but we can't elicit it perfectly', Reliability Engineering and System Safety 85, 239-248. [ Links ]

Raiffa, H. (1970), Decision Analysis: Introductory Lectures on Choice Under Uncertainty, Addison-Wesley: Reading, Masschusetts. [ Links ]

Renooij, S. & Witteman, C. (1999), 'Talking probabilities: Communicating probabilistic information with words and numbers', International Journal of Approximate Reasoning 22, 169-194. [ Links ]

Seynaeve, D., Varewyck, M. & Verbeke, T. (2019), 'Extension of the monte-carlo web application and expert knowledge elicitation web application', EFSA Supporting Publications 16(6), 1630E. [ Links ]

Shadbolt, N. & Burton, M. (1995), 'Knowledge elicitation: A systematic approach', Evaluation of Human Work: A Practical Ergonomics Methodology pp. 406-440. [ Links ]

Truong, P. N. & Heuvelink, G. B. M. (2013), 'Uncertainty quantification of soil property maps with statistical expert elicitation', Geoderma 202-203, 142-152. [ Links ]

Tversky, A. (1974), 'Assessing uncertainty', Journal of the Royal Statistical Society. Series B (Methodological) 36(2), 148-159. [ Links ]

Umesh, G., A. (1988), 'Comparison of two elicitation methods for a prior for a binomial parameter', Management Science 34, 784-790. [ Links ]

Wilcox, C., Mallos, N. J., Leonard, G. H., Rodriguez, A. & Hardesty, B. D. (2016), 'Using expert elicitation to estimate the impacts of plastic pollution on marine wildlife', Marine Policy 65, 107-114. [ Links ]

Winkler, R. L. (1967a), 'The assessment of prior distributions in bayesian analysis', Journal of the American Statistical Association 62(319), 776-800. [ Links ]

Winkler, R. L. (1967b), 'The quantification of judgement: Some methodological suggestions', Journal of the American Statistical Association 62(320), 1105-1120. [ Links ]

Witteman, C. & Renooij, S. (2003), 'Evaluation of a verbal numerical probability scale', International Journal of Approximate Reasoning 33, 117-131. [ Links ]

a Ph.D. E-mail: jccorrea@unal.edu.co

b Ph.D. E-mail: carlosbarrera@itm.edu.co

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License