SciELO - Scientific Electronic Library Online

 
vol.44 issue1Elicitation of the Parameters of Múltiple Linear ModelsStress-Strength Reliability Estimation of Time-Dependent Models with Fixed Stress and Phase Type Strength Distribution author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Revista Colombiana de Estadística

Print version ISSN 0120-1751

Rev.Colomb.Estad. vol.44 no.1 Bogotá Jan./June 2021  Epub Feb 27, 2021

https://doi.org/10.15446/rce.v44n1.89369 

Original articles of research

A Review of Latent Space Models for Social Networks

Una revisión de modelos de espacio latente para redes sociales

Juan Sosa1  a 

Lina Buitrago1  b 

1 Department of Statistics, Facultad de Ciencias, Universidad Nacional de Colombia, Bogotá, Colombia


Abstract

In this paper, we provide a review on both fundamentals of social networks and latent space modeling. The former discusses important topics related to network description, including vertex characteristics and network structure; whereas the latter articulates relevant advances in network modeling, including random graph models, generalized random graph models, exponential random graph models, and social space models. We discuss in detail several latent space models provided in literature, providing special attention to distance, class, and eigen models in the context of undirected, binary networks. In addition, we also examine empirically the behavior of these models in terms of prediction and goodness-of-fit using more than twenty popular datasets of the network literature.

Key words: Bayesian inference; Latent space model; Markov chain Monte Carlo; Social networks

Resumen

En este artículo, proporcionamos una revisión sobre los fundamentos de redes sociales y el modelamiento de espacio latente. La primera trata temas importantes relacionados con la descripción de la red, incluidas las características de los vértices y la estructura de la red; mientras que la segunda articula avances relevantes en el modelado de redes, incluidos modelos de grafos aleatorios, modelos de grafos aleatorios generalizados, modelos de grafos aleatorios exponenciales y modelos de espacio social. Discutimos en detalle varios modelos de espacio latente proporcionados en la literatura, prestando especial atención a los modelos de distancia, clase y eigen, en el contexto de redes binarias no dirigidas. Además, también examinamos empíricamente el comportamiento de estos modelos en términos de predicción y bondad de ajuste utilizando más de veinte conjuntos de datos populares de la literatura de redes.

Palabras clave: Cadena de Markov de Monte Carlo; Inferencia Bayesiana; Modelo de espacio latente; Redes sociales

Full text available only in PDF format

References

Airoldi, E. M., Blei, D. M., Fienberg, S. E. & Xing, E. P. (2009), Mixed membership stochastic blockmodels, in ‘Advances in Neural Information Processing Systems’, pp. 33-40. [ Links ]

Albert, J. H. & Chib, S. (1993), ‘Bayesian analysis of binary and polychotomous response data’, Journal of the American Statistical Association 88(422), 669-679. [ Links ]

Aldous, D. J. (1985), Exchangeability and related topics, Springer. [ Links ]

Barabási, A.-L. & Albert, R. (1999), ‘Emergence of scaling in random networks’, Science 286(5439), 509-512. [ Links ]

Bender, E. A. & Canfield, E. R. (1978), ‘The asymptotic number of labeled graphs with given degree sequences’, Journal of Combinatorial Theory, Series A 24(3), 296-307. [ Links ]

Bollobás, B. (1998), Random graphs, Springer. [ Links ]

Borg, I. & Groenen, P. J. (2005), Modern multidimensional scaling: Theory and applications, Springer Science & Business Media. [ Links ]

Chung, F. & Lu, L. (2006), Complex graphs and networks, Vol. 107, American Mathematical society Providence. [ Links ]

Crane, H. (2018), Probabilistic foundations of statistical network analysis, CRC Press. [ Links ]

Durante, D., Dunson, D. B. et al. (2018), ‘Bayesian inference and testing of group differences in brain networks’, Bayesian Analysis 13(1), 29-58. [ Links ]

Erdös, P. & Rényi, A. (1959), ‘On random graphs’, Publicationes Mathematicae 6(290-297), 5. [ Links ]

Erdös, P. & Rényi, A. (1960), ‘On the evolution of random graphs’, Publ. Math. Inst. Hung. Acad. Sci 5, 17-61. [ Links ]

Erdös, P. & Rényi, A. (1961), ‘On the strength of connectedness of a random graph’, Acta Mathematica Hungarica 12(1-2), 261-267. [ Links ]

Fortunato, S. (2010), ‘Community detection in graphs’, Physics reports 486(3), 75-174. [ Links ]

Frank, O. & Strauss, D. (1986), ‘Markov graphs’, Journal of the American Statistical Association 81(395), 832-842. [ Links ]

Gamerman, D. & Lopes, H. F. (2006), Markov chain Monte Carlo: stochastic simulation for Bayesian inference, CRC Press. [ Links ]

Gelman, A., Hwang, J. & Vehtari, A. (2014), ‘Understanding predictive information criteria for Bayesian models’, Statistics and Computing 24(6), 997-1016. [ Links ]

Gelman, A. & Rubin, D. (1992), ‘Inferences from iterative simulation using multiple sequences’, Statistical Science 7, 457-472. [ Links ]

Gilbert, E. (1959), ‘Random graphs’, The Annals of Mathematical Statistics pp. 1141-1144. [ Links ]

Goldenberg, A., Zheng, A., Fienberg, S. & Airoldi, E. (2010), ‘A survey of statistical network models’, Foundations and Trends in Machine Learning 2(2), 129-233. [ Links ]

Green, P. J. & Hastie, D. I. (2009), ‘Reversible jump MCMC’, Genetics 155(3), 1391-1403. [ Links ]

Guhaniyogi, R. & Rodriguez, A. (2020), ‘Joint modeling of longitudinal relational data and exogenous variables’, Bayesian Analysis . [ Links ]

Han, Q., Xu, K. & Airoldi, E. (2015), Consistent estimation of dynamic and multi-layer block models, in ‘International Conference on Machine Learning’, pp. 1511-1520. [ Links ]

Handcock, M. S., Raftery, A. E. & Tantrum, J. M. (2007), ‘Model-based clustering for social networks’, Journal of the Royal Statistical Society: Series A (Statistics in Society) 170(2), 301-354. [ Links ]

Handcock, M. S., Robins, G., Snijders, T., Moody, J. & Besag, J. (2003), Assessing degeneracy in statistical models of social networks, Technical report, Citeseer. [ Links ]

Hoff, P. D. (2005), ‘Bilinear mixed-effects models for dyadic data’, Journal of the American Statistical Association 100(469), 286-295. [ Links ]

Hoff, P. D. (2008), Modeling homophily and stochastic equivalence in symmetric relational data, in ‘Advances in Neural Information Processing Systems’, pp. 657-664. [ Links ]

Hoff, P. D. (2009), ‘Multiplicative latent factor models for description and prediction of social networks’, Computational and Mathematical Organization Theory 15(4), 261-272. [ Links ]

Hoff, P. D. (2015), ‘Multilinear tensor regression for longitudinal relational data’, The Annals of Applied Statistics 9(3), 1169. [ Links ]

Hoff, P. D., Raftery, A. E. & Handcock, M. S. (2002), ‘Latent space approaches to social network analysis’, Journal of the American Statistical Association 97(460), 1090-1098. [ Links ]

Hoover, D. N. (1982), ‘Row-column exchangeability and a generalized model for probability’, Exchangeability in probability and statistics (Rome, 1981) pp. 281-291. [ Links ]

Ishwaran, H. & Zarepour, M. (2000), ‘Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models’, Biometrika 87(2), 371-390. [ Links ]

Kemp, C., Tenenbaum, J. B., Griffiths, T. L., Yamada, T. & Ueda, N. (2006), Learning systems of concepts with an infinite relational model, in ‘AAAI’, Vol. 3, p. 5. [ Links ]

Kim, B., Lee, K. H., Xue, L. & Niu, X. (2018), ‘A review of dynamic network models with latent variables’, Statistics surveys 12, 105. [ Links ]

Kolaczyk, E. D. (2009), Statistical Analysis of Network Data: Methods and Models, Springer Series in Statistics, Springer. [ Links ]

Kolaczyk, E. D. & Csárdi, G. (2020), Statistical analysis of network data with R, 2nd edn, Springer. [ Links ]

Krivitsky, P. N. & Handcock, M. S. (2008), ‘Fitting latent cluster models for networks with latentnet’, Journal of Statistical Software 24(5). [ Links ]

Krivitsky, P. N., Handcock, M. S., Raftery, A. E. & Hoff, P. D. (2009), ‘Representing degree distributions, clustering, and homophily in social networks with latent cluster random effects models’, Social networks 31(3), 204-213. [ Links ]

Lau, J. W. & Green, P. J. (2007), ‘Bayesian model-based clustering procedures’, Journal of Computational and Graphical Statistics 16(3), 526-558. [ Links ]

Li, W.-J., Yeung, D.-Y. & Zhang, Z. (2011), Generalized latent factor models for social network analysis, in ‘Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI), Barcelona, Spain’. [ Links ]

Linkletter, C. D. (2007), Spatial process models for social network analysis, PhD thesis, Simon Fraser University. [ Links ]

Lusher, D., Koskinen, J. & Robins, G. (2012), Exponential random graph models for social networks: Theory, methods, and applications, Cambridge University Press. [ Links ]

Minhas, S., Hoff, P. D. & Ward, M. D. (2019), ‘Inferential approaches for network analysis: Amen for latent factor models’, Political Analysis 27(2), 208-222. [ Links ]

Newman, M. (2010), Networks: An Introduction, Oxford University Press. [ Links ]

Newman, M. & Watts, D. J. (1999), ‘Scaling and percolation in the small-world network model’, Physical Review E 60(6), 7332. [ Links ]

Nowicki, K. & Snijders, T. (2001), ‘Estimation and prediction for stochastic blockstructures’, Journal of the American Statistical Association 96(455), 1077-1087. [ Links ]

Paez, M. S., Amini, A. A. & Lin, L. (2019), ‘Hierarchical stochastic block model for community detection in multiplex networks’, arXiv preprint arXiv:1904.05330. [ Links ]

Polson, N. G., Scott, J. G. & Windle, J. (2013), ‘Bayesian inference for logistic models using Pólya-Gamma latent variables’, Journal of the American Statistical Association 108(504), 1339-1349. [ Links ]

Raftery, A. E. (2017), ‘Comment: Extending the latent position model for networks’, Journal of the American Statistical Association 112(520), 1531-1534. [ Links ]

Raftery, A. E., Niu, X., Hoff, P. D. & Yeung, K. Y. (2012a), ‘Fast inference for the latent space network model using a case-control approximate likelihood’, Journal of Computational and Graphical Statistics 21(4), 901-919. [ Links ]

Raftery, A. E., Niu, X., Hoff, P. D. & Yeung, K. Y. (2012b), ‘Fast inference for the latent space network model using a case-control approximate likelihood’, Journal of Computational and Graphical Statistics 21(4), 901-919. [ Links ]

Rastelli, R., Friel, N. & Raftery, A. E. (2015), ‘Properties of latent variable network models’, arXiv preprint arXiv:1506.07806. [ Links ]

Regueiro Martinez, P. (2017), Scalable, Hierarchical and Dynamic Modeling of Communities in Networks, PhD thesis, UC Santa Cruz. [ Links ]

Robins, G., Pattison, P., Kalish, Y. & Lusher, D. (2007), ‘An introduction to exponential random graph p* models for social networks’, Social networks 29(2), 173-191. [ Links ]

Salter-Townshend, M. & McCormick, T. H. (2017), ‘Latent space models for multiview network data’, The Annals of Applied Statistics 11(3), 1217. [ Links ]

Salter-Townshend, M. & Murphy, T. B. (2013), ‘Variational bayesian inference for the latent position cluster model for network data’, Computational Statistics & Data Analysis 57(1), 661-671. [ Links ]

Schweinberger, M. & Snijders, T. (2003), ‘Settings in social networks: A measurement model’, Sociological Methodology 33(1), 307-341. [ Links ]

Scott, J. (2000), Social network analysis: A handbook, 2 edn, SAGE Publications. [ Links ]

Sewell, D. K. & Chen, Y. (2015), ‘Latent space models for dynamic networks’, Journal of the American Statistical Association 110(512), 1646-1657. [ Links ]

Snijders, T. (2002), ‘Markov chain monte carlo estimation of exponential random graph models’, Journal of Social Structure 3(2), 1-40. [ Links ]

Snijders, T. (2011), ‘Statistical models for social networks’, Annual Review of Sociology 37, 131-153. [ Links ]

Sosa, J. & Rodriguez, A. (2017), ‘A latent space model for cognitive social structures data’, arXiv preprint arXiv:1711.03662. [ Links ]

Sosa, J. & Rodriguez, A. (2018), ‘A record linkage model incorporating relational data’, arXiv preprint arXiv:1808.04511. [ Links ]

Sosa, J. & Rodriguez, A. (2019), ‘A bayesian approach for de-duplication in the presence of relational data’, arXiv preprint arXiv:1909.06519. [ Links ]

Spiegelhalter, D. J., Best, N. G., Carlin, B. P. & Linde, A. (2014), ‘The deviance information criterion: 12 years on’, Journal of the Royal Statistical Society: Series B (Statistical Methodology) 76(3), 485-493. [ Links ]

Spiegelhalter, D. J., Best, N. G., Carlin, B. P. & Van Der Linde, A. (2002), ‘Bayesian measures of model complexity and fit’, Journal of the Royal Statistical Society: Series B (Statistical Methodology) 64(4), 583-639. [ Links ]

Sweet, T. M., Thomas, A. C. & Junker, B. W. (2013), ‘Hierarchical network models for education research: Hierarchical latent space models’, Journal of Educational and Behavioral Statistics 38(3), 295-318. [ Links ]

Wang, L., Zhang, Z. & Dunson, D. (2019), ‘Common and individual structure of brain networks’, The Annals of Applied Statistics 13(1), 85-112. [ Links ]

Wasserman, S. & Faust, K. (1994), Social Network Analysis: Methods and Applications, Vol. 8, Cambridge University Press. [ Links ]

Wasserman, S. & Pattison, P. (1996), ‘Logit models and logistic regressions for social networks:I. an introduction to markov graphs and p*’, Psychometrika 61(3), 401-425. [ Links ]

Watanabe, S. (2010), ‘Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory’, Journal of Machine Learning Research 11(Dec), 3571-3594. [ Links ]

Watanabe, S. (2013), ‘A widely applicable Bayesian information criterion’, Journal of Machine Learning Research 14(Mar), 867-897. [ Links ]

Watts, D. J. & Strogatz, S. H. (1998), ‘Collective dynamics of small-world networks’, Nature 393(6684), 440-442. [ Links ]

Xu, Z., Tresp, V., Yu, K. & Kriegel, H. P. (2006), ‘Learning infinite hidden relational models’, Uncertainity in Artificial Intelligence (UAI2006). [ Links ]

a Ph.D. E-mail: jcsosam@unal.edu.co

b Ph.D. (c). E-mail: labuitragor@unal.edu.co

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License