<?xml version="1.0" encoding="ISO-8859-1"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id>0120-3584</journal-id>
<journal-title><![CDATA[Desarrollo y Sociedad]]></journal-title>
<abbrev-journal-title><![CDATA[Desarro. soc.]]></abbrev-journal-title>
<issn>0120-3584</issn>
<publisher>
<publisher-name><![CDATA[Universidad de los Andes]]></publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id>S0120-35842014000200007</article-id>
<article-id pub-id-type="doi">10.13043/DYS.74.6</article-id>
<title-group>
<article-title xml:lang="en"><![CDATA[The Effects of Bullying on Academic Achievement]]></article-title>
<article-title xml:lang="es"><![CDATA[Desempeño académico y ambiente escolar: efecto de la intimidación]]></article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname><![CDATA[van der Werf]]></surname>
<given-names><![CDATA[Cynthia]]></given-names>
</name>
<xref ref-type="aff" rid="A01"/>
</contrib>
</contrib-group>
<aff id="A01">
<institution><![CDATA[,Universidad de los Andes  ]]></institution>
<addr-line><![CDATA[Bogotá ]]></addr-line>
<country>Colombia</country>
</aff>
<pub-date pub-type="pub">
<day>00</day>
<month>12</month>
<year>2014</year>
</pub-date>
<pub-date pub-type="epub">
<day>00</day>
<month>12</month>
<year>2014</year>
</pub-date>
<numero>74</numero>
<fpage>275</fpage>
<lpage>308</lpage>
<copyright-statement/>
<copyright-year/>
<self-uri xlink:href="http://www.scielo.org.co/scielo.php?script=sci_arttext&amp;pid=S0120-35842014000200007&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.co/scielo.php?script=sci_abstract&amp;pid=S0120-35842014000200007&amp;lng=en&amp;nrm=iso"></self-uri><self-uri xlink:href="http://www.scielo.org.co/scielo.php?script=sci_pdf&amp;pid=S0120-35842014000200007&amp;lng=en&amp;nrm=iso"></self-uri><abstract abstract-type="short" xml:lang="en"><p><![CDATA[This document analyzes the effect of bullying on student performance in the short and in the long term. The level of bullying is estimated from the answers of 9th grade students in Saber test (2005-2006), while student performance is measured both in Saber 9º test (short term) and Saber 11º, a standardized test answered by students two years later (long term). Because of the existence of reverse causality, the relationship is estimated through instrumental variables. The results suggest that a one standard deviation increase in the within-school level of bullying decreases individual test score by 0.55 standard deviations in Saber 9º and by 0.4 standard deviation in Saber 11º. Furthermore, the results indicate that bullying's effect is stronger for younger students in the short term but that there are no differences by gender. However, in the long run the existing differences disappear. Additionally, this document finds that there are differences in the relationship between the level of bullying and academic performance depending on student's academic achievement.]]></p></abstract>
<abstract abstract-type="short" xml:lang="es"><p><![CDATA[Este artículo evalúa el efecto de la intimidación escolar sobre el desempeño de los estudiantes en las pruebas Saber 9º y 11º. El nivel de intimidación proviene del número de casos de intimidación reportados en el módulo de competencias ciudadanas de la prueba Saber 9º, mientras que el desempeño académico se mide tanto en la prueba Saber 9º (corto plazo) como en la prueba Saber 11º (largo plazo). Ante la posibilidad de doble causalidad, se utiliza el método de variables instrumentales, y se encuentra que un aumento en una desviación estándar en el nivel de intimidación en el colegio disminuye el resultado de la prueba Saber 9º en cerca de 0,55 desviaciones estándar, mientras que disminuye el resultado de la prueba Saber 11º en aproximadamente 0,4 desviaciones estándar. Además, los resultados muestran la existencia de efectos heterogéneos en el efecto de la intimidación por edad del estudiante en el corto plazo y por el desempeño académico en el corto y en el largo plazo.]]></p></abstract>
<kwd-group>
<kwd lng="en"><![CDATA[Bullying]]></kwd>
<kwd lng="en"><![CDATA[academic achievement]]></kwd>
<kwd lng="en"><![CDATA[Saber 9º and 11º tests]]></kwd>
<kwd lng="es"><![CDATA[Intimidación escolar]]></kwd>
<kwd lng="es"><![CDATA[desempeño académico]]></kwd>
<kwd lng="es"><![CDATA[pruebas Saber 9º y 11º]]></kwd>
</kwd-group>
</article-meta>
</front><body><![CDATA[  <font face="verdana" size="2">     <p>DOI: <a href="http://dx.doi.org/10.13043/DYS.74.6" target="_blank">10.13043/DYS.74.6</a></p>     <p>&nbsp;</p>     <p align = "center"><font size = "4"><b>The Effects of Bullying on Academic Achievement</b></font></p>     <p>&nbsp;</p>     <p align = "center"><font size = "3"><b><i>Desempe&ntilde;o acad&eacute;mico y ambiente escolar: efecto de la intimidaci&oacute;n</i></b></font></p>     <p align = "center">&nbsp;</p>     <p>Cynthia van der Werf<sup>1</sup></p>     <p>1 Universidad de los Andes. Bogot&aacute;, Colombia. I am grateful to Catherine Rodriguez for her advice, to Enrique Chaux and Sara Schodt for their valuable comments, and to Fabio S&aacute;nchez and Meliza Castellanos for their help in accessing Saber 5&ordm; y 9&ordm; data.</p>     <p>Este art&iacute;culo fue recibido el 8 de abril de 2014; revisado el 22 de agosto de 2014 y, finalmente aceptado el 8 de octubre de 2014.</p> <hr size = "1" />     ]]></body>
<body><![CDATA[<p><b>Abstract</b></p>     <p>This document analyzes the effect of bullying on  student performance in the short and in the long term. The level of bullying is  estimated from the answers of 9<sup>th</sup> grade students  in Saber test (2005-2006), while student performance is measured both in Saber 9&ordm; test (short term) and Saber  11&ordm;, a standardized test answered by students two years later (long term).  Because of the existence of reverse causality, the relationship is estimated  through instrumental variables. The results suggest that a one standard deviation  increase in the within-school level of bullying decreases individual test score by  0.55 standard deviations in Saber 9&ordm; and by 0.4 standard deviation in Saber 11&ordm;.  Furthermore, the results indicate that bullying's effect is stronger for  younger students in the short term but that there are no differences by gender.  However, in the long run the existing differences disappear. Additionally, this  document finds that there are differences in the relationship between the level  of bullying and academic performance depending on student's academic  achievement.</p>     <p><b><i>Key words</i>:</b> Bullying, academic achievement, Saber 9&ordm; and 11&ordm; tests.</p>     <p><i>JEL classification</i>:  I21, I29.</p> <hr size = "1" />     <p><b>Resumen</b></p>     <p>Este  art&iacute;culo eval&uacute;a el efecto de la intimidaci&oacute;n escolar sobre el desempe&ntilde;o de los  estudiantes en las pruebas Saber 9&ordm; y 11&ordm;. El nivel de intimidaci&oacute;n proviene del  n&uacute;mero de casos de intimidaci&oacute;n reportados en el m&oacute;dulo de competencias ciudadanas  de la prueba Saber 9&ordm;, mientras que el desempe&ntilde;o acad&eacute;mico se  mide tanto en la prueba Saber 9&ordm; (corto plazo) como en la prueba Saber 11&ordm; (largo  plazo). Ante la posibilidad de doble causalidad, se utiliza el m&eacute;todo de variables  instrumentales, y se encuentra que un aumento en una desviaci&oacute;n est&aacute;ndar  en el nivel de intimidaci&oacute;n en el colegio disminuye el resultado de la prueba  Saber 9&ordm; en cerca de 0,55 desviaciones est&aacute;ndar, mientras que disminuye el  resultado de la prueba Saber 11&ordm; en aproximadamente 0,4 desviaciones est&aacute;ndar.  Adem&aacute;s, los resultados muestran la existencia de efectos heterog&eacute;neos en  el efecto de la intimidaci&oacute;n por edad del estudiante en el corto plazo y por el desempe&ntilde;o acad&eacute;mico en el corto y en el largo  plazo.</p>     <p><b><i>Palabras clave</i>:</b> Intimidaci&oacute;n escolar, desempe&ntilde;o acad&eacute;mico, pruebas Saber 9&ordm; y 11&ordm;.</p>     <p><i>Clasificaci&oacute;n JEL</i>:  I21, I29.</p> <hr size = "1" />     <p><b>Introduction</b></p>     <p>Schools are critical for individual development, as  they are the first place in which children undertake a formal learning process  that provides them with basic knowledge and thus enables them to discover and  deepen the skill they need to be successful and independent adults. The  result of this initial learning process determines both the probability of having  access to tertiary education as well as long-term outcomes such as future income.  For these reasons, it is essential to understand which factors within schools  directly influence the quality of education  that students experience and, consequently, their learning.</p>     ]]></body>
<body><![CDATA[<p>Bullying, a process in which one person repeatedly  uses his superior strength or influence to mistreat, attack or force another  person to do something, is one of the main problems of schools environment  (Unicef, 2007b). Examples of such behavior include derogatory comments, physical  assaults, and social exclusion, where the key factor is the existence of  power imbalance between the perpetrator and the victim. It is a serious  problem that can affect a child's school experience and one that has only recently begun  to receive attention. Besides affecting the self-esteem of the assaulted, it  often results in situations in which both victims and perpetrators miss learning  opportunities, diminishing the quality of their education and therefore their  academic performance.</p>     <p>According to the Olweus Bullying Prevention Center,  the foremost bullying prevention center worldwide, in 1983 the percentage of  bullying victims in Norway was close to 10%, however it rapidly increased  and by 2001 it had risen by 50%<sup><a href="#2a" name="2b">2</a></sup>. As in  Norway, according to the World Health Organization, in the past thirty years this phenomenon has grown  rapidly to rates between 10 and 15% worldwide (Craig and Harel, 2004). This  increase in the level of bullying has had negative consequences on students'  education and on their quality of life; for instance, Unicef (2007a) reports  that bullying decreases school attendance rates, contact with peers, and  academic achievement while it increases physical injuries and the incidence of  depression<sup><a href="#3a" name="3b">3</a></sup>. Furthermore, bullying decreases the motivation to study and  generates anxiety disorders (Chaux, 2012).</p>     <p>Economic literature supports the negative correlation  between bullying level and student performance on academic tests. Porta et  al. (2007) report a negative correlation between bullying incidence and academic  performance for more than 57 countries in Trends in International  Mathematics and Science Study (TIMSS). Additionally, Nansel et al. (2001) find  a negative relationship between the number of bullying episodes experienced and  academic achievement, suggesting that it is explained by poorer  relationships with peers and by the victim's inability to make friends. In this sense,  international evidence shows that schools and, specifically, school environment,  appear to critically affect academic performance, and consequently to determine  whether students can make the most of the learning opportunities throughout  their school life.</p>     <p>A graphic depiction of the relationship between bullying  and academic performance in Colombia is presented is <a href="#fig1">Figure 1</a>; it displays the  distribution of scores in Saber 9&ordm;, a standardized test for high  school freshmen in Colombia, divided by the level of bullying in their school<sup><a href="#4a" name="4b">4</a></sup>. In accordance with the existing literature, students from schools with higher  levels of bullying tend to have poorer results than students from schools with  medium or low levels of bullying.</p>     <p align="center"><a name="fig1"></a><img src="img/revistas/dys/n74/n74a07fig1.gif"></p>     <p>In Colombia, the level of bullying is as concerning as  in other countries. According to Chaux, Molano and Podlesky (2009), 29.1%  of fifth graders have been bullying victims while 14.7% of freshmen were  victimized during the two months preceding the survey. The high levels of  bullying episodes make it imperative to analyze the magnitude of the effect  of bullying on student learning in Colombia. In particular, it is important  to quantify the effect of bullying on learning, to understand whether strength  and power imbalances among students negatively impact their education, and  to what extent. Furthermore, understanding the extent and impact of bullying has  important public policy implication, such as estimating the potential  gains from expanding public programs like <i>"Aulas en Paz"</i><sup>5</sup> that seek to reduce bullying by  transforming perpetrators into leaders within schools and changing  third parties or observers  attitude towards bullying.</p>     <p>Although previous document such as Chaux et al. (2009)  have analyzed the determinants of bullying in Colombia, this paper  contributes to the literature because there is no other document that studies  bullying's effect on academic performance in the country, taking into account the  existence of reverse causality. Furthermore, there are few academic works that  establish the relationship between the level of intimidation and academic  performance at the international level, and those documents generally evaluate the  relationship leaving aside the existence of reverse causality<sup><a href="#6a" name="6b">6</a></sup>. The one exception is Mundbjerg, Nielsen and Simonsen (2014) that analyze the causal  relationship between bullying and test scores in Denmark.</p>     <p>This paper, contributes to the existing literature by  analyzing the effect of the school level of bullying on student performance in the  short and in the long term. The level of bullying is estimated from the  answers of 9<sup>th</sup> grade students in Saber test (2005-2006), while student performance  is measured both in Saber 9&ordm; test (short term) and Saber 11&ordm;, a standardized  test answered by students two years later (long term).<sup><a href="#7a" name="7b">7</a></sup> The estimation takes into account  both the existences of additional variables that determine  the level of bullying and academic performance, and the existence of reverse  causality.</p>     <p>The first section analyses the short-term effect of  the school level of bullying on academic performance, controlling for individual  characteristics such as gender, income and parental education, and school  level variables such as average socio-emotional characteristics of students.  In the long run however, the estimations only control for average income and  parental educational by school as there is no individual level information of  such variables. The OLS results indicate that the level of bullying has a  negative and significant effect in the short term at both the school and individual  levels but that it has no effect in the long term.</p>     <p>Nevertheless, because it is possible that the bullying  a student experiences is related to that student's prior academic achievement,  the relationship is also estimated through instrumental variables. To do so,  the standard deviation of the age of the students in each school is used as  an instrument, since an increase in this variable reflects higher  within-school differences in students' age and consequently larger differences in their  physical development. Thus, an increase in the standard deviation of age results  in a greater number of tall students that, as a result of their size, may be able  to intimidate their younger and shorter peers. Note that the standard deviation of  the age depends only on the date of birth of students, a random variable that  does not depend in any way on the students, their parents or the school and  therefore has no direct relationship with academic performance.</p>     ]]></body>
<body><![CDATA[<p>After controlling for the existence of reserve  causality, the results indicate that higher levels of bullying at school decrease  academic performance in both the short and the long term. In particular, a one  standard deviation increase in the level of bullying within-schools decreases individual  test score by 0.55 standard deviations in  Saber 9&ordm; and by 0.4 standard deviation in Saber 11&ordm;.</p>     <p>Additionally, as certain student characteristics may  make them more likely to be victims, it is important to analyze if there are  heterogeneous effects. The results indicate that in the short term the effect  of bullying is larger for younger students but that there and no differences by  gender. However, in the long run the existing differences disappear.  Furthermore, this document finds that there are differences in the relationship between  the level of bullying and academic performance depending on student's academic  achievement. In particular, in the short term the effect of bullying is higher for  students between the 30 and the 90th percentiles of the achievement  distribution while in the long run the effect is larger for those located bellow  the median, indicating changes in the behavior of victims and perpetrators.</p>     <p>The document is divided into six sections. Section I  contains a review of the literature; section II presents the data used, while  the methodology is presented in section III. Section IV and V present the  short-term and long-run results respectively. Section VI concludes.</p>     <p><b>I.  Literature Review</b></p>     <p>Firstly, it is necessary to establish which kinds of  behaviors within the school   are defined as bullying. Bauman (2008), based on  Olweus (1993), referred to   bullying as a phenomenon with three components: first,  there must be an   intention to harm; second, it is essential that this  happens repeatedly; finally,   there needs to be a power imbalance between the  perpetrator and the victim. Similarly, the "Olweus Bullying Prevention Program"<sup><a href="#8a" name="8b">8</a></sup> defines bullying as a process in which a person is exposed repeatedly to negative  actions by another one and is unable or finds it hard to defend him or herself.</p>     <p>According to the Olweus Bullying Prevention Program  there are nine types of bullying. The first one is verbal bullying, which  includes attacks through nicknames or derogatory comments; the second and third  types are physical assaults against an individual or his possessions. The  fourth type of bullying is through isolation or social exclusion; the fifth one  refers to aggression through lies, gossip and false rumors; the sixth is when  children are threatened to do things against their will; the seventh and eight are  racial and sexual bullying. Lastly, this prevention program includes cyber  bullying, through phones and internet, as a new type of aggression.</p>     <p>Regarding the magnitude of bullying, Chaux et al.  (2009) suggest that between ten and fifteen percent of adolescents worldwide are  bullied two or more times a month. In turn, Craig and Harel (2004) argue that it  is a phenomenon with a very high rate of variance around the world, as  between 2 and 32% of students are bullied two to three times a month when they are  15 years old, and between 6 and 36% when they are 11 years old. This  statistics suggest the existence of a large problem with high variations  across countries and therefore highlight the importance of studying the effects of  bullying in specific countries such as in Colombia.</p>     <p>With regard to the extent of bullying in Colombia,  Chaux et al. (2009) estimate, based on questions about bullying through physical and  verbal aggression in Saber tests (2005), that 29% of fifth grade  students are bullied, 22% bully their peers and 50% were aware that this happens  to their peers during the two months before the test. In 9<sup>th</sup> grade, the  percentage of bullied students decreases to 15%, the percentage identifying as  perpetrators diminishes to 20%, while the percentage of students that report  to observe this phenomenon amongst their peers increases to 57%.</p>     <p>It is worth noting that bullying is not an isolated  phenomenon, the majority of schools worldwide experience this type violence.  According to the World Bank, in 35% of the schools that took the TIMSS test  in 2007 there were no reported incidents in the eighth grade, in 27% there  was at least one reported incident, and in 38% there were two or more reported  bullying episodes during the previous month (Porta, 2007).</p>     <p>These results are particularly important, as the  authors show that there are statistically significant differences in worldwide results in the  math section of the TIMSS test as a result of the differences in the  number of incidents of bullying in the classroom during the month before the test in 8<sup>th</sup> grade. This finding supports the possibility that a negative relationship  between bullying level and academic performance of students exists. However, it  is worth noting that this study only shows correlations and therefore does not  establish the causality of the relationship between academic performance and  intimidation.</p>     ]]></body>
<body><![CDATA[<p>With regards to the international evidence on this  relationship, Roman and Murillo (2011), employ a hierarchical model, finding  that aggression in schools has a negative effect on academic achievement in Latin  America. In particular, the authors affirm that students who have been robbed  or physically or verbally abused perform less well in math and language on the  Second Regional Comparative and Explanatory test conducted by Unesco  in 2005 and 2009.</p>     <p>Furthermore, Brown and Taylor (2008) report that  bullying has a negative effect on human capital accumulation and on labor  market outcomes in England. The authors use the <i>National Child Development  Study </i>database,  NCDS, which contains information on education, work and  family environment for all children born between the third and the ninth of  March 1958; moreover, in this database mothers answer questions about the  level of bullying their children experienced at seven and eleven years.</p>     <p>Brown and Taylor (2008) use an ordered probit model to  predict the probability of being in given grade, in a given time period, based  on the level of bullying experienced by each individual at that period; they  control by the quality of the school, the family environment and student ability.  Their main result is that an increase in one standard deviation in the level of  bullying to which a child is exposed at age 11 increases the likelihood of failing  all secondary education examinations by 1.7 %, where the magnitude of the  effect depends positively on the proximity between the bullying episode and the  test. Their results are robust to controlling for educational level, previous  academic achievement, height, weight and personality characteristics of  students as well as household characteristics. However, it is worth noting that the  authors don't control for the existence of reverse causality in their estimates.</p>     <p>Likewise, Mundbjerg et al. (2014) analyze the causal  relationship between bullying in elementary in school and future outcomes in  Denmark, establishing that bullied children have lower academic achievement  in 9<sup>th</sup> grade and that the effects are larger when bullying episodes are more  severe. The authors use the <i>Aarhus Birth Cohort </i>database<i>, </i>ABC, which  contains information on academic achievement in 9<sup>th</sup> grade and bullying incidence from  two sources, parents and teachers, for all children born in Aarhus, Denmark,  between 1990 and 1992.</p>     <p>An important note is that the ABD database contains  information on parent's criminal history, which enables Mundbjerg et al.  (2014) to calculate the proportion of the child's classroom peers whose  parents have a criminal conviction. The authors then use that index as an instrument and  thus estimate the causal effect of bullying on academic achievement  through instrumental variables. They find that and increase in a one  standard deviation in individual exposure to bullying reduces academic achievement in  over 10% of a standard deviation.</p>     <p>Along the same lines, Le, Miller and Heath (2005),  estimate the effect of having a conduct disorder on the probability of dropping out  of school<sup><a href="#9a" name="9b">9</a></sup>. To do so, the authors use information on family background,  demographic variables and behavioral variables such as bullying, theft, and  physical violence from the Australian Twins Registry. It is worth noting that  this dataset is a volunteer sample of siblings in Australia that contains  information about behavior problems and family labor market outcomes for 4,264  twin pairs born between 1961 and 1974.</p>     <p>Le et al. (2004) estimate the impact of being an  aggressor on dropouts through a logit model with fixed effects, finding that children  with higher behavioral problems are more likely to leave school early. Their  results suggest the existence of heterogeneous effects where, among other behavioral  problems, stealing, leaving home without permission, and  bullying or fighting with their peers, have the greatest negative impact on education  and employment. Additionally, the authors study the relationship between behavioral  problems and labor market performance, finding that the former has  a negative effect on labor market performance.</p>     <p>As to the specific ways through which bullying can  affect academic performance, Smith, Talamelli, Cowie, Naylor and Chauhan (2004)  study the profile of the bullying victims from interviews in two time  periods. Their results show that school attendance negatively depends on the  level of bullying to which each student is exposed to; those students who have  never been bullied by their peers have the highest rate of school attendance  while those who were victims of bullying at both moments in the interviews  spent 4.55% less time in school<sup><a href="#10a" name="10b">10</a></sup>. A second way  in which bullying can have a negative effect on performance is through lower peer effects because,  according to Brown and Taylor (2008), victims have fewer friends and worse  relationships with their peers and therefore fewer opportunities to learn from  them.</p>     <p>Regarding the institutional characteristics that  explain the negative effect of bullying, it is important to acknowledge that in  schools with higher levels of bullying, classroom climate hinders learning  process because students live in an environment of teasing, stress and anger, all of  which negatively affect their ability to learn (Chaux, 2012). Furthermore, this type  of environment decreases student motivation and prevents students from participating  and asking questions in class because they are scared of the reaction of  their peers.</p>     <p>According to the above finding, although international  evidence posits the existence of a negative relationship between the level  of bullying and academic performance both for developed and developing  countries, this paper contributes to the literature as it quantifies the  relationship between these variables after controlling by the existence of  reverse causality. In this sense, the paper adds to the literature by estimating the  relationship without the negative bias on the magnitude of effect that comes  from the fact that bullying is aimed at students with depending on their academic  performance in a developing country.</p>     ]]></body>
<body><![CDATA[<p><b>II. Data</b></p>     <p><b>A.  Content Knowledge Tests: Saber 9&ordm; and Saber 11&ordm;</b></p>     <p>In 2005 and 2006, every student in 9<sup>th</sup> grade in  Colombia took a test called   Saber 9&ordm;, which sought to measure the school level  performance in language,   mathematics, science, and social studies in order to  make recommendations at the institutional level. During the test, freshmen  answered 12 questions   in each area that add up to a total of 48 questions  from which an individual   average knowledge score was built and then  standardized such that its mean   is zero and its standard deviation one. It is  important to mention that there   were three questionnaires in this test but the results  are only available for two   of the three questionnaires. Furthermore, the  individual results on the content   knowledge component of a restricted sample that  included specific bullying   questions - explained in detail in the next section -  are not available.</p>     <p>Two years later, in the second semester of 2007 and  the first semester of 2008, the same cohort of students took a second test called  Saber 11&ordm;. This test is an official requirement that all seniors students must  take in order to graduate from high school; its main objective is to measure the  skills of senior students in order to provide universities and other tertiary  education institutions with a measure of the abilities of each individual in  seven different areas. It is important to stress that, although the students  from the same cohorts took this second test, as there are not name records in  Saber 9&ordm;, it is impossible to know if some students dropped out of school, finished  high school in a different institution, or if there are new students in the  existing schools.</p>     <p>An important note on the interpretation of the results  is that, as the average score of Saber 11&ordm; varies between semesters, the test  results have been standardized by semester so that they are comparable: the average  score of each area and the general score is zero and its standard  deviation is one.</p>     <p><b>B.  Bulling Level</b></p>     <p>Saber 9&ordm; test contained a second part which contained  45 questions on citizenship   competencies that included integrative skills,  democratic environments,   socio-emotional and cognitive skills. The first part  included questions   on attitudes and actions of students, trust and  empathy, and three additional   questions regarding attitudes against citizenship  competencies such as bullying   in the first questionnaire, cheating in the second  one, and piracy in the   third one<sup><a href="#11a" name="11b">11</a></sup>. It is  important to stress that the students answered this set of   questions knowing that individual results would never  reach their teachers, directors or classmates, allowing them to honestly report  the level of aggression   to which they were exposed.</p>     <p>Regarding the bullying level, the test measures the  level of aggression within school by asking students about the number of insults  they have experienced, the number of times they have been beaten, and the  number of times they have been excluded by their classmates during the past  week. Additionally, the first questionnaire, asked only to a restricted  sampled, inquired about repeated power imbalance by giving asking students three  questions about the following hypothetical situation:</p>     <blockquote>       <p>Some people often feel really bad because they are  frequently beaten     or insulted by others. For example, Fanny and Gabriel  bother Marcos     all the time. At the beginning they took his food,  then they began to     steal and damage his stuff and now they hit him and  tease him. Marcos     is very afraid, he feels very bad, and wants to skip  school more     every day.</p> </blockquote>     ]]></body>
<body><![CDATA[<p>To measure the incidence of bullying, the  questionnaire asked each student if they had been beaten or teased and had felt powerless  like Marcos during the past two months; if they had seen situations like  those in their classroom; or, if they had acted like Fanny and Gabriel during the  same period of time.</p>     <p>Based on the above information, it is possible to  establish whether each student was bullied, bullied another, both or neither.  However, as there is no record of the name of each student it is impossible to match  those records with individual test scores, implying that the results can only be  used to determine the effect of bullying over academic achievement at the  aggregate level.</p>     <p><a href="#tab1">Table 1</a> shows that in 9<sup>th</sup> grade 15% of students are bullied  by their peer. It also indicates that the most common source aggression for  freshman is through insults, followed by similar levels of physical  violence and social exclusion. It is worth mentioning that, as stated before, the level  of bullying was only measured in the first questionnaire of the citizenship  competencies module and thus, it is only possible to measure it at the school  level. Furthermore, as there is no individual measures of aggression in Saber 11&ordm;,  in the long run aggression levels are measured by the percentage of children that  where insulted, beaten or  excluded once or more in Saber 9&ordm;.</p>     <p align="center"><a name="tab1"></a><img src="img/revistas/dys/n74/n74a07tab1.gif"></p>     <p><b>C.  Individual, Household, and School Level Characteristics</b></p>     <p>A discrete age variable is used both to control by  student's age and to calculate   the standard deviation of age within school. In Saber  9&ordm;, the variable   comes from a categorical question while in Saber 11&ordm;,  a discrete variable is   built from the date of birth and test date of each  student; in both datasets   average students' age is used to exclude education  institutions for adults from   the estimations.</p>     <p>Regarding socio-economical characteristics, Saber 9&ordm;  includes information on mothers' education and household income. Mothers'  educational information can be grouped into three categorical variables:  elementary education or less, secondary education, and tertiary education; household  quartiles come from an income index constructed with 5 assets and two  services<sup><a href="#12a" name="12b">12</a></sup>. These variables are used at the individual level as controls in the  short run estimation.</p>     <p>Regarding the conditions of households and schools,  <a href="#tab2">Table 2</a> indicates that students were on average 15 to 17 years when they took  Saber 9&ordm; and 11&ordm; respectively. Additionally, most students in the  sample come from mixed-sex schooled, followed by female schools and lastly by  male schools. Finally, it is worth mentioning that 39 % of mothers have complete or  incomplete secondary education, 32% received primary education or less, and  29% of mothers started or finished university.</p>     <p align="center"><a name="tab2"></a><img src="img/revistas/dys/n74/n74a07tab2.gif"></p>     <p>In the long run however, as there is no information on  mother's education and household income in Saber 11&ordm;, average  socio-economical information at the school level  from Saber 9&ordm; are used.</p>     ]]></body>
<body><![CDATA[<p>Furthermore, as the module of citizenship competencies  in Saber 9&ordm; included measures of socio-emotional characteristics such as  trust, empathy, and intention interpretation, and family and neighborhood  environment, these variables are used to control by school level attitudes, and by  average violence and segregation in student's environment both in the short and in the  long run.</p>     <p><b>III.  Methodology</b></p>     <p>To measure the impact of the average level of bullying  in each school over average   academic  achievement in the short run, we run regressions of the form</p>       <p><a name="for1"></a><img src="img/revistas/dys/n74/n74a07for1.gif"></p>     <p>where <i>Y</i><i><sub>jkt</sub> </i>is the average score in Saber 9&ordm; for school <i>j</i>, in time <i>t</i>, and district <i>k</i>; <i>I</i><i><sub>jt</sub> </i>is the level of bullying in school  j which is measured as the percentage   of children that report to have been bullied during  the past two months in the   same test; <i>C</i><i><sub>jt</sub> </i>is a vector including a constant  and school control variables   such as school size, the percentage of males in the  student population, average   violence within school, average school income level,  average mother education,   average socio-emotional characteristics, average  household and neighborhood   environment, whether the school is rural or urban, and  whether the   school is public or private.</p>     <p>In order to analyze the effect of the average level of  bullying in each school over the individual academic achievement, we also run</p>     <p><a name="for2"></a><img src="img/revistas/dys/n74/n74a07for2.gif"></p>     <p>where <i>Y</i><i><sub>ijtk</sub> </i>is the average score in Saber 9&ordm; for individual i in  school j; <i>I</i><i><sub>jt</sub> </i>is   the level of bullying in school j. <i>X</i><i><sub>it</sub> </i>is a vector including a constant  and individual   control variables such as gender, age, the number of  times the person   has been beaten, insulted and rejected by their peer,  their mother's education   and their income level in the short run<sup><a href="#13a" name="13b">13</a></sup>. Additionally, <i>C</i><i><sub>jt</sub> </i>is a vector including   school control variables such as school size, average  socio-emotional characteristics,   average household and neighborhood environment,  whether the   school is rural or urban, and whether the school is  public or private.</p>     <p>Regarding the included control variables, average  socio-emotional characteristics are taken into account because, according to Chauhan  et al. (2004), bullying victims have trouble getting along with their peers  and therefore they miss on learning opportunities. Furthermore, the  average level of violence in each student's house and neighborhood are included  as controls because Baldry (2003) states that bullying peers is highly  correlated with household violence which  also affects school achievement.</p>     <p>Moreover, in Colombia Chaux et al. (2009) state that  socio-emotional characteristics, family and school environment determine the level of  bullying in school. Firstly, the authors state that the level  of bullying is higher for male schools, private school and those situated in  urban areas. Then, the authors determine that the family has a fundamental  impact on student's performance through their beliefs and behavior.  Regarding the socio-emotional determinants, the authors indicate that lower levels  of empathy, trust and anger management, as well as beliefs that support  aggressive responses increase the level of bullying. Finally, it is worth  noting that, as violence in the neighborhood raises so does violence within schools.  Thus, all regression control by for socio-emotional characteristics of individuals,  family background and neighborhood conditions, and by more standard  variables such as type and school location.</p>     ]]></body>
<body><![CDATA[<p>The effect of the level of bullying over average  academic achievement in the long run is  estimated through regressions of this form</p>     <p><a name="for3"></a><img src="img/revistas/dys/n74/n74a07for3.gif"></p>     <p>where <i>Y</i><i><sub>ijtk</sub> </i>is the average score in Saber 11&ordm; for school j; <i>I</i><i><sub>jt</sub></i><sub>-1</sub> is the level  of   bullying in school j measured in Saber 9&ordm;. <i>C</i><i><sub>jt</sub> </i>is a vector including a constant   and school control variables measured in Saber 11&ordm;  such as school size, the   percentage of males in the student population, whether  the school is rural or   urban, and whether the school is public or private and <i>D</i><i><sub>jt-</sub></i><sub>1</sub> includes  school   control variables from Saber 9&ordm; such as the average  household and neighborhood   characteristics, average level of aggression within  school, average school   income level, average mother education, average  socio-emotional characteristics,   and average family and neighbor environment.</p>     <p>Additionally, in order to measure the effect of the  level of bullying over individual academic achievement,  we run regressions of the form</p>     <p><a name="for4"></a><img src="img/revistas/dys/n74/n74a07for4.gif"></p>     <p>where <i>Y</i><i><sub>ijtk</sub> </i>is the average score in Saber 11&ordm; for individual i in  for school j; <i>I</i><i><sub>jt</sub></i> is the level of bullying in school j measured; <i>X</i><i><sub>it</sub> </i>is a vector including a constant   and individual control variables such as gender and  age. <i>C</i><i><sub>jt</sub> </i>is a vector   including a  constant and school control variables measured in Saber 11&ordm; such   as school size, the percentage of males in the student  population, whether the   school is rural or urban, and whether the school is  public or private and <i>D</i><i><sub>jt-</sub></i><sub>1</sub>   includes school control variables from Saber 9&ordm; such  as the average household   and neighborhood characteristics, average level of  aggression within school,   average school income level, average mother education,  average socio-emotional   characteristics, and average family and neighbor  environment<sup><a href="#14a" name="14b">14</a></sup>.</p>     <p>An important note is that, in order to control by  violence, inequality and poverty, as they directly determine the school environment and  the academic achievement of students, all estimations include  district fixed effect (<i>&micro;</i><i><sub>k</sub></i>).  Furthermore, according to Chaux et al. (2009), these variables  directly affect the number of bullying episodes within schools making it  imperative to control by them. Additionally, as the level of bullying is  constant within schools, the standard errors are clustered at school level.</p>     <p>Although there is no clear evidence in the literature  about the effect of academic achievement on bullying, it is likely that bullying is  directed towards students depending on their academic performance which  would bias the estimates. In particular, if the bullying is directed toward  students with higher academic level, the coefficients that measure the  average effect of bullying on school performance will be underestimated as these  students will counteract the effect of bullying on academic performance by  studying harder or as a result of their baseline skills.</p>     <p>To overcome the bias that results from the existence  of reverse causality between bullying and academic performance, the  instrumental variables method is used. According to Cameron and Trivedi  (2009), this method is consistent when the instrument is relevant and valid. In this  sense it is necessary to find a variable that is related to academic  performance only through bullying. The effect of bullying on academic performance would  then be estimated through the  following regressions:</p>     <p><a name="for5"></a><img src="img/revistas/dys/n74/n74a07for5.gif"></p>     ]]></body>
<body><![CDATA[<p><a href="#for5">Equation 5</a> is the first stage regression where <i>I<sub>jt</sub> </i>is the level of bullying in   school j which is measured as the percentage of  children that report to have   been bullied during the past two months in Saber 9&ordm;; <i>Z</i><i><sub>jt</sub> </i>is the instrument   variable; <i>X</i><i><sub>ijt</sub> </i>and <i>C<sub>jt</sub> </i>are the individual and school level  controls included in   <a href="#for2">Equation 2</a>.</p>     <p>The instrument used is the standard deviation of the  age of the students in each school, since an increase in this variable reflects  higher differences in students' age and thus greater differences in their physical and  emotional development. Therefore an increase in the standard deviation of age  results in higher number of older students who can intimidate their younger and  weaker peers.</p>     <p>Looking at the first stage results it is possible to  confirm if the instrument is relevant or if it is related to bullying by analyzing  whether the instrument significantly explains the variance of the endogenous  variable. With regards to the exclusion restriction, the standard deviation  of the age depends only on the date of birth of all students in the classroom,  a random variable that does not depend in any way of the student's decisions,  their parents or their schools'. It is worth noting that after controlling  for student's age, the date of birth of each student has no relationship with his  level of skills or knowledge, indicating that the standard deviation of age should  have no direct relation with the academic performance of students in school or  state tests.</p>     <p>Based to the above, the effect of the level of  bullying over individual academic achievement is  estimated by regressions of this form</p>     <p><a name="for6"></a><img src="img/revistas/dys/n74/n74a07for6.gif"></p>     <p>where <i>Y</i><i><sub>ijtk</sub> </i>is the average score in Saber 9&ordm; for individual i in  school j; <i>I<sub>jt</sub> </i>is   predicted level of bullying in school j from <a href="#for5">Equation  5</a>; <i>X<sub>ijt</sub> </i>and <i>C<sub>jt</sub> </i>are the   individual and school level controls included in  <a href="#for2">Equation 2</a>.</p>     <p>Finally, after estimating the unbiased coefficients  through instrumental variables, it is possible to analyze if there are differences in  the effect of bullying by age or gender. Additionally, it possible to analyze  if the relationship between test results and the level of intimidation  varies through the distribution of test scores  by using quintile regressions. It is important to mention that this method estimates the relationship between the  variables at different levels of Saber test scores, presenting a wider picture of the  relationship between bullying and academic achievement. This is especially relevant  because it grants the opportunity to analyze if the effect of bullying  is particularly perverse for those students in the right tail of the achievement  distribution or if the effect is greater for those on the left tail. Additionally,  as a result of the existence of reverse causality mentioned above, the differences in  the relationship of bullying and academic performance are especially relevant for  students at the ends of the distribution because they can be affected  at a greater extent as they may be more likely to be bullied or to face  stronger attacks.</p>     <p><b>IV. Short  Term Results: Bullying Effects Over Saber 9&ordm;</b></p>     <p><a href="#tab3">Table 3</a> summarizes the effect of bullying on academic  performance in Saber 9&ordm;   at the school level. The first column shows that,  after controlling for the percentage   of males in the student population, average violence  within school,   average school income level, region, type of school,  and district fixed effects,   an increase in one standard deviation in the level of  bullying decreases average scores in the Saber 9&ordm; test by 0.04 standard  deviations. However, when additional   controls such as mother education and average  socio-emotional characteristics   are included, the effect becomes smaller and  statistically insignificant.</p>       <p align="center"><a name="tab3"></a><img src="img/revistas/dys/n74/n74a07tab3.gif"></p>     ]]></body>
<body><![CDATA[<p>Regarding the results, it is worth noting that  according to Chaux et al. (2009), better conditions in the environment of the school  district, the school environment, as well as the socio-emotional conditions of student's  decrease the level of bullying to which students are exposed, while  directly improving their academic performance. In this sense, controlling for such  variables should reduce the effect as it actually does. Nevertheless, as  bullying may depend on the academic achievement of each student, the estimates  found may be biased, making it necessary to analyze the effect on  individual student results.</p>     <p>Taking account of the above, <a href="#tab4">Table 4</a> estimates the  effects of school bullying level on individual academic performance in the short  term, as measured by the Saber 9&ordm; test. Column one shows that as the  percentage of bullying victims increases in one standard deviation, the performance  of individual scores decreases by 0.04 standard deviations.</p>     <p align="center"><a name="tab4"></a><img src="img/revistas/dys/n74/n74a07tab4.gif"></p>     <p>The negative relationship between the level of  bullying and academic achievement is most likely explained by the fact that victims have  lower attendance rates, lower contact with their peers and higher  incidence of depression (Unicef, 2007a). Additionally, negative classroom atmosphere  hinders the learning process in schools with higher levels of bullying, as  students live in an environment of mocking, stress and anger, which decreases their  motivation (Chaux, 2012). It follows then that victims learn less as a  result of having less interest in studying, not only because they often miss school  but also because they learn less from their peers when they do attend  school. Furthermore, bullied students may not participate in class when they sense  a hostile school environment, because they are scared of their fellow classmates'  possible reactions.</p>     <p>However, in order to correctly infer the magnitude of  these effects, it is necessary to correct the bias that comes from the possibility  that academic performance influences the likelihood of being a victim of  bullying, where, if bullying is directed towards students with higher achievement  the coefficients will be biased downward, and if it directed towards  students with low academic achievement  the coefficients will be biased upwards.</p>     <p>In order to address this bias, the second column in  <a href="#tab4">Table 4</a> estimates the results by using the standard deviation of age in each  school as an instrumental variable, under the assumption that older and taller  students could possible bully those who are weaker because they are  shorter or younger. The magnitude of the effect is much larger: as the average  level of school bullying incidents increase by one standard deviation, the  performance of each of student  decreases by 0.55 standard deviations.</p>     <p>Of note from the results is the existence of a  negative bias on the effects of bullying, which means that victims of bullying are  students with better test results Saber 9&ordm; and consequently those who  probably got better grades throughout their time in school. This bias may be due  to the fact that students with better academic performance arouse envy from  their peers as a result of their performance. Another alternative is  that students with greater academic abilities tend to have fewer friends because  they tend to focus on their studies rather than on cultivating social  relationships, and in doing so become more vulnerable to attacks from their  classmates, as indicated by Brown and Taylor (2008).</p>     <p>With regards to the first stage, the standard  deviation of age is used as an instrument because a higher standard deviation results  from larger differences in age composition within the group and thus reflects  the unequal power relations between students that result from differences in their  age and subsequent physical and socio-emotional development. Groups with a  higher age standard deviation will have a greater number of students who  bully their peers because they are taller or stronger, as well as a larger  number of young students who can be easily victimized.</p>     <p><a href="#tab5">Table 5</a> shows the existence of a positive relationship  between the standard deviation of age and the percentage of bullying  victims within schools, indicating that it is a relevant instrument for estimating the  percentage of bullying episodes. With regards to the exclusion restriction,  the standard deviation of age depends on the date of birth of all students in  the school, a random variable that does not depend in any way of students or on  their parents' decisions. It is worth noting that after controlling for age  dummies, the date of birth of each student has no relationship to their level of  academic skills or knowledge, indicating that the standard deviation of age should  have no direct relation to the academic performance of students in the school or  to their performance on state tests, and thus that it is a valid instrument.  Furthermore, as the date of birth of each student does not determine his or her  personality, is not related with a student's ability to interact with their peers.<sup><a href="#15a" name="15b">15</a></sup></p>     <p align="center"><a name="tab5"></a><img src="img/revistas/dys/n74/n74a07tab5.gif"></p>     ]]></body>
<body><![CDATA[<p>However, two points are worth noting. First,  instrumental variables estimates   by design are local average effects. Therefore, and  due to the relatively low   predicting power of the instrument, the external  validity of the results may   be limited. Second, higher standard deviation on age  may result in differences   in cognitive development and maturity that may in turn  result in differences in   peer effects, beyond those captured by the age of each  student, thus biasing   the results.<sup><a href="#16a" name="16b">16</a></sup> Nevertheless,  the negative effect of bullying on academic achievement are consistent with the  causal effects estimated by Mundbjerg   et al. (2014).</p>     <p>Regarding the additional controls, nor mother's  education nor income nor gender affect the level of bullying. However, school type  does influence the amount of bullying: schools were boys attend have the highest  level of bullying, followed by school were both girls and boys attend and lastly  by school were only girls attend. An important result is that aggression,  measured by the number of insults they have experienced, the number of times  they have been beaten, and the number of times they have been excluded by  their classmates, has a positive and significant effect over bullying.  Moreover, schools with higher levels of school trust and empathy have lower levels  of bullying.</p>     <p><a href="#tab6">Table 6</a> analyses the existence of heterogeneous  effects on age and gender; in both cases the coefficient reflects the  differential effect of a one standard deviation increase in the percentage of bullying  estimated by the instrumental variables. Panel A reveals that the effect of the  average level of bullying within schools on academic performance is higher for  students who are below the average age for the school. One possible explanation  for this fact is that is that younger students are more likely to be bullied  and therefore more affected by the level of bullying within the school.  Panel B analyzes heterogeneous effects by gender and finds that there are no  statistically significant differences in the effect.</p>     <p align="center"><a name="tab6"></a><img src="img/revistas/dys/n74/n74a07tab6.gif"></p>     <p>Additionally, <a href="#fig2">Figure 2</a> analyses the differences on the  average effect of bullying by individual academic achievement. It shows that the  percentage of victims of bullying at a school has a negative effect on the  Saber 9&ordm; test score at all levels of academic performance, but it  indicates that the effect may be greater for those students between the 30 and 90th percentile. However, due to the large standard errors in the estimation such  difference may be statistically equal to zero.</p>     <p align="center"><a name="fig2"></a><img src="img/revistas/dys/n74/n74a07fig2.gif"></p>     <p>One possible explanation for the difference in the  result is that students with greater academic skills, top 10<sup>th</sup> percentile of the academic  achievement distribution, focus on their studies while students with lower  academic skills stop studying; it is also likely that both groups  reconfigure their relationships to spend time with friends with similar interests, as  in the case of High-Skills Afro-Descendants students in <i>An  economic analysis of "Acting White" </i>(Austen- Smith and Fryer, 2005).</p>     <p>In this scenario, the high achieving group would be  completely isolated from the rest of the class and the students in this group  focus primarily on studying and therefore are less affected by bullying, or the  cohesion as a group offsets the effect of bullying at a higher level of academic  engagement. On the other hand, a second group of students, those who are  between the 30 and the 90th percentile of  the performance distribution, decrease their academic performance to reduce the episodes of bullying against  them, resulting in the fact that the greatest effect on the level of bullying  is observed in the population near the median. A third group corresponds to the  students at the bottom of the achievement distribution, who isolates  themselves from the other students, probably focusing on other non-academic  interests, and as a results are less  exposed to bullying in their school.</p>     <p><b>V. Long  Run Results: Bullying Effect Over Saber 11&ordm;</b></p>     <p>Unlike the short-term results, in the long-term  bullying has no effect on the   average academic performance by school or at the  individual level as estimated   by OLS in <a href="#tab7">Table 7</a>. However, after correcting for the  bias that results from   reverse causality between bullying and academic  achievement, the results   indicate the existence of a negative and significant  effect two years after   the first test as shown in <a href="#tab8">Table 8</a>. The results also  indicate a negative bias   of the effect of bullying on the relationship between  the level of intimidation   and academic performance, where victims of bullying  are high-skill students   with better test results in the Saber 11<sup>th</sup>, and those who probably got better   grades  throughout their time in school.</p>       ]]></body>
<body><![CDATA[<p align="center"><a name="tab7"></a><img src="img/revistas/dys/n74/n74a07tab7.gif"></p>       <p align="center"><a name="tab8"></a><img src="img/revistas/dys/n74/n74a07tab8.gif"></p>     <p>Regarding the magnitude of the effect, <a href="#tab8">Table 8</a> shows  the instrumental variables results. They indicate that a one standard deviation  increase in the percentage of victims of bullying within schools decreases the  Saber 11&ordm; test results by 0.37 standard deviations. The effect of bullying  over the areas of the test is significant and varies between 0.2 and 0.4 standard  deviations, except in math where there is no significant effect. An  important note, however, is that the first the endogeneity test reflect that in all  Saber 11&ordm; test areas except mathematics bullying was endogenous. It also is  worth mentioning that, in the first stage results, there is positive and strong  relationship between the standard deviation of age and the percentage of bullying  victims within schools as the first stage coefficient is 0.77 and its  standard error 0.26.</p>     <p>An interesting finding is that the magnitude of the  effect is smaller than in the short term, a result which probably comes from the  increase in the time lapse between the episode of intimidation and the  state exam. It is worth noting that this result is consistent with the literature  that states that the effect on academic performance is greater the closer the  episode of intimidation is to the time of  the test, as stated in Brown and Taylor (2008).</p>     <p>Furthermore, it is worth noting that, as a result of  the characteristics of the database, is impossible to know whether all students  who took the Saber 9&ordm; test in 2005-2006 also took the Saber 11&ordm; test two  years later. Therefore, it is possible that the decrease in the long-term effect is  related to an increase in desertion of victims, an increase in the number of  students who finish school somewhere else, or the incorporation of new students.</p>     <p>As for the existence of heterogeneous effects, there  are no significant differences by gender or age of the students. However, when  analyzing the percentile regressions by academic performance, the results shows  that in the long term bullying may have a smaller effect on students  located in the right tail of the distribution as shown in <a href="#fig3">Figure 3</a>. In particular,  the relative effect is lower for those located between the median and the right  tail. One explanation for this result is that the tendencies observed in the  short term are exacerbated when a larger group of students joins the first group  of students, those who focus solely on their education and therefore are less  affected by average bullying level within schools. A second explanation is that as  students near the end of high school, they become more aware of the  importance of academic achievement and thus stop bullying their peers with  higher grades. Nevertheless, due to the large standard errors in the estimation  such difference may be statistically equal to zero.</p>     <p align="center"><a name="fig3"></a><img src="img/revistas/dys/n74/n74a07fig3.gif"></p>     <p><b>VI.  Conclusions</b></p>     <p>The results indicate that for high school students in  Colombia, increases in the   frequency of bullying negatively affect individual  academic performance both   in the short and in the long term. In particular,  taking into account possible   biases, an increase of one standard deviation in the  average level of bullying   decreases a student's Saber 9<b>&ordm; </b>test score by 0.55 standard  deviations and their   Saber 11<b>&ordm; </b>test by 0.37  standard deviations. This result suggests that by reducing   the number of bullying incidents by one standard  deviation, it is possible   to improve long term academic performance of students.</p>     <p>These results are consistent with the international  literature. According to Brown and Taylor (2008), reducing the frequency of  bullying is fundamental, as it has a negative long-term effect on wages both  directly and indirectly through human capital accumulation. Furthermore,  Mundbjerg et al. (2014) indicate that bullying has negative effect in academic  achievement and that, as a result, the loss in potential lifetime earning  may be enormous. This implies that a decrease in the level of bullying within  classrooms would improve not only the performance of students on the Saber 9<b>&ordm; </b>and Saber 11<b>&ordm; </b>tests, but also improve their future wages and living conditions.</p>     ]]></body>
<body><![CDATA[<p>Regarding the heterogeneous effects, the results  indicate that the long run effect of being bullied does not depend on gender or  age. However, in the short run the effect is greater for younger students,  indicating that while bullying has a negative effect on all students, the effect is  greater on those younger students who may be more likely to be victimized by  peers.</p>     <p>Finally, this analysis reveals the existence of  differences in the relationship between the level of bullying experienced and academic  performance by test scores over time. In particular, it finds that in the  short term, the effect of being bullied is greater for students between the 30 and the  90<sup>th</sup> percentile of the academic achievement distribution, and in the long run  it is higher for those students below the median. A possible explanation for  this result is that students divide themselves in two groups as postulated in <i>An  economic analysis of "Acting White" </i>(Austen-Smith and Fryer, 2005). In the short run,  there is a small group of students who focus primarily on  studying and therefore are less affected by bullying and, as they approach the  end of high school, they are joined by a larger group of students who decide to  focus on their studies as well. Simultaneously, the second group of students,  who studied less in order to fit in and prevent bullying attacks against  them, becomes small and less powerful as they progress through high school.</p>     <p>The existence of heterogeneous effects by age and  level of performance means that public policies should aim at reducing bullying  nationwide while taking into account the specific conditions of individual  schools and students; one example of this is through programs that specifically  protect younger students. Furthermore, prevention programs should be designed to  specifically protect children around the median of the academic  distribution by helping them find friends with similar characteristics and by promoting  higher academic achievement within schools. Doing this, however, implies designing  prevention programs that suit the particular needs of each school.</p>     <p>However, further research is needed to measure the  benefits of current bullying prevention programs such as "<i>Aulas  en Paz</i>" in Colombia  and Mexico. In this regard, it is essential to measure and compare  the outcomes of different types of programs that seek to prevent bullying in  order to establish the most efficient way to solve the problem. A first  step in this direction is to begin with programs that focus on the students who  observe bullying and not on the aggressors themselves as, according to Chaux  (2012), is easier to change the attitudes against bullying and the behavior of  observers than to change the behavior of the aggressors.</p>     <p>Regarding the above, in order to measure which  programs work best, it is necessary to determine the level of bullying to which each child  is exposed, the prevention programs to which they were exposed, as  well as their academic performance through school and university and, if  possible, their eventual labor market outcomes. In the case of Colombia, this  means that the state test should continue to measure bullying but it should  also include each student's individual information in order to match those results  with individual test scores. In addition, in order to more accurately  assess the effect of bullying in the future, it would be interesting to measure the  effect of different types of bullying. For these reasons, it would be  essential to include additional questions in bullying surveys that measure a  greater variety of the nine types of bullying defined by the Olweus Prevention Center.</p>     <p>_____________________________    <br> <b>Foot notes</b>    <br> <a href="#2b" name="2a"><sup>2</sup></a> According to  the Olweus Bullying Prevention Program (2011), an organization that focus on  bullying prevention  worldwide, the first national representative study of bullying in Norway found  that around 10% of  students between 8 and 16 years were bullying victims and that by 2011 that  number had raised in 50%.  Furthermore, the center reports that in the first nationally representative  study in the United States,  17% of students in middle-school had been bullied at least one time and 8% had  been bullied at  least once during the past week.    <br> <a href="#3b" name="3a"><sup>3</sup></a> As reported  by Unicef (2007a), bullying victims in Malaysia lose interest in school,  decrease attendance, communicate  less with their peers, and have lower grades. Moreover, bullying reduces sleep  and appetite while increasing disease reports and physical  injuries.    <br> <a href="#4b" name="4a"><sup>4</sup></a> <a href="#fig1">Figure 1</a>  displays the distribution of student scores in Saber 9 test when schools are  divided in three groups  according to the level of bullying in Schools. Each group contains one third of  the schools, where high  contains the 33% schools with higher level of bulling, medium the next 33%, and  low the bottom  33%. The difference in the average test score between the three groups are  statistically significant at  1%.    ]]></body>
<body><![CDATA[<br> <a href="#5b" name="5a"><sup>5</sup></a> According to  Chaux (2012), such programs improve coexistence, reduce aggression, decrease  discipline interruptions,  and increase friendship within the classrooms. Additionally, according to  Garcia (2011), Aulas en Paz  has reduced violence within-schools, while improving coexistence, empathy,  assertiveness, and academic  achievement by promoting peaceful coexistence through the promotion of  citizenship skills.    <br> <a href="#6b" name="6a"><sup>6</sup></a> Reverse  causality refers to the possible existence of a two way causal relationships.  In this paper reverse causality  refers to the possibility that bullying is directed towards students depending  on their academic achievement and academic achievement depends  on the level of bullying.    <br> <a href="#7b" name="7a"><sup>7</sup></a> It is  important to stress that, although the students from the same cohorts took this  second test, as there are not  name records in Saber 9&ordm;, it is impossible to know if some students dropped out  of school, finished high school in a different institution, or if  there are new students in the existing schools.    <br> <a href="#8b" name="8a"><sup>8</sup></a> The Olweus  Bullying Prevention Program is an organization that focuses on worldwide  bullying prevention at the  individual, school and community level. The website  <a href="http://www.olweus.org/public/bullying" target="_blank">http://www.olweus.org/public/bullying</a>. page has more information about the organization,  bullying and bullying prevention programs.    <br> <a href="#9b" name="9a"><sup>9</sup></a> Among  behavioral problems, Le et al. (2004) include conduct disorder, personality  disorder, delinquency, immaturity and  aggressive behavior because they are usually related with problems between  students, between students and teachers or between students and  other school authorities.    <br> <a href="#10b" name="10a"><sup>10</sup></a> According  to Smith et al. (2004), students that were never bullied attend school 98.8% of  the time while those that were bullied in both periods only  attend 94.3% of the time.    <br> <a href="#11b" name="11a"><sup>11</sup></a> The first  questionnaire was only used in a restricted sample that evaluated a nationally  representative set  of schools.    <br> <a href="#12b" name="12a"><sup>12</sup></a> Household  assets refers to whether the household as a working tv, refrigerator, radio,  computer and car. The two  services included are whether the household has access to electricity and  whether it has a  phone line.    <br> <a href="#13b" name="13a"><sup>13</sup></a> The number  of times a person has been beaten, insulted and rejected by their peer comes  from three different  categorical variables that ask each student who often each of these behaviors  happened to him in the  following scale: never, once, between two and four times, or five or more  times. Mother's education is  divided in the following categories: elementary school or less, complete or  incomplete high-school education, tertiary education or more.    <br> <a href="#14b" name="14a"><sup>14</sup></a> In the long  run there is no individual information of mother's education, income level, nor  of the level of aggression  each student receives and those variables are only included as the average by  school level.    ]]></body>
<body><![CDATA[<br> <a href="#15b" name="15a"><sup>15</sup></a> Cragg  Donald Wald test shows that the instrument is not weak as it exceed the  critical value of 16.38 Stock and  Yogo, indicating that the coefficients do not exceed 10% of the bias of the  ordinary least squares  estimators. Additionally, that endogeneity test shows that the null hypothesis -  bullying in endogenous -  can't be rejected, indicating that the percentage of episodes of intimidation  is endogenous, confirming the  need to instrument and that the OLS effects was downward biased.    <br> <a href="#16b" name="16a"><sup>16</sup></a> Although it  is impossible to verify the exclusion restriction without another (valid)  instrument, it is possible to  include the interaction between gender and the standard deviation of age as a  second instrument and  test whether the instrument is exogenous. The results of those estimations show  that the null  hypothesis, that the instruments are exogenous, cannot be rejected as the p  value is 0.65. Nevertheless,  it is important to stress that the validity of this test again depends on the  exogeneity of the  instrument, as it also assumes that the standard deviation of age is an  exogenous instrument in other to confirm that the interaction between the  instrument and gender is exogenous.</p>     <p><b>References</b></p>     <!-- ref --><p>1. AUSTEN-SMITH, D., AND FRYER, R. G. (2005). "An  economic analysis of   Acting White", <i>The Quarterly Journal of  Economics</i>, 120:551-583.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000156&pid=S0120-3584201400020000700001&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  2. BALDRY, A. C. (2003). "Bullying in schools and  exposure to domestic   violence", <i>Child Abuse &#38; Neglect</i>, 27:713-732.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000158&pid=S0120-3584201400020000700002&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  3. BAUMAN, S. (2008). "The role of elementary school  counselors in reducing   school bullying", <i>The Elementary School  Journal</i>, 108:362-375.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000160&pid=S0120-3584201400020000700003&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  4. BROWN, S., AND TAYLOR, K. (2008). "Bullying,  education and earnings:   Evidence from the National Child Development Study", <i>Economics  of</i>   <i>Education</i>, 27(4):387-401.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000162&pid=S0120-3584201400020000700004&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  5. CAMERON, C., AND TRIVEDI, P. K. (2009). <i>Microeconometrics  using Stata</i>. College Station: Stata Press.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000164&pid=S0120-3584201400020000700005&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  6. CHAUHAN, P., COWIE, H., NAYLOR, P., SMITH, P. K.,  AND TALAMELLI,   L. (2004). "Profiles of non-victims, escaped victims,  continuing victims   and new victims of school bullying", <i>British  Journal of Educational</i>   <i>Psychology, </i>74:565-581.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000166&pid=S0120-3584201400020000700006&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  7.  CHAUX, E. (2012). <i>Educaci&oacute;n, convivencia y  agresi&oacute;n escolar</i>. Bogot&aacute;:   Ediciones  Uniandes. Taratus, Santillana.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000168&pid=S0120-3584201400020000700007&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  8.  CHAUX, E., MOLANO, A., AND PODLESKY, P. (2009). "Socio-economic,   socio-political and socio-emotional variables  explaining school   bullying: A country-wide multilevel analysis", <i>Aggressive  Behavior</i>,   35:520-529.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000170&pid=S0120-3584201400020000700008&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  9. CRAIG, W., AND HAREL, Y. (2004). "Bullying,  physical fighting and victimization",   in C. Currie, C. Roberts, A. Morgan, R. Smith, W.  Settertobulte,   O. Samdal and V. Barnekow-Rasmussen (Eds.), <i>Young  people's health in context. Health Behaviour in School-aged Children (HBSC)  study: International</i>   <i>report from the 2001/2002  survey </i>(pp. 133-144).  Copenhagen:   World Health Organization.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000172&pid=S0120-3584201400020000700009&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  10. GARC&Iacute;A, B. (2011). "Fueron  tres tristes trigres...", <i>Nota Uniandina</i>,   34:36-39.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000174&pid=S0120-3584201400020000700010&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  11. LE, A. T., MILLER, P. W., AND HEATH, A. C. (2005).  "Early childhood behaviours,   schooling and labour market outcomes; estimates from a  sample   of twins", <i>Economics of Education  Review</i>, 24:1-17.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000176&pid=S0120-3584201400020000700011&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  12. MUNDBJERG, T.L, NIELSEN, H. S, AND SIMONSEN, M.  (2014). "Bullying in elementary school", <i>Journal  of Human Resources</i>,   49(4):839-871.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000178&pid=S0120-3584201400020000700012&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  13. NANSEL, T. R., OVERPECK, M., PILLA, R. S., RUAN,  W. J., SIMONSMORTON,   B., AND SCHEIDT, P. (2001). "Bullying behaviors among   U. S. Youth", <i>Journal of the American  Medical Association, </i>28:2094-2100.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000180&pid=S0120-3584201400020000700013&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  14. OLWEUS, D. (1993). <i>Bullying at school: What we  know and what we can</i>   <i>do. </i>Cambridge, MA: Blackwell.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000182&pid=S0120-3584201400020000700014&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  15. OLWEUS PREVENTION CENTER. (2011). How common is  bullying? Olweus   Prevention Center. Recovered 11 October 2011, from  <a href="http://www.olweus.org/public/faqs.page?menuheader=1#Answer_numberCbQ7" target="_blank">http://www.olweus.org/public/faqs.page?menuheader=1#Answer_numberCbQ7</a>.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000184&pid=S0120-3584201400020000700015&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  16.  PORTA, E. (2007). <i>Usando TIMSS para entender los  determinantes del</i>   <i>aprendizaje: hallazgos iniciales para Colombia 2007 </i>(pp.  1-56)<i>. </i>Education:   The World Bank.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000186&pid=S0120-3584201400020000700016&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  17. ROM&Aacute;N, M., AND MURILLO, F. J. (2011). "Am&eacute;rica  Latina: violencia entre   estudiantes  y desempe&ntilde;o escolar", <i>Revista Cepal</i>,  104:37-54.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000188&pid=S0120-3584201400020000700017&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  18. SMITH, P. K., TALAMELLI, L., COWIE, H., NAYLOR,  P., AND CHAUHAN, P. (2004). "Profiles of non-victims, escaped victims,  continuing victims   and new victims of school bullying"<i>,  British Journal of Educational</i>   <i>Psycholog</i>y,  74:565-581.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000190&pid=S0120-3584201400020000700018&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  19. UNICEF. (2007a). <i>Stop violence in schools!  The scope and impact of</i>   <i>bullying. Fact Sheet. </i>Malaysia: Unicef Malaysia  Communications.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000192&pid=S0120-3584201400020000700019&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>     <!-- ref --><p>  20.  UNICEF. (2007b). MTV Latinoam&eacute;rica y Unicef unen esfuerzos para   presentar  una realidad que viven muchos adolescentes y j&oacute;venes en   Latinoam&eacute;rica.  Recuperado el 21 de septiembre de 2011 de Centro de prensa:  <a href="http://www.unicef.org/spanish/media/media_40147.html" target="_blank">http://www.unicef.org/spanish/media/media_40147.html</a>.    &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;[&#160;<a href="javascript:void(0);" onclick="javascript: window.open('/scielo.php?script=sci_nlinks&ref=000194&pid=S0120-3584201400020000700020&lng=','','width=640,height=500,resizable=yes,scrollbars=1,menubar=yes,');">Links</a>&#160;]<!-- end-ref --></p>   </font>      ]]></body><back>
<ref-list>
<ref id="B1">
<label>1</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[AUSTEN-SMITH]]></surname>
<given-names><![CDATA[D.]]></given-names>
</name>
<name>
<surname><![CDATA[FRYER]]></surname>
<given-names><![CDATA[R. G]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[An economic analysis of Acting White]]></article-title>
<source><![CDATA[The Quarterly Journal of Economics]]></source>
<year>2005</year>
<volume>120</volume>
<page-range>551-583</page-range></nlm-citation>
</ref>
<ref id="B2">
<label>2</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[BALDRY]]></surname>
<given-names><![CDATA[A. C]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Bullying in schools and exposure to domestic violence]]></article-title>
<source><![CDATA[Child Abuse &#038; Neglect]]></source>
<year>2003</year>
<volume>27</volume>
<page-range>713-732</page-range></nlm-citation>
</ref>
<ref id="B3">
<label>3</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[BAUMAN]]></surname>
<given-names><![CDATA[S]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[The role of elementary school counselors in reducing school bullying]]></article-title>
<source><![CDATA[The Elementary School Journal]]></source>
<year>2008</year>
<volume>108</volume>
<page-range>362-375</page-range></nlm-citation>
</ref>
<ref id="B4">
<label>4</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[BROWN]]></surname>
<given-names><![CDATA[S.]]></given-names>
</name>
<name>
<surname><![CDATA[TAYLOR]]></surname>
<given-names><![CDATA[K]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Bullying, education and earnings: Evidence from the National Child Development Study]]></article-title>
<source><![CDATA[Economics of Education]]></source>
<year>2008</year>
<volume>27</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>387-401</page-range></nlm-citation>
</ref>
<ref id="B5">
<label>5</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CAMERON]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[TRIVEDI]]></surname>
<given-names><![CDATA[P. K]]></given-names>
</name>
</person-group>
<source><![CDATA[Microeconometrics using Stata]]></source>
<year>2009</year>
<publisher-name><![CDATA[College Station: Stata Press]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B6">
<label>6</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CHAUHAN]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[COWIE]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[NAYLOR]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[SMITH]]></surname>
<given-names><![CDATA[P. K.]]></given-names>
</name>
<name>
<surname><![CDATA[TALAMELLI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Profiles of non-victims, escaped victims, continuing victims and new victims of school bullying]]></article-title>
<source><![CDATA[British Journal of Educational Psychology]]></source>
<year>2004</year>
<volume>74</volume>
<page-range>565-581</page-range></nlm-citation>
</ref>
<ref id="B7">
<label>7</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CHAUX]]></surname>
<given-names><![CDATA[E]]></given-names>
</name>
</person-group>
<source><![CDATA[Educación, convivencia y agresión escolar]]></source>
<year>2012</year>
<publisher-loc><![CDATA[Bogotá ]]></publisher-loc>
<publisher-name><![CDATA[Ediciones UniandesTaratusSantillana]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B8">
<label>8</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CHAUX]]></surname>
<given-names><![CDATA[E.]]></given-names>
</name>
<name>
<surname><![CDATA[MOLANO]]></surname>
<given-names><![CDATA[A.]]></given-names>
</name>
<name>
<surname><![CDATA[PODLESKY]]></surname>
<given-names><![CDATA[P]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Socio-economic, socio-political and socio-emotional variables explaining school bullying: A country-wide multilevel analysis]]></article-title>
<source><![CDATA[Aggressive Behavior]]></source>
<year>2009</year>
<volume>35</volume>
<page-range>520-529</page-range></nlm-citation>
</ref>
<ref id="B9">
<label>9</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[CRAIG]]></surname>
<given-names><![CDATA[W.]]></given-names>
</name>
<name>
<surname><![CDATA[HAREL]]></surname>
<given-names><![CDATA[Y.]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Bullying, physical fighting and victimization]]></article-title>
<person-group person-group-type="editor">
<name>
<surname><![CDATA[Currie]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Roberts]]></surname>
<given-names><![CDATA[C]]></given-names>
</name>
<name>
<surname><![CDATA[Morgan]]></surname>
<given-names><![CDATA[A]]></given-names>
</name>
<name>
<surname><![CDATA[Smith]]></surname>
<given-names><![CDATA[R]]></given-names>
</name>
<name>
<surname><![CDATA[Settertobulte]]></surname>
<given-names><![CDATA[W]]></given-names>
</name>
<name>
<surname><![CDATA[Samdal]]></surname>
<given-names><![CDATA[O]]></given-names>
</name>
<name>
<surname><![CDATA[Barnekow-Rasmussen]]></surname>
<given-names><![CDATA[V]]></given-names>
</name>
</person-group>
<source><![CDATA[Young people's health in context: Health Behaviour in School-aged Children (HBSC) study: International report from the 2001/2002 survey]]></source>
<year>2004</year>
<page-range>133-144</page-range><publisher-loc><![CDATA[Copenhagen ]]></publisher-loc>
<publisher-name><![CDATA[World Health Organization]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B10">
<label>10</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[GARCÍA]]></surname>
<given-names><![CDATA[B]]></given-names>
</name>
</person-group>
<article-title xml:lang="es"><![CDATA[Fueron tres tristes trigres...]]></article-title>
<source><![CDATA[Nota Uniandina]]></source>
<year>2011</year>
<volume>34</volume>
<page-range>36-39</page-range></nlm-citation>
</ref>
<ref id="B11">
<label>11</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[LE]]></surname>
<given-names><![CDATA[A. T.]]></given-names>
</name>
<name>
<surname><![CDATA[MILLER]]></surname>
<given-names><![CDATA[P. W.]]></given-names>
</name>
<name>
<surname><![CDATA[HEATH]]></surname>
<given-names><![CDATA[A. C]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Early childhood behaviours, schooling and labour market outcomes; estimates from a sample of twins]]></article-title>
<source><![CDATA[Economics of Education Review]]></source>
<year>2005</year>
<volume>24</volume>
<page-range>1-17</page-range></nlm-citation>
</ref>
<ref id="B12">
<label>12</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[MUNDBJERG]]></surname>
<given-names><![CDATA[T.L]]></given-names>
</name>
<name>
<surname><![CDATA[NIELSEN]]></surname>
<given-names><![CDATA[H. S]]></given-names>
</name>
<name>
<surname><![CDATA[SIMONSEN]]></surname>
<given-names><![CDATA[M]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Bullying in elementary school]]></article-title>
<source><![CDATA[Journal of Human Resources]]></source>
<year>2014</year>
<volume>49</volume>
<numero>4</numero>
<issue>4</issue>
<page-range>839-871</page-range></nlm-citation>
</ref>
<ref id="B13">
<label>13</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[NANSEL]]></surname>
<given-names><![CDATA[T. R.]]></given-names>
</name>
<name>
<surname><![CDATA[OVERPECK]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[PILLA]]></surname>
<given-names><![CDATA[R. S.]]></given-names>
</name>
<name>
<surname><![CDATA[RUAN]]></surname>
<given-names><![CDATA[W. J.]]></given-names>
</name>
<name>
<surname><![CDATA[SIMONSMORTON]]></surname>
<given-names><![CDATA[B.]]></given-names>
</name>
<name>
<surname><![CDATA[SCHEIDT]]></surname>
<given-names><![CDATA[P]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Bullying behaviors among U. S. Youth]]></article-title>
<source><![CDATA[Journal of the American Medical Association]]></source>
<year>2001</year>
<volume>28</volume>
<page-range>2094-2100</page-range></nlm-citation>
</ref>
<ref id="B14">
<label>14</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[OLWEUS]]></surname>
<given-names><![CDATA[D]]></given-names>
</name>
</person-group>
<source><![CDATA[Bullying at school: What we know and what we can do]]></source>
<year>1993</year>
<publisher-loc><![CDATA[Cambridge^eMA MA]]></publisher-loc>
<publisher-name><![CDATA[Blackwell]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B15">
<label>15</label><nlm-citation citation-type="book">
<collab>OLWEUS PREVENTION CENTER</collab>
<source><![CDATA[How common is bullying?]]></source>
<year>2011</year>
<publisher-name><![CDATA[Olweus Prevention Center]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B16">
<label>16</label><nlm-citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname><![CDATA[PORTA]]></surname>
<given-names><![CDATA[E]]></given-names>
</name>
</person-group>
<source><![CDATA[Usando TIMSS para entender los determinantes del aprendizaje: hallazgos iniciales para Colombia 2007]]></source>
<year>2007</year>
<page-range>1-56</page-range><publisher-name><![CDATA[The World Bank]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B17">
<label>17</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[ROMÁN]]></surname>
<given-names><![CDATA[M.]]></given-names>
</name>
<name>
<surname><![CDATA[MURILLO]]></surname>
<given-names><![CDATA[F. J]]></given-names>
</name>
</person-group>
<article-title xml:lang="es"><![CDATA[América Latina: violencia entre estudiantes y desempeño escolar]]></article-title>
<source><![CDATA[Revista Cepal]]></source>
<year>2011</year>
<volume>104</volume>
<page-range>37-54</page-range></nlm-citation>
</ref>
<ref id="B18">
<label>18</label><nlm-citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname><![CDATA[SMITH]]></surname>
<given-names><![CDATA[P. K.]]></given-names>
</name>
<name>
<surname><![CDATA[TALAMELLI]]></surname>
<given-names><![CDATA[L.]]></given-names>
</name>
<name>
<surname><![CDATA[COWIE]]></surname>
<given-names><![CDATA[H.]]></given-names>
</name>
<name>
<surname><![CDATA[NAYLOR]]></surname>
<given-names><![CDATA[P.]]></given-names>
</name>
<name>
<surname><![CDATA[CHAUHAN]]></surname>
<given-names><![CDATA[P]]></given-names>
</name>
</person-group>
<article-title xml:lang="en"><![CDATA[Profiles of non-victims, escaped victims, continuing victims and new victims of school bullying]]></article-title>
<source><![CDATA[British Journal of Educational Psychology]]></source>
<year>2004</year>
<volume>74</volume>
<page-range>565-581</page-range></nlm-citation>
</ref>
<ref id="B19">
<label>19</label><nlm-citation citation-type="book">
<collab>UNICEF</collab>
<source><![CDATA[Stop violence in schools!: The scope and impact of bullying]]></source>
<year>2007</year>
<publisher-name><![CDATA[Unicef Malaysia Communications]]></publisher-name>
</nlm-citation>
</ref>
<ref id="B20">
<label>20</label><nlm-citation citation-type="">
<collab>^dUNICEF</collab>
<source><![CDATA[MTV Latinoamérica y Unicef unen esfuerzos para presentar una realidad que viven muchos adolescentes y jóvenes en Latinoamérica]]></source>
<year>2007</year>
</nlm-citation>
</ref>
</ref-list>
</back>
</article>
