SciELO - Scientific Electronic Library Online

 
vol.42 issue2Needs Assessment for Promoting Prosocial Behavior in Early Childhood EducationThe Relationship between Teacher-Student Conflict Management Styles and Teacher Self-Efficacy author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Avances en Psicología Latinoamericana

Print version ISSN 1794-4724On-line version ISSN 2145-4515

Av. Psicol. Latinoam. vol.42 no.2 Bogotá May/Aug. 2024  Epub Dec 12, 2024

https://doi.org/10.12804/revistas.urosario.edu.co/apl/a.14321 

Artículos

Assessing Workplace Bullying: Psychometric Analysis of the Negative Acts Questionnaire-Revised (NAQ-R) among Brazilian Teachers

Evaluación del acoso laboral: análisis psicométrico del Cuestionario de Actos Negativos Revisado (CAQ-R) entre docentes brasileños

Avaliação do assédio no local de trabalho: análise psicométrica do Negative Acts Questionnaire-Revised (NAQ-R) entre professores brasileiros

Esthela Sá Cunha1 
http://orcid.org/0000-0002-4822-0454

Francisco Pablo Huascar Aragão Pinheiro2 
http://orcid.org/0000-0001-9289-845X

Alex Sandro de Moura Grangeiro3 
http://orcid.org/0000-0001-7668-7978

Jorge Tarcisio da Rocha Falcão4 
http://orcid.org/0000-0002-2798-3727

Walberto Silva dos Santos5 
http://orcid.org/0000-0001-6816-0105

Francisco Herbert Lima Vasconcelos6 
http://orcid.org/0000-0003-4896-9024

Amanda Queiroz Silva7 
http://orcid.org/0000-0001-5448-2461

Lorena Albuquerque Mendes7 
http://orcid.org/0009-0005-3262-0372

1 Curso de Psicologia, Faculdade 05 de Julho. Curso de Psicologia, Centro Universitário INTA - UNINTA

2 Programa de Pós-Graduação Profissional em Psicologia e Políticas Públicas, Universidade Federal do Ceará

3 Curso de Medicina, Campus Sobral, Universidade Federal do Ceará

4 Universidade Federal do Rio Grande do Norte, Programa de Pós-Graduação em Psicologia

5 Programa de Pós-Graduação em Psicologia, Universidade Federal do Ceará

6 Programa de Pós-Graduação em Tecnologia Educacional, Universidade Federal do Ceará

7 Curso de Psicologia, Universidade Federal do Ceará


Abstract

Most research on school violence in Brazil has over-looked teacher victimization, focusing instead on students. This study focused on evaluating the psychometric properties of the Negative Acts Questionnaire-Revised (NAQ-R) in a sample of 10.148 teachers from Brazilian public schools. The NAQ-R, developed to measure exposure to workplace bullying, originally included 23 items but was later revised to 22. It assesses three factors of bullying: personal, work- related, and physically intimidating forms. The study employed a self-administered questionnaire issued via the Internet. Exploratory and confirmatory factor analyses were performed, alongside assessment of convergent validity with the Self-Reporting Questionnaire-20 (SRQ-20), an instrument for screening common mental disorders. This study discovered a two-factor structure (personal bullying: α = .93, ω = .79; work-related bullying: α = .92, ω = .74). The NAQ-R showed adequate internal consistency and validity (RMSEArobust = .089, 90 % CI: .086 - .089, SRMR = .041, CFIrobust = .916, TLIrobust = .905), correlating positively with the SRQ-20. The findings align with international studies, suggesting the measure’s stability.

Keywords: Harassment; workplace violence; teachers; schools; validation studies

Resumen

La mayor parte de la investigación sobre la violencia escolar en Brasil ha pasado por alto la victimización de los docentes, centrándose en los estudiantes. Este estudio se centró en evaluar las propiedades psicométricas del Cuestionario de Actos Negativos Revisado (CAN-R), en una muestra de 10.148 profesores de escuelas públicas brasileñas. El CAN-R, desarrollado para medir la exposición al acoso laboral, incluía originalmente 23 ítems, pero posteriormente se revisó a 22. Evalúa tres factores del acoso: personal, laboral y formas con intimidación física. El estudio empleó un cuestionario autoadministrado difundido a través de Internet. Se realizaron análisis factoriales exploratorios y confirmatorios, junto con la evaluación de la validez convergente con el SelfReporting Questionnaire-20 (SRQ-20), un instrumento para el cribado de los trastornos mentales comunes. Este estudio descubrió una estructura de dos factores (acoso personal: α = .93, ω = .79; acoso laboral: α = .92, ω = .74). El CAN-R presentó una consistencia interna y validez adecuadas (RMSEArobusto = .089, IC del 90 %: .086 - .089, SRMR = .041, CFIrobusto = .916, TLIrobusto = .905), correlacionándose positivamente con el SRQ-20. Los hallazgos se alinean con estudios internacionales, lo que sugiere la estabilidad de la medida.

Palabras clave: acoso; violencia laboral; docentes; escuelas; estudios de validación

Resumo

A maior parte da pesquisa sobre violência escolar no Brasil tem ignorado a vitimização de professores, concentrando-se nos alunos. Este estudo se concentrou na avaliação das propriedades psicométricas do Negative Acts Questionnaire-Revised (NAQ-R) em uma amostra de 10.148 professores de escolas públicas brasileiras. O NAQ-R, desenvolvido para medir a exposição ao assédio no local de trabalho, incluía originalmente 23 itens, mas foi posteriormente revisado para 22. Ele avalia três fatores de assédio: pessoal, profissional e formas de intimidação física. O estudo utilizou um questionário autoadministrado divulgado pela internet. Foram realizadas análises fatoriais exploratórias e confirmatórias, juntamente com a avaliação da validade convergente com o Self-Reporting Questionnaire-20 (SRQ-20), um instrumento para a triagem de transtornos mentais comuns. Este estudo encontrou uma estrutura de dois fatores (assédio pessoal: α = 0.93, ω = 0.79; assédio profissional: α = 0.92, ω = 0.74). O NAQ-R apresentou consistência interna e validade adequadas (RMSEArobusto = 0.089; 90 % IC: 0.086-0.089; SRMR = 0.041; CFIrobusto = 0.916; TLIrobusto = 0.905), correlacionando-se positivamente com o SRQ-20. Os resultados estão de acordo com estudos internacionais, sugerindo a estabilidade da medida.

Palavras-chave: assédio; violência no local de trabalho; professores; escolas; estudos de validação

In 2021, Brazil recorded over 52.000 cases of workplace bullying (Modesto, 2022). Most research and interventions in school violence particularly obscure this form of violence among teachers by focusing on students as victims of aggression (Scheeler et al., 2022). Repeated offenses, exclusion, and humiliations characterize workplace bullying, detrimentally affecting an employee’s performance and fostering a hostile work environment. The victim experiences belittlement and becomes a target of negative social acts (Einarsen et al., 2003). Hostile behaviors can also define it, occurring at least weekly or daily for at least six months. This definition excludes temporary mistreatments, and the manner of aggression is not considered (Leymann, 1996).

In educational settings, instances of this form of violence may originate from multiple individuals involved in the teaching environment, such as directors, students, parents, administrative personnel, and peer educators (Wet & Jacob, 2021). Among teachers, stress (Malik & Björkqvist, 2019), burnout (Inandi & Büyüközkan, 2022; Mościcka-Teske et al., 2014), and psychological distress (Bernotaite & Malinauskiene, 2017) have been associated with workplace bullying.

The Negative Acts Questionnaire (NAQ; Einarsen et al., 1994; Einarsen et al., 2009) was developed to gauge feelings of exposure to moral harassment and victimization at work. Initially, the NAQ comprised twenty-three items (Einarsen & Raknes, 1997). However, cultural limitations and issues with its factorial structure required a revision, resulting in a 22-item questionnaire.

The NAQ-R encompasses three factors: personal bullying, work-related bullying, and physically intimidating forms of bullying. Personal bullying includes negative acts such as humiliation, exclusion, slander, and intimidation that target the person or their private life (Einarsen et al., 2009). Work-related bullying pertains to dysfunctional or adverse work organization, often manifesting as the imposition of excessive workloads, alteration of the nature of tasks, or enforcement of stringent deadlines (Einarsen et al., 2009). Physically intimidating forms of bullying, the third factor, involve more severe actions like physical aggression, shoving, abuse, and threats (Einarsen et al., 2003).

Global studies have confirmed the psychometric properties of the NAQ among various worker categories. Research has identified structures of three (Erwandi et al., 2021; Dujo López et al., 2020; González-Trijueque & Gómez, 2013; Gupta et al., 2017; Nam et al., 2010; Takaki et al., 2010; Tsuno et al., 2010) and two factors (Charilaos et al., 2015; Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017), and even four (Simons et al., 2011) and five factors (Abe & Henly, 2010; Verdasca, 2008).

These investigations used exploratory factor analysis (Erwandi et al., 2021; Gupta et al., 2017; León-Pérez et al., 2019; Makarem et al., 2018; Nam et al., 2010; Takaki et al., 2010; Tsuno et al., 2010) and principal components analysis (Charilaos et al., 2015; González-Trijueque & Gómez, 2013; Rai & Agarwal, 2017; Verdasca, 2008), or both (Abe & Henly, 2010; Simons et al., 2011). The factor retention method most employed was the classic Kaiser-Guttman and Cattell criteria (Eigenvalues > 1), despite their imprecision and tendency to overestimate factor numbers (Damásio, 2012).

These studies used both oblique and orthogonal rotations to enhance result interpretation. The correlation between factors ranged from 0.16 to 0.86 (Dujo López et al., 2020; Giorgi et al., 2011; Gupta et al., 2017; Simons et al., 2011), with a total explained variances ranging from 35.58 % to 69.72 % (Abe & Henly, 2010; Giorgi et al., 2011; González-Trijueque & Gómez, 2013; Gupta et al., 2017; León-Pérez et al., 2019; Makarem et al., 2018; Rai & Agarwal, 2017; Simons et al., 2011; Tsuno et al., 2010; Verdasca, 2008). Reliability, primarily assessed using Cronbach’s alpha, varied between 0.56 and 0.98 (Abe & Henly, 2010; Charilaos et al., 2015; Dujo López et al., 2020; Erwandi et al., 2021; Giorgi et al., 2011; González-Trijueque & Gómez, 2013; Gupta et al., 2017; León-Pérez et al., 2019; Nam et al., 2010; Rai & Agarwal, 2017; Simons et al., 2011; Takaki et al., 2010; Verdasca, 2008).

The NAQ’s convergent validity was evaluated by examining its relationship with constructs like psychosocial suffering, life satisfaction (Erwandi et al., 2021; Makarem et al., 2018), self-esteem, anxiety (Charilaos et al., 2015), stress (Charilaos et al., 2015), depression (Charilaos et al., 2015; Makarem et al., 2018), work engagement (Gupta et al., 2017), burnout (Dujo López et al., 2020; González-Trijueque & Gómez, 2013; Gupta et al., 2017), job satisfaction (Simons et al., 2011), among others. The instrument’s concurrent validity was also evaluated (Simons et al., 2011; Tsuno et al., 2010).

In Brazil, these validations of the NAQ have been conducted with workers from various categories (Amazarray, 2010; Christ, 2011; Maciel & Gonçalves, 2008; Silva et al., 2017). Maciel and Gonçalves (2008) assessed its internal consistency among bank officers and professionals from various sectors, achieving a Cronbach’s alpha of 0.90. Amazarray (2010), in a study with bank officers, named a unifactorial structure, with a 45 % variance explained and a reliability of 0.94. Christ (2011) explored its application with university students, youth and adult education students, and workers from various categories, revealing four factors accounting for 58.75 % of the total variance, with reliability ranging from 0.65 to 0.87. Silva et al. (2017) found a two-factor structure for men and a single-factor structure for women among statutory servers, with variances explained of 61.3 % and 67.9 %, respectively. However, none of the Brazilian studies used confirmatory factor analysis to investigate the measure’s dimensionality, and there have been no validations with teachers.

Given the disparities in the number of NAQ factors found among Brazilian workers, the lack of studies explicitly targeting teachers, and the need for further evidence to confirm the instrument’s validity in Brazil, this study aims to examine the psychometric properties of the NAQ-R among Brazilian K12 teachers. We hypothesize that (H1) the instrument will exhibit a three- factor structure consistent with the original research (Einarsen et al., 2009) and (H2) will demonstrate convergent validity with indicators of common mental disorders, paralleling findings in the studies of Malik and Björkqvist (2019) , Inandi and Büyüközkan (2022) , Mościcka- Teske et al. (2014), and Bernotaite and Mali-nauskiene (2017) .

Method

Sample

The convenience sample included 10.148 teachers. The inclusion criteria for the sample stipulated that participants must be teachers working in public schools, ranging from Early Childhood Education to High School.

Most participants were female (81 %), aged 18 to 74 (M = 41.8; SD = 9.3). The teachers self-identified as Brown (51.2 %), White (35.5 %), Black (11.3 %), Asian (1.4 %), and Indigenous (0.7 %). The average per capita family income was R$ 2,282.8 (SD = 2,571.4). Geographically, 59.8 % worked in the Northeast, 25.2 % in the Southeast, 6.9 % in the Central-West, 5.9 % in the North, and 2.2 % in the South of Brazil.

In terms of educational background, most teachers reported having a specialization (63.9 %), a completed higher education degree (21.5 %), and a master’s degree (8.9 %). On average, they had 13.2 years of teaching experience (SD = 8.4) in public schools. Regarding the educational levels they taught, 15.7 % worked in Early Childhood Education, 39.7 % in Elementary School, 12.3 % in High School, 2.3 % in Special Education, 1.9 % in Youth and Adult Education, and 28.1 % engaged in teaching at multiple educational levels. The sample was randomly split into equal-sized groups: sample 1 for Exploratory Factor Analysis (EFA) and sample 2 for Confirmatory Factor Analysis (CFA). We detailed both samples in Table 1.

Table 1 Sociodemographic characteristics of participants 

Characteristic Sample 1 (n = 5074) Sample 2 (n = 5074)
n % n %
Sex
Female 4095 80.7 4121 81.2
Male 979 19.3 953 18.8
Race
Brown 2603 51.3 2593 51.1
White 1818 35.8 1787 35.2
Black 560 11 582 11.5
Asian 58 1.1 79 1.6
Indigenous 35 0.7 33 0.7
Educational background
High school a 41 0.8 42 0.8
Incomplete higher education degree 141 2.8 151 3.0
Higher education degree 1126 22.2 1053 20.8
Specialization 3199 63.0 3289 64.8
Master’s degree 480 9.5 424 8.4
Ph. D. 87 1.7 115 2.3
Country Region
Northeast 3028 59.7 3038 59.9
Southeast 1268 25.0 1290 25.4
Central-West 351 6.9 353 7.0
North 305 6.0 290 5.7
South 122 2.4 103 2.0
Educational levels
Early childhood education 785 15.5 805 15.9
Elementary school 1975 38.9 2053 40.4
High school 647 12.8 600 11.8
Youth and adult education 102 2.0 89 1.8
Special education 114 2.2 124 2.4
Multiple educational levels 1451 28.6 1403 27.7
M SD M SD
Age 42.0 9.4 41.6 9.2
Teaching experience (years) 13.4 8.5 12.9 8.3
Family income (BRL) 2296.8 2613.8 2268.9 2528.4

Note . a The “Magistério” is a technical secondary education program designed to train teachers in Brazil. This course prepares individuals to teach in early childhood education, elementary school, and high school.

To evaluate the cross-validation and factorial stability of the measurement, we randomly divided the sample into two groups of equal size. This method adheres to the recommendations of Laros (2005) and Schumacker and Lomax (2004) , aiming to figure out how replicable the factorial solution obtained in one dataset is within a second sample. This approach is particularly suitable when the sample size is sufficiently large to allow for the random division of respondents into two groups that are equivalent in sociodemographic characteristics. In the first of these samples, the factorial structure is derived using an exploratory factor analysis technique. In contrast, in the second sample, the cross-validation of the previously shown factorial solution is conducted using a different method, specifically confirmatory factor analysis.

Measures

Workplace Bullying

The NAQ-R measures exposure to workplace bullying over the preceding six months using a five-level response scale ranging from never to daily (Einarsen et al., 2009). The original version of NAQ-R comprises twenty-two items categorized into three factors: personal bullying (e.g., “Allegations were made against you”), work-related bullying (e.g., “You were humiliated or ridiculed because of your work”), and physically intimidating forms of bullying (e.g., “You were threatened with violence or physical abuse or were the target of actual violence”). Scores for each factor are derived by calculating the averages of their respective items.

The items on the scale do not explicitly mention “moral harassment;” instead, the assessment is based on the respondent’s self-perception of exposure to behaviors characteristic of workplace bullying (Christ, 2011). In its original study, the NAQ-R proved adequate internal consistency (α = .90).

For the Brazilian Portuguese adaptation of the NAQ-R, the translation process involved three independent translators focusing on linguistic and semantic aspects, followed by a back-translation into English. This back-translated version was compared with the original by the translators and the Norwegian authors, with discrepancies being discussed, corrected, and improved. The adapted version then underwent evaluation by five experts for relevance and cultural-semantic understanding. There was unanimous agreement on linguistic and semantic equivalence. The Brazilian Portuguese version of the NAQ-R kept the twenty-two original items and the self-perception item from the English version (Christ, 2011).

Common Mental Disorders

The Self-Reporting Questionnaire-20 (SRQ-20) is a screening tool for non-psychotic mental disorders (common mental disorders, CMDs), such as insomnia, difficulty concentrating, fatigue, headaches, and lack of appetite (e.g., “Do you easily get tired?”). This instrument includes twenty statements with binary response options of “yes” or “no.” Negative responses are scored as zero, while positive responses are scored as 1. The accumulated scores are then totaled, with a cut-off point proved at 7/8 to distinguish between the absence and presence of CMDs, respectively (Gonçalves et al., 2008). In its Brazilian validation study, the SRQ-20 proved adequate internal consistency (α = .86), a finding also seen in the current investigation (α = .96).

Procedure

The study employed an online self-administered questionnaire issued via the Internet. Informed onsent was obtained individually from all participants involved in the study.

Data Analysis

Data analysis was conducted using R (version 4.3.2) and RStudio (version 2023.12.0), incorporating various packages and metapackages, including tidyverse (version 2.0.0), tidymodels (version 1.1.1), MVN (version 5.9), psych (version 2.3.3), EFA.dimensions (version 0.1.8.1), EFAtools (version 0.4.4), lavaan (version 0.6- 17), semPlot (version 1.1.6), semptools (version 0.2.10), and semTools (version 0.5-6). Data from Sample 1 were analyzed using EFA. The process began by verifying the multivariate normality of the data through Mardia’s test. The Kaiser-Meyer- Olkin (KMO) adequacy index and Bartlett’s test of sphericity were also calculated to assess the factorability of the data matrix. Expectations were set for KMO values higher than .80 and a significant result in Bartlett’s test of sphericity (Damásio, 2012). We used parallel analysis and the Minimum Average Partial (MAP) to decide the number of factors to keep. We utilized oblimin rotation, considering the potential correlation between factors. Items with a factor loading greater than |.40| were kept.

Data from Sample 2 underwent CFA. As in Study 1, the assessment of multivariate normality of the data was conducted using Mardia’s test. Fit indices analyzed included the comparative fit index (CFI), Tucker-Lewis’s index (TLI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). Expected values for CFI and TLI were greater than .90, and for RMSEA and SRMR, less than .08 (Brown, 2015). The internal consistency of the measure was evaluated using Cronbach’s alpha and McDonald’s omega. Lastly, convergent validity was assessed through Spearman’s rank correlation between the NAQ-R and the SRQ-20 factors.

Results

Exploratory Factor Analysis

Multivariate skewness and kurtosis, according to Mardia, were both significant, writing down the data’s non-normal distribution (𝛽1,p = 172685.2, p < .001; 𝛽2,p = 1109.6, p < .001). The Kaiser- Meyer-Olkin (KMO) measure was .97, and Bartlett’s test of sphericity was significant (χ2(231) = 89753.5, p < .001), affirming the data matrix’s factorability. The data’s non-normality and the variables’ ordinal nature needed using a polychoric matrix and the Weighted Least Squares Mean and Variance adjusted (WLSMV) method for extraction.

Parallel analysis and the Minimum Average Partial (MAP) suggested keeping up to five and two factors, respectively. However, models with three, four, and five dimensions lacked theoretical coherence. The two-factor structure merged fifteen items under “personal bullying” and six under “work-related bullying.” Item 1, “Someone withheld information that could affect your work performance”, did not achieve a factor loading above |.40| and was thus excluded from CFA. The two factors accounted for 61 % of the variance. The results of the exploratory factor analysis are presented in Table 2.

Table 2 Results from an exploratory factor analysis of the Negative Acts Questionnaire-Revised (NAQ -R) 

Items Factor Loadings
1 2
Factor 1: Personal bullying
1. Someone withholding information which affects your performance at work. .399 .164
2. You were humiliated or ridiculed because of your work. .713 .104
5. Spreading of gossip and rumors about you. .987 -.252
6. Being ignored, excluded, or put on the back burner. .719 .102
7. Having insulting or offensive remarks made about your person, attitudes, or your private life. .997 -.208
8. Being shouted at or being the target of spontaneous anger. .772 .051
9. Intimidating behaviors such as finger-pointing, invasion of personal space, shoving, blocking your way. .787 .076
10. Hints or signals from others that you should quit your job (transfer yourself to another unit). .687 .193
11. Repeated reminders of your errors or mistakes. .680 .146
12 Being ignored or facing a hostile reaction when you approach. .703 .190
13. Persistent criticism of your work and effort. .685 .175
14. Having your opinions and viewpoints ignored. .501 .273
15. Practical jokes conducted by people you don’t get along with. .651 .107
17. Allegations were made against you. .816 .085
20. Being the subject of excessive jokes and sarcasm .700 .204
22. You were threatened with violence or physical abuse or were the target of actual violence. .655 .194
Factor 2: Work-related bullying
3. Being ordered to do work below your level of competence. .233 .573
4. Having key areas of responsibility removed or replaced with more trivial or unpleasant tasks. .245 .548
16. Were asked to perform tasks that were unreasonable or with an impossible deadline to meet. .097 .687
18. Excessive monitoring of your work. .287 .559
19. Pressure not to claim something to which by right you are entitled. .341 .538
21. Being exposed to an excessive workload -.069 .677

Note. N = 5074. The extraction method was WLSMV with an oblique (oblimin) rotation. Factor loadings above .40 are in bold. The items’ content aligns with the Brazilian Portuguese version of the NAQ-R and may not directly correspond to the content of the original English version.

Confirmatory Factor Analysis

Mardia’s test for multivariate normality revealed a non-normal distribution of data (𝛽1,p = 161962.8, p < .001; 𝛽2,p = 1028.6, p < .001). The WLSMV method was employed again as the estimation method. The CFA of the NAQ-R showed inadequate robust fit indices (Brosseau-Liard & Savalei, 2014). Consequently, modification indices were reviewed, leading to the decision to correlate residuals of items with similar content (5 and 7; 3 and 4; 8 and 9). These correlations were added progressively to the model until the fit indices reached acceptable levels, except RMSEA (Byrne, 1994). We present the conventional, scaled, and robust fit indices in Table 3.

Table 3 Fit indices for the confirmatory factor analysis of the Negative Acts Questionnaire - Revised (NAQ-R) 

Fit Indicator Model 1 Model 2
CFI .992 .995
CFI scaled .944 .965
CFI robust .873 .916
TLI .991 .994
TLI scaled .937 .906
TLI robust .858 .905
RMSEA .050 .038
(90 % CI) [.048, .051] [.037, .040]
RMSEA scaled .067 .053
(90 % CI) [.065, .068] [.052, .055]
RMSEA robust .109 .089
(90 % CI) [.109, .106] [.089, .086]
SRMR .049 .041

Note. CFI = comparative fit index, TLI = Tucker-Lewis’s index, RMSEA = root mean square error of approximation, SRMR = standardized root mean square residual.

In the final model, all items proved factor loadings above .50 (Stevens, 2009). The standardized factor loadings are depicted in Figure 1.

Figure 1 Results from a confirmatory factor analysis of the Negative Acts Questionnaire-Revised (NAQ -R) 

Internal Consistency and Convergent Validity

The reliability of the NAQ-R factors was found to be satisfactory (personal bullying: α = .93, ω = .79; work-related bullying: α = .92, ω = .74). Additionally, positive correlations between the NAQ-R factors and the SRQ-20 were seen, showing convergent validity (personal bullying: rs(10,146) = .27, p < .001; work-related bullying rs(10,146) = .33, p < .001).

Discussion

The objective of this study was to investigate the psychometric properties of the NAQ within the context of Brazilian K-12 educators, incorporating exploratory and confirmatory factor analyses alongside convergent validity. The findings showed a two-factor structure for the NAQ-R, including personal bullying and work-related bullying. The instrument proved proper fit indices, internal consistency, and convergent validity evidence with a mental health measure.

Exploratory factor analysis revealed that two underlying factors of the NAQ-R accounted for 61 % of the variance in item responses, aligning with the results of similar international studies (Abe & Henly, 2010; Verdasca, 2008). Conversely, other investigations have reported lower explained variances for the instrument’s factors in comparison to the findings of the current study (Giorgi et al., 2011; González-Trijueque & Gómez, 2013; León- Pérez et al., 2019; Makarem et al., 2018; Simons et al., 2011; Tsuno et al., 2010).

Contrasting with the original study (Einarsen et al., 2009), this investigation found that items associated with the “Physically intimidating bullying” factor were grouped under the “Personal bullying” factor. This finding does not support the H1 outlined in the study.

The amalgamation between those factors is rationalized since statements about physical intimidation are variations of personal bullying, albeit standing for more severe violence forms. This finding echoes other NAQ-R adaptations (Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017), including studies with teachers (Charilaos et al., 2015), where similar integration of these factors was seen.

Item 1, “Someone withholding information which affects your performance at work,” did not reach a factor loading above |0.40| and was excluded from the confirmatory analysis, a result that aligns with another study where this item also received no endorsement (Abe & Henly, 2010). Given a teacher’s autonomy in classroom management and work performance, withholding information may take time to affect their work. Conversely, teachers generate student-related information, typically shared with colleagues.

In contrast to the original study (Einarsen et al., 2009), “Having key areas of responsibility removed or replaced with more trivial or unpleasant tasks” aligned with the work-related bullying factor instead of personal bullying. This item’s focus on work tasks justifies its categorization in this dimension, as corroborated by other studies (Charilaos et al., 2015; Dujo López et al., 2020; Erwandi et al., 2021; Giorgi et al., 2011; González-Trijueque & Gómez, 2013; Makarem et al., 2018; Nam et al., 2010; Takaki et al., 2010).

Also deviating from the original version of the NAQ-R (Einarsen et al., 2009), the statement “Having your opinions and viewpoints ignored” was included in the personal bullying factor. This item’s retention in this dimension is plausible as it involves devaluing personal stances, extending beyond professional opinions. Equivalent results were noted in other studies (Dujo López et al., 2020; González-Trijueque & Gómez, 2013; Makarem et al., 2018; Takaki et al., 2010).

The NAQ-R’s CFA yielded acceptable fit indices, showing that the theoretical measurement model aligns well with the empirical data (Hair et al., 2009). This outcome is consistent with earlier studies, where the two-factor structure showed suitable fit indices (Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017). The original study posited that both unidimensional and two-factor structures showed good fit indices, though the data favored a three-factor structure (Einarsen et al., 2009). Cultural differences may account for the variations between this study, the original research, and other global instrument validations.

Finally, the NAQ-R in this study proved internal consistency measures of reliability above the desirable threshold for both factors, aligning with past research that found adequate reliability for the two-factor structure (Rai & Agarwal, 2017). The correlation between the NAQ-R factors in this study shows that the instrument’s dimensions are interrelated, supporting the use of oblique rotation methods for more nuanced interpretation. Consistent with the original NAQ-R validation study, the high correlation between the factors shows that personal and work-related bullying often co-occur in the work environment (Einarsen et al., 2009).

The NAQ-R factors positively correlated with CMDs, supporting the measure’s convergent validity. This result supports H2 of the study. Similar validity evidence has been found in other studies that correlated the NAQ-R with instruments assessing mental health (e.g., Erwandi et al., 2021; Makarem et al., 2018; Charilaos et al., 2015). Workplace bullying, encompassing victimization primarily causing psychological harm (Einarsen et al., 2009), suggests that negative behaviors like threats, humiliation, intimidations, and physical aggressions can inflict significant mental health damage. A study involving teachers (Pinheiro et al., 2023) highlighted the association between physical aggression, verbal harassment, and psychological harm. Moreover, these results align with other research exploring the impact of school violence on teacher health (Wilson et al., 2011).

Strengths and Limitations

This study faced limitations. The use of convenience sampling restricts the generalizability of the results. Nonetheless, the factorial structure aligns with earlier studies (Charilaos et al., 2015; Giorgi et al., 2011; Makarem et al., 2018; Rai & Agarwal, 2017) conducted in different contexts, suggesting the measure’s robustness.

Another limitation concerns the inherent nature of self-report scales, which do not provide causal explanations for the observed phenomena. High scores on the NAQ-R show the presence of workplace bullying but offer limited insight into the underlying reasons for this phenomenon. While helpful for screening workplace bullying, deeper understanding needs added research approaches, such as qualitative methods. The NAQ-R is a measure that can generate hypotheses and aid in intervention planning. Despite these limitations, the study employed rigorous methods appropriate to the data and conducted comprehensive analyses to show evidence of the instrument’s validity, with the substantial sample size being noteworthy.

Recommendations for Future Research and Intervention

Future research extending the psychometric analysis of the NAQ-R and exploring its properties among other Brazilian worker samples could contribute to a better understanding of workplace bullying in Brazil. It is valuable to set up evidence of convergent and predictive validity through the NAQ-R’s relationship with external measures and its use in predicting work-related psychological phenomena (e.g., mental health, burnout, engagement, job satisfaction, turnover, productivity, absenteeism).

The NAQ-R can support effective interventions, informed by the detection of workplace bullying, which could include the formulation of organizational policies against harassment, information dissemination through manuals and training, adoption of ethical leadership styles, and management reorganization. These initiatives require senior management’s support and active involvement (Glina & Soboll, 2012).

References

Abe, K., & Henly, S. J. (2010). Bullying (ijime) among japanese hospital nurses: Modeling responses to the revised Negative Acts Questionnaire. Nursing Research, 59(2), 110-118. https://doi.org/10.1097/NNR.0b013e3181d1a709Links ]

Amazarray, M. R. (2010). Violência psicológica e assédio moral no trabalho enquanto expressões de estratégias de gestão [Psychological violence and moral harassment at work as expressions of management strategies] [Doctoral dissertation, Universidade Federal do Rio Grande do Sul]. Lume, Repositório Institucional. https://lume.ufrgs.br/handle/10183/26083Links ]

Bernotaite, L., & Malinauskiene, V. (2017). Work-place bullying and mental health among teachers in relation to psychosocial job characteristics and burnout. International Journal of Occupational Medicine and Environmental Health, 30(4), 629. https://doi.org/10.13075/ijomeh.1896.00943Links ]

Brosseau-Liard, P. E., & Savalei, V. (2014). Adjusting incremental fit indices for nonnormality. Multi-variate Behavioral Research, 49(5), 460-470. https://doi.org/10.1080/00273171.2014.933697Links ]

Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications. [ Links ]

Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows. Sage Publications. [ Links ]

Charilaos, K., Michael, G., Chryssa, B.-T., Panagiota, D., George, C. P., & Christina, D. (2015). Validation of the Negative Acts Questionnaire (NAQ) in a sample of Greek teachers. Psychology, 6, 63-74. http://doi.org/10.4236/psych.2015.61007Links ]

Christ, H. D. (2011). Estudo de adaptação e fidedignidade do questionário de atos negativos: revisado (QAN-R) para o português do [Adaptation and reliability study of the negative acts questionnaire - revised (NAQ-R) into Brazilian Portuguese Brasil] [Master’s thesis, Pontifícia Universidade Católica do Rio Grande do Sul]. TEDE, PUCRS. https://tede2.pucrs.br/tede2/handle/tede/772Links ]

Damásio, B. F. (2012). Uso da análise fatorial exploratória em psicologia [Uses of exploratory factorial analysis in psychology]. Avaliação Psicológica, 11(2), 213-228. http://pepsic.bv-salud.org/scielo.php?script=sci_arttext&pi-d=S1677-04712012000200007&lng=pt&nr-m=iso&tlng=ptLinks ]

Dujo López, V., González Trijueque, D., Graña Gómez, J. L., & Andreu Rodríguez, J. M. (2020). A psychometric study of a Spanish version of the Negative Acts Questionnaire-Revised: Confirmatory factor analysis. Frontiers in Psychology, 11(1856), Article 1856. https://doi.org/10.3389/fpsyg.2020.01856Links ]

Einarsen, S., Raknes, B. I., & Matthiesen, S. B. (1994). Bullying and harassment at work and their relationships to work environment quality: An exploratory study. European Work and Organizational Psychologist, 4(4), 381-401. https://doi.org/10.1080/13594329408410497Links ]

Einarsen, S., & Raknes, B.I. (1997). Harassment in the workplace and the victimization of men. Violence and Victims, 12(3), article 247263. https://doi.org/10.1891/0886-6708.12.3.247Links ]

Einarsen, S., Hoel, H., Zapf, D., & Cooper, C. (2003). Bullying and emotional abuse in the workplace: International perspectives in research and practice. Taylor & Francis. https://doi.org/10.1201/9780203164662Links ]

Einarsen, S., Hoel, H., & Notelaers, G. (2009). Measuring exposure to bullying and harassment at work: Validity, factor structure and psychometric properties of the Negative Acts Questionnaire- Revised. Work & Stress, 23(1), 24-44. https://doi.org/10.1080/02678370902815673Links ]

Erwandi, D., Kadir, A., & Lestari, F. (2021). Identification of workplace bullying: Reliability and validity of Indonesian version of the Negative Acts Questionnaire-Revised (NAQ-R). International Journal of Environmental Research and Public Health, 18(8), Article 3985. https://doi.org/10.3390/ijerph18083985Links ]

Giorgi, G., Arenas, A., & Leon-Perez, J. M. (2011). An operative measure of workplace bullying: The negative acts questionnaire across Italian companies. Industrial Health, 49(6), 686-695. https://doi.org/10.2486/indhealth.MS1287Links ]

Glina, D. M. R., & Soboll, L. A. (2012). Bullying at work interventions: A literature review. Revista Brasileira de Saúde Ocupacional, 37(126), 269-283. https://doi.org/10.1590/S0303-76572012000200008Links ]

Gonçalves, D. M., Stein, A. T., & Kapczinski, F. (2008). Avaliação de desempenho do Self-Reporting Questionnaire como instrumento de rastreamento psiquiátrico: Um estudo comparativo com o Structured Clinical Interview for DSM-IV-TR [Performance of the Self-Reporting Questionnaire as a psychiatric screening questionnaire: A comparativestudy with Structured Clinical Interview for DSM-IV-TR]. Cadernos de Saúde Pública, 24(2), 380-390. https://doi.org/10.1590/S0102-311X2008000200017Links ]

González-Trijueque, D., & Gómez, J. L. G. (2013). Adaptación psicométrica de una versión española del cuestionario de conductas negativas revisado (NAQ-R) [Psychometric adaptation of a Spanish version of the negative acts questionnaire revised (NAQ-R)]. Psicopatología Clínica Legal y Forense, 13(1), 7-28. https://masterforense.com/pdf/2013/2013art1.pdfLinks ]

Gupta, R., Bakhshi, A., & Einarsen, S. (2017). Investigating workplace bullying in India: Psychometric properties, validity, and cutoff scores of Negative Acts Questionnaire-Revised. SAGE Open, 7(2), 1-12. https://doi.org/10.1177/2158244017715674Links ]

Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2009). Multivariate data analysis. A global perspective. Pearson. [ Links ]

Inandi, Y., & Büyüközkan, A. S. (2022). The relationship between mobbing, alienation, and burnout among teachers in Mersin, Turkey. South African Journal of Education, 42(1), Article 1990. https://doi.org/10.15700/saje.v42n1a1990Links ]

Laros, J. A. (2005). O uso de análise fatorial: Algumas diretrizes para pesquisadores [The use of factor analysis: Some guidelines for researchers]. In L. Pasquali (Eds.), Análise fatorial para pesquisadores [Factor analysis for researchers] (pp. 163-184). LabPAM. [ Links ]

León-Pérez, J. M., Sánchez Iglesias, I., Rodríguez Muñoz, A., & Notelaers, G. (2019). Cutoff scores for workplace bullying: The Spanish short-negative acts questionnaire (S-NAQ). Psicothema, 31(4), 482-490. https://doi.org/10.7334/psicothema2019.137Links ]

Leymann, H. (1996). The content and development of mobbing at work. European Journal of Work and Organizational Psychology, 5(2), 165-184. https://doi.org/10.1080/13594329608414853Links ]

Maciel, R. H., & Gonçalves, R. C. (2008). Pesquisando o assédio moral: A questão do método do Negative Acts Questionnaire (NAQ) para o Brasil [Researching bullying: The issue of the Negative Acts Questionnaire (NAQ) method for Brazil]. In L. A. P. Soboll (Org.). Violência psicológica e assédio moral no trabalho [Psychological violence and moral harassment in work]. Casa do Psicólogo. [ Links ]

Makarem, N. N., Tavitian-Elmadjian, L. R., Brome, D., Hamadeh, G. N., & Einarsen, S. (2018). Assessment of workplace bullying: Reliability and validity of an Arabic version of the Ne gative Acts Questionnaire-Revised (NAQ-R). BMJ Open, 8(12), Article e024009. https://doi.org/10.1136/bmjopen-2018-024009Links ]

Malik, N. A., & Björkqvist, K. (2019). Workplace bullying and occupational stress among university teachers: Mediating and moderating factors. Europe’s Journal of Psychology, 15(2), 240-259. https://doi.org/10.5964/ejop.v15i2.1611Links ]

Modesto, C. (2022, May 3). Em 2021, Justiça do Trabalho registrou mais de 52 mil casos de assédio moral no Brasil [In 2021, Labor Justice registered more than 52 thousand cases of moral harassment in Brazil]. Justiça do Trabalho - Tribunal Regional do Trabalho da 13ª Região. https://www.trt13.jus.br/informe-se/noticias/em-2021-justica-do-trabalho-registrou-mais-de-52-mil-casos-de-assedio-moral-no-brasilLinks ]

Mościcka-Teske, A., Drabek, M., & Pyżalski, J. (2014). Experienced bullying and hostile behavior in the workplace and symptoms of burnout in teachers. Medycyna Pracy, 65(4), 535-542. https://doi.org/10.13075/mp.5893.00017Links ]

Nam, W., Kim, J. W., Kim, Y. K., Koo, J. W., & Park, C. Y. (2010). The reliability and validity of the negative acts questionnaire-revised (NAQ-R) for nurses for the assessment of workplace bullying. Korean Journal of Occupational and Environmental Medicine, 22(2), 129-139. https://doi.org/10.35371/kjoem.2010.22.2.129Links ]

Pinheiro, F. P. H. A., Aquino, C. A. B. de, Vieira, E. M., Marques, N. S., Vieira, C. A. L., Cunha, E. S., Aguiar, H. M. T., Feijão, A. R. C., & Rodrigues,H. M. P. (2023). Effects of school violence and work context on teachers’ health. Psico, 54(1), Article e37756. https://doi.org/10.15448/1980-8623.2023.1.37756Links ]

Rai, A., & Agarwal, U. A (2017), Exploring nature of workplace bullying and psychometric properties of negative acts questionnaire-revised (NAQ-R) in Indian organizations. Journal of Indian Business Research, 9(3), 229-247. https://doi.org/10.1108/JIBR-12-2016-0145Links ]

Scheeler, M. C., Markelz, A., Taylor, J. C., Deshpande, D. S., & Wolfe, P. (2022). Teacher workplace bullying: How pervasive is the problem? Teacher Education and Special Education, 45(2), 123-140. https://doi.org/10.1177/08884064211015698Links ]

Schumacker, R. E., & Lomax, R. G. (2004). A beginner’s guide to structural equation modeling. Psychology Press. [ Links ]

Silva, I. V., Aquino, E. M. L., & Pinto, I. C. M. (2017). Características psicométricas do Negative Acts Questionnaire para detecção do assédio moral no trabalho: Estudo avaliativo do instrumento com uma amostra de servidores estaduais da saúde [Psychometric properties of the Negative Acts Questionnaire for the detection of workplace bullying: An evaluation of the instrument with a sample of state health care Workers]. Revista Brasileira de Saúde Ocupacional, 42, 1-9. https://doi.org/10.1590/2317-6369000128715Links ]

Simons, S. R., Stark, R. B., & DeMarco, R. F. (2011). A new, four-item instrument to measure workplace bullying. Research in Nursing & Health, 34(2), 132-140. https://doi.org/10.1002/nur.20422Links ]

Stevens, J. P. (2009). Applied multivariate statistics for the social sciences. Routledge. https://doi.org/10.4324/9780203843130Links ]

Takaki, J., Tsutsumi, A., Fujii, Y., Taniguchi, T., Hirokawa, K., Hibino, Y., Lemmer, J. R., Nashiwa, H., Wang, D., & Ogino, K. (2010). Assessment of workplace bullying and harassment: Reliability and validity of a Japanese version of the negative acts questionnaire. Journal of Occupational Health, 52(1), 74-81. https://doi.org/10.1539/joh.O9011Links ]

Tsuno, K., Kawakami, N., Inoue, A., & Abe, K. (2010). Measuring workplace bullying: Reliability and validity of the Japanese version of the negative acts questionnaire. Journal of Occupational Health, 52(4), 216-226. https://doi.org/10.1539/joh.L10036Links ]

Verdasca, A. T. (2008, November 29-30). Portuguese validation of the negative acts questionnaire revised (NAQ-R) [Conference presentation]. Socius Working Papers. https://www.repository.utl.pt/bitstream/10400.5/1913/1/WP.6.2008.pdfLinks ]

Wet, C., & Jacobs, L. (2021). Workplace bullying, emotional abuse, and harassment in schools. In P. D’Cruz, E. Noronha, L. Keashly & S. Tye-Williams (Eds.), Special topics and particular occupations, professions, and sectors. Handbooks of workplace bullying, emotional abuse, and harassment (pp. 187-219). Springer. https://doi.org/10.1007/978-981-10-5308-5_11Links ]

Wilson, C. M., Douglas, K. S., & Lyon, D. R. (2011). Violence against teachers: Prevalence and consequences. Journal of Interpersonal Violence, 26(12), 2353-2371. https://doi.org/10.1177/0886260510383027Links ]

To reference this article: Sá Cunha, E., Huascar, A. P. F., de Moura, A., da Rocha, J., Silva, d. W., Lima, F., Queiroz, A., & Albuquerque, L. (2024). Assessing workplace bullying: Psychometric analysis of the Negative Acts Questionnaire-Revised (NAQ-R) among brazilian teachers. Avances en Psicología Latinoamericana, 42(2), 1-16. https://doi.org/10.12804/revistas.urosario.edu.co/apl/a.14321

Funding The authors disclosed receipt of the following financial support for the research of this article: This work was supported by the Fundação Cearense de Apoio ao Desenvolvimento Científico e Tecnológico (Funcap) [grant number - BP4-0172-00166.01.00/20 and BP5-0197-00046.01.00/22] and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) [grant number - 403787/2023-8].

Ethical Approval The research project received approval from the Research Ethics Committee of the Universidade Estadual Vale do Acaraú under the number 39276720.5.0000.5053. This approval aligned with the guidelines outlined in 466/12 and 510/16 of the Brazilian National Health Council.

Anexo 1

Versão em português do Negative Acts Questionnaire - Revised (NAQ-R)

Assédio moral pessoal

2 Foi humilhado(a) ou ridicularizado(a) em relação ao seu trabalho

5 Espalharam boatos ou rumores sobre você

6 Foi ignorado(a), excluído(a) ou “colocado(a) na geladeira”

7 Foram feitos comentários ofensivos sobre a sua pessoa, suas atitudes ou sobre sua vida privada

8 Gritaram com o(a) Sr(a) ou o(a) Sr(a) foi alvo de agressividade gratuita

9 Foi alvo de comportamentos intimidativos, tais como “apontar o dedo”, invasão do seu espaço pessoal, empurrões

10 Recebeu sinais ou dicas de que você deve pedir demissão ou largar o emprego (transferir-se para outra unidade)

11 Foi constantemente lembrado dos seus erros ou omissões

12 Foi ignorado ou foi recebido com uma reação hostil quando tentou uma aproximação

13 Recebeu críticas persistentes ao seu trabalho e esforço

14 Suas opiniões e pontos de vista foram ignorados

15 Pessoas com as quais você não tem intimidade lhe aplicaram “pegadinhas”

17 Foram feitas alegações contra o(a) Sr(a)

20 Foi submetido a sarcasmos ou alvo de brincadeiras excessivas

22 Foi ameaçado(a) de violência ou abuso físico ou foi alvo de violência real

Assédio moral profissional

3 Foi obrigado(a) a realizar um trabalho abaixo do seu nível de competência

4 Áreas ou tarefas de sua responsabilidade foram retiradas ou substituídas por tarefas mais desagradáveis ou mais simples

16 Foi solicitado(a) a realizar tarefas despropositadas ou com um prazo impossível de ser cumprido

18 Sofreu supervisão excessiva de seu trabalho

19 Foi pressionado a não reclamar um direito que o(a) Sr(a) tem

21 Foi exposto a uma carga de trabalho excessiva

Received: April 30, 2024; Accepted: December 12, 2024

Correspondence concerning this article should be addressed to Esthela Sá Cunha, Curso de Psicologia, Faculdade 5 de Julho, Av. Estrada do Jordão, s/nº - KM 02, Ac - Jordão, Sobral - CE. E-mail: esthelasa7@gmail.com. Phone: +55(88) 98196-4199

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License