SciELO - Scientific Electronic Library Online

vol.35 issue2Outcome assessment of patients classified through the Manchester Triage System in emergency units in Brazil and PortugalOverweight and Obesity Conditions: Prevalence and Associated Risk Factors in Nursing Students in a Public University in Medellín, Colombia author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand




Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google


Investigación y Educación en Enfermería

Print version ISSN 0120-5307On-line version ISSN 2216-0280

Invest. educ. enferm vol.35 no.2 Medellín May/Aug. 2017 

Original article

Questionnaire to Measure the Participation of Nursing Professionals in Mentoring Students

Questionário para medir a participação dos profissionais de enfermagem na tutela de estudantes

Agueda Cervera-Gasch1 

Loreto Macia-Soler2 

Blanca Torres-Manrique3 

Desirée Mena-Tudela4 

Pablo Salas-Medina5 

María Isabel Orts-Cortes6 

Víctor M González-Chordá7 

1 Nurse, Ph.D. Professor, Universitat Jaume I -UJI-, Spain. email:

2 Nurse, Ph.D. Professor, Universidad de Alicante, Spain. email:

3 Nurse, Ph.D. Professor, Universidad de Cantabria, Spain. email:

4 Nurse, Ph.D. Professor, Universitat Jaume I, Spain. email:

5 Nurse, Ph.D. Professor, Universitat Jaume I, Spain. email:

6 Nurse, Ph.D. Professor, Universidad de Alicante, Spain. email:

7 Nurse, Ph.D. Professor, Universitat Jaume I, Spain. email:



The aim herein was to validate a questionnaire to measure the level of participation of clinical nursing professionals in the mentorship of nursing students during clinical practices.


Design and validation of a questionnaire. The psychometric properties of the tool were determined through four phases: 1- literature review; 2- evaluation of content validity; 3- pilot test, cognitive pretest and intra-observer reliability study; 4- construct validity study through an exploratory factor analysis of main components with varimax rotation in a sample of 249 nursing professionals from primary care and hospital care from different Spanish provinces. The internal consistency was studied with Cronbach’s alpha coefficient.


The global content validity was above 0.8. The final version of the questionnaire had 33 items, with a global intraclass correlation coefficient of 0.852 and Cronbach’s alpha of 0.837. Factor analysis explained 55.4% of the total variance, with a solution of five factors that made up the dimensions: Implication, Motivation, Satisfaction, Obstacles, and Commitment.


The questionnaire evaluated has adequate validity and reliability to permit determining the level of nurse participation in the mentorship of students.

Desctriptors: nursing education; clinical clerkship; mentors; validation studies



Validar um questionário para medir o nível de participação dos profissionais de enfermagem clínicos na tutela de estudantes de enfermagem durante as práticas clínicas.


Desenho e validação de um questionário. Se determinaram as propriedades psicométricas da ferramenta mediante quatro fases: 1- revisão da literatura; 2- avaliação da validez de conteúdo; 3- prova piloto, pré-teste cognitivo e estudo da fiabilidade intra-observador; 4-, estudo de validez de construto mediante uma análise fatorial exploratório de componentes principais com rotação varimax numa amostra de 249 profissionais de enfermagem de atenção primária e de atenção hospitalar de diferentes províncias espanholas. A consistência interna se estudou com o coeficiente Alfa de Cronbach.


A validez de conteúdo global foi superior a 0.8. A versão final do questionário foi de 33 itens, com um CCI global de 0.852 e um alfa de Cronbach de 0.837. A análise fatorial explicou que 55.4% de variância total, com uma solução de cinco fatores que formaram as dimensões; Implicação, Motivação, Satisfação, Obstáculos e Compromisso.


O questionário avaliado tem validez e fiabilidade adequadas que permite determinar o nível de participação das enfermeiras na tutela de estudantes.

Descritores: educação em enfermagem; estágio clínico; mentores; estudos de validação



Validar un cuestionario para medir el nivel de participación de los profesionales de enfermería clínicos en la tutela de estudiantes de enfermería durante las prácticas clínicas.


Diseño y validación de un cuestionario. Se determinaron las propiedades psicométricas de la herramienta mediante cuatro fases: 1- revisión de la literatura; 2- evaluación de la validez de contenido; 3- prueba piloto, pretest cognitivo y estudio de la fiabilidad intraobservador; 4-, estudio de validez de constructo mediante un análisis factorial exploratorio de componentes principales con rotación varimax en una muestra de 249 profesionales de enfermería de atención primaria y de atención hospitalaria de diferentes provincias españolas. La consistencia interna se estudió con el coeficiente Alfa de Cronbach.


La validez de contenido global fue superior a 0.8. La versión final del cuestionario fue de 33 ítems, con un CCI global de 0.852 y un alfa de Cronbach de 0.837. El análisis factorial explicó el 55.4% de varianza total, con una solución de cinco factores que formaron las dimensiones Implicación, Motivación, Satisfacción, Obstáculos y Compromiso.


El cuestionario evaluado tiene validez y fiabilidad adecuadas que permite determinar el nivel de participación de las enfermeras en la tutela de estudiantes.

Descriptores: educación en enfermería; prácticas clínicas; mentores; estudios de validación


Clinical practices comprise around 50% of the educational programs in Nursing; not only in the European Union, but in the rest of the world,1 so that clinical nurses are a key element to help students acquire skills2 due to direct relationship both have during clinical practices.3 All students have during their clinical learning several figures with greater or lesser involvement with the university and distinct denominations. This research focused on the role of clinical nursing with mentorship function and without formal ties to the student’s university of origin. To conduct mentorship of students, it is important for nursing care professionals to maintain ties with the university and receive prior formation in mentorship of students, although it is true that a variability exists in this process.4-6 Diversity exists in the terms that describe professionals who mentor students in the clinical setting due to the different health and educational systems in the world. In all cases, these are nursing care professionals who guide students, as a model to imitate who helps to integrate theory and practice.7,8

Jokelainen et al.,6 state that the functions of practice mentors are confusing and provide a conceptual framework with four principal functions: (i) create an environment of solidarity learning; (ii) that permits a process of individual learning; (iii) development of empowerment of professional attributes and identity; (iv) achieve improvement in professional skills. These functions are developed within a context that combines the culture of two complex organizations: university and health center. Lack of time, work overload, or institutional support can limit the availability of nursing professionals to carry out adequately the mentor function.9,10 In some cases, deficiencies exist in teaching methodology, lack of clear evaluation criteria,11 or inadequate communication between professors and mentors, which are obstacles that can have negative impact on student evaluations during the clinical practices.12

Further, nursing professionals must have skills, like experience, enthusiasm, positive attitude,5,13) commitment, and level of implication6,9 necessary to achieve effective learning. Formation from the university on aspects related to teaching methodology, evidence-based practice, or the educational program and the evaluation tools are well-received by clinical professionals who mentor students and contribute improvement to student learning.14-16) In synthesis, adequate mentorship of students by nursing care professionals during clinical practices requires fluent institutional relationships between the university and health services, besides pedagogic, clinical, and academic attributes of the practice mentors, which along with experience, improve the quality of clinical learning1 and by extension, the formation of future nurses. In the literature reviewed, no tools have been found to measure the level of participation of clinical professionals in mentoring students. Hence, the objective of this research study was to design and validate a questionnaire that permits determining the level of participation of nursing care professionals in mentoring nursing students during clinical practices.


This study was conducted to design and validate a questionnaire that permits knowing the participation of nursing professionals in mentoring nursing students during their clinical practices within the setting of Spanish universities. The study was conducted between January and November of 2014. The following phases were carried out:

Phase I: Literature review. A literature review was conducted to obtain a battery of items related to mentoring nursing students, which was carried out by combining the descriptors ‘Survey’, ‘Mentor’, ‘Preceptor’, ‘Clinical learning’, ‘Clinical training’, and ‘Nursing’. PubMed, CINAHL, SciELO, and ERIC databases were consulted to recover all the research articles of interest in English and Spanish between 2009 and 2014; this permitted the recovery of 324 articles and 27 were included in the study because they are directly related to the study theme. Many of the articles included were from qualitative methodology and a systematic review. The items were obtained through abstraction of content and were grouped into four initial dimensions (Implication, Motivation, Satisfaction, and Obstacles). This literature review based the first version on the items from the questionnaire.

Phase II: Content validity. Five nursing professionals who are experts in educational innovation participated; these had PhD or Masters academic level and over 10 years of teaching experience in nursing assignments with clinical practices in different Spanish universities. They received, via e-mail, the initial version of the questionnaire to evaluate through a four-point ascending Likert scale if each of the items fit the construct; also, they were asked to propose new items in an open space where they could express their general opinion on the questionnaire. The experts were given a week to complete the evaluation. One round was sufficient to reach adequate consensus levels. The content validity analysis was conducted by following the methodology by Polit and Beck;17 the content validity index, CVI, (adequate validity I-CVI ≥0.8) was calculated for each item and the global coefficient of content validity (adequate validity S-CVI ≥0.8) was calculated for the questionnaire and for each dimension. Content validity results and comments from the experts were considered in the elaboration of the second version of the questionnaire.

Phase III: Pilot test, cognitive pretest and intra-observer reliability. With version 2 of the questionnaire, a pilot test and cognitive pretest were run to detect possible comprehension problems, response of items, and comprehension in general, with a group of 30 nursing care professionals from different health centers near Castellón, a branch of Universidad Jaume I, and where the nursing students conduct their practices. Upon completion, a researcher asked for possible comprehension problems of the items, response categories, encoding, and functioning of the dimensions. Besides, the formal aspect and compliance time were evaluated. This phase also studied intra-observer reliability: in the same sample a re-test was applied with a new delivery of the questionnaire three weeks later, and intra-observer reliability was studied with the intraclass correlation coefficient (ICC; excellent agreement ICC ≥0.75). Also, a first internal consistency analysis was performed with Cronbach’s alpha.

Phase IV: Construct validation and internal consistency. To finish the validation process, the questionnaire’s psychometric properties were studied in a sample of 249 nursing professionals who mentored nursing students in primary care and hospital care from different Spanish provinces, through convenience sampling. Construct validity was studied with exploratory factor analysis of main components with varimax rotation and the amount of dimensions from the third version of the questionnaire was examined. This version of the questionnaire was introduced into electronic support with Google Drive and the data were collected by sending e-mails that included a presentation letter with the objectives and methodology of the study and the link for the questionnaire. The nursing professionals answered the items from the questionnaire with a five-level Likert-type scale (1: Totally disagree; 2: Disagree; 3: Neither agree nor disagree; 4: Agree; 5: Totally agree). Sociodemographic variables, like age and work environment (primary care, specialized care, or social-health care) were collected. The viability of the factor analysis was confirmed with Bartlett’s sphericity test and the Kaiser-Meyer-Olkin test (acceptable KMO test ≥0.7). The research group discussed including items with factor loading below 0.4. The global internal consistency and that of each dimension was studied with Cronbach’s alpha coefficient (acceptable consistency α ≥0.7). Statistical analysis was performed via Excel and the SPSS statistical package V21 for IOS operating system. The statistical significance level was established at p ≤0.05.

Ethical considerations. Informed signed consent was obtained from all the experts and nursing professionals participating in the study. The questionnaire sent via e-mail to the nursing care professionals did not request data of personal nature that would permit their identification and their compliance was completely volunteer. All the information was maintained encoded under a password to guarantee data confidentiality. At all times, respect was upheld for the ethical principles of the Helsinki Declaration of October 2013 and the Spanish legislation regarding the protection of data of personal nature, Legislation 15/199918.


Table 1 shows the modifications in the number of items and dimensions as the questionnaire’s validation process advanced.

Table 1 Validation process through phases 

After the literature review, the research team constructed the first version (v1) of the questionnaire, with four dimensions: Implication (15 items), Motivation (11 items), Satisfaction (11 items), and Obstacles (6 items).

Content validity: the global S-CVI score was 0.82 points and all the dimensions obtained S-CVI scores above 0.8, except for the dimension of Satisfaction (S-CVI = 0.76). Table 2 shows the eight items eliminated from the first version for having values of I-CVI<0.8. According to comments by the experts, some of the items from the dimension of Satisfaction and Motivation had small changes in their writing. Thus, version 2 (v2) of the questionnaire was created with 34 items distributed in the same dimensions.

Table 2 Items eliminated from the first version of the questionnaire for having values of I-CVI<0.8 

The phase that ran the pilot test and the cognitive pretest included 30 questionnaires and three were discarded because they were not filled out correctly. The writing of the items was not modified, but the item from the dimension of Motivation ‘I mentor students because I work in a university hospital’ was eliminated given that it was not well taken by the primary care nursing professionals. It was estimated that the time to complete the questionnaire was between 10 and 12 minutes and the most appropriate format to reach the professionals was an on-line questionnaire.

Intra-observer reliability results after three weeks were excellent with global ICC = 0.852 and the values of each dimension were: Implication ICC = 0.851, Motivation ICC = 0.819, Satisfaction ICC = 0.854, and Obstacles ICC = 0.79.

To evaluate construct validity and internal consistency, 249 questionnaires correctly filled out were collected. The mean age of the nurses surveyed was 42.26 years (sd = 9.02; 95%CI 41.23-43.48 years); 75.1% (n = 187) worked in specialized care (95%CI 69.8%-80.09%). The viability of the factor analysis was confirmed with the KMO test (p = 0.862) and Bartlett’s sphericity test (X2 = 4258.726, p <0.001), verifying that correlations between pairs of variables could be explained by other variables and that the correlations were different from zero, respectively. With the principal components analysis method, with varimax rotation and a factor solution with five factors, 55.4% of the variance was explained. The first factor explained 15.08% of the total accumulated variance and corresponding to the dimension of Implication, composed of eight items. The second factor explained 11.39% of the variance (26.47% of the accumulated variance); corresponding to the dimension of Motivation, with six items. The third factor corresponded to the dimension of Satisfaction, with eight items, and explained 10.77% of the variance (37.24% of the accumulated variance). The fourth factor explained 10.41% of the variance (47.65% of the accumulated variance) and corresponded to the dimension of Obstacles, comprised of six items. A fifth factor appeared, denominated Commitment and composed of five items. This new dimension explained 7.75% of the variance (55.4% of the accumulated variance). Table 3 shows the rotated component matrix in search of a simpler and more interpretable structure to observe in which factor each item obtains better saturation. The table also shows the definite version of the questionnaire (v4) after the factor analysis, illustrating a questionnaire made up of 33 items distributed into five dimensions (it uses a five-level Likert-type scale and permits obtaining a global score as the sum of the score of the items, with a range between 33 and 165 points), which offer information on: Implication, Motivation, Satisfaction, Obstacles, and Commitment of nurses in mentoring students. The questionnaire was denominated IMSOC, corresponding to the initials of its dimensions (Implication, Motivation, Satisfaction, Obstacles, and Commitment), and it is in the process of intellectual property registration.

The questionnaire’s internal consistency was excellent, with a value of α = 0.837. The values of the questionnaire’s dimensions were: Implication α = 0.875, Motivation α = 0.824, Satisfaction α = 0.811, Obstacles α = 0.811, and Commitment α = 0.713.

Table 3 Rotated component matrix and construct of the definite version of the questionnaire 


Fifty percent of learning in the nursing degree program occurs in the clinical setting and clinical nursing professionals assume the mentorship of nursing students. It is important to know the level of participation in the formation and the related factors19 through validated tools. The results of the questionnaire elaboration show adequate content validity, temporal stability, and internal consistency, according to the literature proposed.17) Two items from the dimension of Implication and one from the dimension of Satisfaction obtained factor loading in their respective dimensions considered insufficient by other authors,20) although the research team decided to keep them because of their practical relevance against the statistical relevance, given that these contributed important information to know how clinical nurses assess the organization of the practices.

Student mentoring during clinical practices has been debated in nursing literature for over 25 years.21 According to Jokelainen et al.,7) comparative studies must be conducted with different approaches of clinical mentorship that help to determine the best methods to train future professionals in clinical settings, but for this it is necessary to establish a series of valid and reliable tools that permit gathering relevant information to make this comparison. The IMSOC questionnaire offers relevant information on the level of participation from nursing care professionals in mentoring students and has adequate psychometric properties, which can be useful to improve the evaluation of clinical practices in different contexts and organizational models.

In addition, the IMSOC questionnaire may be used to evaluate the effect of the formation of mentors in their level of participation or to select mentors and practice units, along with other tools, like the Clinical Learning Environment, Supervision and Nurse Teacher evaluation scale (CLES+T)22,23 that permits evaluating the adaptation of the learning environment in the practice units. The difference between both is that the IMSOC questionnaire permits knowing beforehand the level of implication or participation of the mentors and the CLES+T questionnaire offers information from the students’ perspectives and it is administered when the students have already done the clinical practices.

It is worth highlighting that the validation process of a questionnaire is a live and continuous process and that in spite of the good psychometric properties obtained, it is possible to continue working on it, given that this study was conducted within the Spanish context - limiting its application within the international setting - making it necessary to develop transcultural adaptation and validity studies in other contexts different from the Spanish. A limitation may be the fact that a round with five experts was carried out and this may have influenced upon the definite version, given that the modifications made after the first round were not subjected to a new round, although the experts were selected with stringent criteria and the results of content validity were adequate, according to criteria by Polit et al.17 Additionally, questionnaires validated with a panel of three experts and one round can be found in literature.24 Besides, the criterion validity could not be studied because no Gold Standard was found that would permit a comparison.

To conclude, the IMSOC questionnaire has been validated to determine the level of nurse participation in the mentorship of nursing students with adequate validity and reliability in the Spanish context. This questionnaire offers information on the implication, motivation, satisfaction, obstacles, and commitment of nursing care professionals in the mentorship of students and may be used to select practice mentors, compare different models of clinical mentorship, or evaluate intervention strategies to promote nurse participation in mentoring students during clinical practices. It is pertinent to continue investigating the factors that can affect the level of implication of nurses in student mentorship.


1. Maciá-Soler ML, González Chordá VM, Salas Medina P, Mena Tudela D, Cervera Gasch Á, Orts Cortés MI. Level of involvement of clinical nurses in the evaluation of competence of nursing students. Invest. Educ. Enferm. 2014; 32(3):461-70. [ Links ]

2. Chen Y, Watson R, Hilton A. A review of mentorship measurement tools. Nurse Educ. Today. 2016; 40:20-8. [ Links ]

3. Dobrowolska B, McGonagle I, Kane R, Jackson CS, Kegl B, Bergin M, et al. Patterns of clinical mentorship in undergraduate nurse education: A comparative case analysis of eleven EU and non-EU countries. Nurse Educ. Today. 2016; 36:44-52. [ Links ]

4. Skela-Savič B, Kiger A. Self-assessment of clinical nurse mentors as dimensions of professional development and the capability of developing ethical values at nursing students: A correlational research study. Nurse Educ. Today. 2015; 35(10):1044-51. [ Links ]

5. Webb C, Shakespeare P. Judgements about mentoring relationships in nurse education. Nurse Educ. Today. 2008; 28(5):563-71. [ Links ]

6. Jokelainen M, Turunen H, Tossavainen K, Jamookeeah D, Coco K. A systematic review of mentoring nursing students in clinical placements. J. Clin. Nurs. 2011; 20(19-20):2854-67. [ Links ]

7. Moseley LG, Davies M. What do mentors find difficult? J. Clin. Nurs . 2008; 17(12):1627-34. [ Links ]

8. Perry RN. Role modeling excellence in clinical nursing practice. Nurse Educ. Pract. 2009; 9(1):36-44. [ Links ]

9. Jokelainen M, Jamookeeah D, Tossavainen K, Turunen H. Finnish and British mentors' conceptions of facilitating nursing students' placement learning and professional development. Nurse Educ. Pract . 2013; 13(1):61-7. [ Links ]

10. Edo-Gual M, Tomás-Sábado J, Bardallo-Porras D, Monforte-Royo C. The impact of death and dying on nursing students: an explanatory model. J. Clin. Nurs . 2014; 23(23-24):3501-12. [ Links ]

11. Darlow B, Coleman K, McKinlay E, Donovan S, Beckingsale L, Gray B, et al. The positive impact of interprofessional education: a controlled trial to evaluate a programme for health professional students. BMC Med. Educ. 2015; 15:98. [ Links ]

12. Heaslip V, Scammell JM. Failing underperforming students: the role of grading in practice assessment. Nurse Educ. Pract . 2012; 12(2):95-100. [ Links ]

13. Wilkes Z. The student-mentor relationship: a review of the literature. Nurs. Stand. 2006 May 24-30; 20(37):42-7. [ Links ]

14. Ownby K, Schumann R, Dune L, Kohne D. A comparison of a traditional clinical experience to a precepted clinical experience for baccalaureate-seeking nursing students in their second semester. Nurs. Res. Pract. 2012; 2012:276506. [ Links ]

15. Broadbent M, Moxham L, Sander T, Walker S, Dwyer T. Supporting bachelor of nursing students within the clinical environment: perspectives of preceptors. Nurse Educ. Pract . 2014; 14(4):403-9. [ Links ]

16. Wink D, Ruland JP. Multiagency Online Preceptor Education: Design, Implementation, and Outcomes. Nurse Educ. 2016; 41(5):270-3. [ Links ]

17. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res. Nurs. Health. 2007; 30(4):459-67. [ Links ]

18. Organic Law 15/1999, of December 13, on the Protection of Personal Data núm. 298, de 14 December 1999. Spain. Available from ]

19. Johnson KV. Improving Adjunct Nursing Instructors' Knowledge of Student Assessment in Clinical Courses. Nurse Educ. 2016; 41(2):108-10. [ Links ]

20. Ruzafa-Martinez M, Lopez-Iborra L, Moreno-Casbas T, Madrigal-Torres M. Development and validation of the competence in evidence based practice questionnaire (EBP-COQ) among nursing students. BMC Med. Educ . 2013; 13:19. [ Links ]

21. Bray L, Nettleton P. Assessor or mentor? Role confusion in professional education. Nurse Educ. Today. 2007; 27(8):848-55. [ Links ]

22. Vizcaya-Moreno MF, Pérez-Cañaveras RM, De Juan J, Saarikoski M. Development and psychometric testing of the Clinical Learning Environment, Supervision and Nurse Teacher evaluation scale (CLES+T): the Spanish version. Int. J. Nurs. Stud. 2015; 52(1):361-7. [ Links ]

23. Watson PB, Seaton P, Sims D, Jamieson I, Mountier J, Whittle R, et al. Exploratory factor analysis of the Clinical Learning Environment, Supervision and Nurse Teacher Scale (CLES+T). J. Nurs. Meas. 2014; 22(1):164-80. [ Links ]

24. Chow SK, Wong LT, Chan YK, Chung TY. The impact and importance of clinical learning experience in supporting nursing students in end-of-life care: cluster analysis. Nurse Educ. Pract . 2014; 14(5):532-7. [ Links ]

1Article linked to research: this article is derived from the PhD thesis: “Validation and results of a questionnaire to measure the implication of clinical nurses in the formation of Nursing Degree students”. Funding: this work has been funded by a call for projects of educational innovation, call 2015/2016 by Universitat Jaume I within the project “Acquisition of skills in clinical practices and simulation” (Code: 10G136-733). Approved by Resolution of 02 November 2015. Conflicts of interest: None. How to cite this article: Cervera-Gasch A, Macia-Soler L, Torres-Manrique B, Mena-Tudela D, Salas-Medina P, Orts-Cortes MI, et al. Questionnaire to Measure the Participation of Nursing Professionals in Mentoring Students. Invest. Educ. Enferm. 2017; 35(2):182-190.

2Artículo vinculado a investigación: Este artículo se deriva de la tesis doctoral: “Validación y resultados de un cuestionario para medir la implicación de las enfermeras clínicas en la formación de estudiantes de Grado en Enfermería”. Financiación: Este trabajo ha estado financiado por la convocatoria para proyectos de innovación educativa convocatoria 2015/2016 de la Universitat Jaume I dentro del proyecto “Adquisición de competencias en prácticas clínicas y simulación” (Código: 10G136-733). Aprobado por Resolución de 2 noviembre de 2015. Conflicto de intereses: Ninguno. Cómo citar este artículo: Cervera-Gasch A, Macia-Soler L, Torres-Manrique B, Mena-Tudela D, Salas-Medina P, Orts-Cortes MI, et al. Questionnaire to Measure the Participation of Nursing Professionals in Mentoring Students. Invest. Educ. Enferm. 2017; 35(2):182-190.

Received: December 06, 2016; Accepted: May 10, 2017

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License