SciELO - Scientific Electronic Library Online

 
vol.24 issue2EFL Teachers’ Professional Identity: A Narrative Study With Colombian Graduate StudentsSelf-Efficacy of English Language Teachers With Low and High Curriculum Literacy in Indonesian Schools author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Profile Issues in Teachers` Professional Development

Print version ISSN 1657-0790

profile vol.24 no.2 Bogotá July/Dec. 2022  Epub Oct 06, 2022

https://doi.org/10.15446/profile.v24n2.93571 

Issues from Teacher Researchers

The Factors Contributing to Language Teachers’ Effectiveness in an EFL Learning Context: A Questionnaire Validation Study

Factores que contribuyen a la eficacia de los docentes de idiomas en un contexto de aprendizaje del inglés como lengua extranjera: estudio de validación de un cuestionario

* Iran University of Science and Technology, Tehran, Iran, a_nayernia@iust.ac.ir

** Iran University of Science and Technology, Tehran, Iran, rana_nosrati@alumni.iust.ac.ir

*** European Knowledge Development Institute (EUROKD), Ankara, Turkey, hassanmohebbi@ut.ac.ir


Abstract

This mixed-methods study explores the factors contributing to the language teachers’ effectiveness in the context of English as a foreign language. Through a systematic review of the literature, six main factors were extracted: assessment literacy, content and pedagogical content knowledge, experience, oral proficiency, personality type, and self-efficacy. In the first phase of the study, 13 experts in the field shared their attitudes towards these factors through a semi-structured interview. The data obtained from the interviews was analysed thematically to develop a questionnaire. Ninety-three language teachers participated in a pilot study to validate the newly developed questionnaire. The results were factor analysed. After the required modifications based on the factor analysis were introduced, a questionnaire with 19 items entitled “EFL Language Teachers’ Effectiveness” was developed.

Keywords: assessment literacy; content and pedagogical content knowledge; effectiveness; EFL teachers; experience; oral proficiency; personality type; self-efficacy

Resumen

Este estudio de diseño mixto explora los factores que contribuyen a la eficacia de los docentes de idiomas en un contexto de aprendizaje del inglés como lengua extranjera. De una revisión sistemática de la bibliografía, se extrajeron seis factores principales: conocimientos en evaluación, conocimiento del contenido y del contenido pedagógico, experiencia, competencia oral, personalidad y autoeficacia. En la primera fase del estudio, trece expertos opinaron sobre estos factores en una entrevista semiestructurada. Los datos de las entrevistas se analizaron temáticamente para desarrollar un cuestionario que fue validado en un estudio piloto con 93 docentes. Después de las modificaciones necesarias, basadas en el análisis factorial de los resultados, se diseñó un cuestionario con 19 ítems titulado “Eficacia de los docentes de inglés”.

Palabras clave: autoeficacia; competencia oral; conocimiento del contenido y del contenido pedagógico; conocimientos en evaluación; docentes de inglés; eficacia; experiencia; personalidad

Introduction

Due to the essential role of language teachers in the teaching profession, researchers have focused on the crucial factors that would improve their performance and, consequently, their effectiveness. Hence, it is of primary importance to identify factors contributing to language teachers’ effectiveness (Pishghadam et al., 2011).

In teaching literature, the word effectiveness seems to lack an explicit, straightforward, and robust definition. Hunt (2009) defined effective teachers as those who can teach their learners to be good and effective citizens in the future. Galluzo (2005) defined teachers’ effectiveness in relation to students’ success. If we focus on foreign language teachers, as this study does, there is at least one more variable to consider: teachers’ effectiveness is associated with the students’ competence in the foreign language. For Galluzo, teachers’ effectiveness plays a significant role in the students’ academic achievement and linguistic performance. He argues that effective teachers finish a course where the majority of students succeed in achieving the course’s goals. Therefore, the course’s objectives are important, and teachers’ effectiveness may vary in different courses and contexts and from one objective to another.

Therefore, exploring the characteristics of teacher effectiveness is essential for improving the quality and productivity of foreign language teacher’s training courses. Hence, the present study investigates the factors contributing to language teachers’ effectiveness in improving teacher’s training courses, leading to successful language learning programmes.

Literature Review

To date, researchers have investigated teacher’s effectiveness from different perspectives to shed light on the factors which play a key role in promoting teachers’ productivity and efficiency. Zamani and Ahangari (2016) defined effectiveness as what is perceived by a language learner in an English as a foreign language (EFL) context. Their definition focuses primarily on the quality and kind of relationship that teachers have with language learners. Furthermore, they concluded that effectiveness helps teachers have discipline in their classrooms, which is a fundamental aspect of teachers’ effectiveness. According to their study, discipline and the teacher-learner relationship come to the fore when investigating language teachers’ effectiveness. Similar research has been done on effectiveness, but none has provided a comprehensive definition of the construct that would involve all its contributing factors (e.g., Mitchell & Bradshaw, 2013; Pane, 2010).

Liakopoulou (2011) sees a good teacher as someone who is effective in how he or she teaches. She searched for the qualifications that contribute to a good teaching; however, she rightly argued that an explicit definition of a good and effective teacher is neither possible nor desirable because, essentially, it varies from one context to another. One of the factors that she mentioned, and which was absent in other studies, was the teachers’ experience. She claimed that experience could facilitate, to a large extent, their task and guarantee their effectiveness. Goodwin et al. (2019) acknowledged the importance of experience in language teachers’ effectiveness. However, in a longitudinal study, they concluded that experience and its effect on teachers’ performance were more significant in the first years of teaching. Afterwards, its significance decreases in an unprecedented scale. However, they found that language learners favour experienced teachers, and, in many situations, they see experienced teachers as the most effective ones.

An issue closely related to language teachers’ effectiveness is their assessment literacy and practice. Language teachers’ assessment literacy has recently received much attention (for a recent comprehensive review, see Coombe et al., 2020; Giraldo, 2021; Levi & Inbar-Lourie, 2020; Vogt et al., 2020). In a recent study, Kremmel and Harding (2020) highlighted the need for promoting language teachers’ assessment literacy. They also emphasised the need for further research in this field. Hao and Johnson (2013) investigated the relationship between the teachers’ use of different classroom assessment types (such as multiple questions, short answers, and paragraph writing) and oral communication across several classes in different countries. They observed that teachers’ assessment literacy helps them provide their class with an appropriate assessment frame that suits their objectives. Thus, their interpretation of the learners’ performance may be more valid in their evaluation of learners. More precisely, it seems that the teachers’ experience and education affect their assessment literacy and, consequently, their effectiveness (Asl et al., 2014).

When it comes to teacher’s effectiveness, content and pedagogical content knowledge is another issue that should not be neglected. Shulman (1987) first discussed pedagogical content knowledge and asserted that teachers needed to have curricular knowledge, pedagogical knowledge, subject matter knowledge, knowledge of students, knowledge of the school, and pedagogical content knowledge. Since then, many researchers have investigated these factors in various teaching contexts to develop measurement instruments (e.g., Han-Tosunoglu & Lederman, 2021). Three decades after Shulman’s seminal study, Grieser and Hendricks (2018) defined pedagogical content knowledge considering two subcategories: in-field and out-of-the-field pedagogical content knowledge. Out-of-the-field pedagogical content knowledge is when teachers’ preparation does not correspond to their teaching assignments. To have pedagogical content knowledge, teachers should be aware of the context and social norms that may contribute to the topic and to the subject matter they teach (Liakopoulou, 2011).

The construct of experience and its effect on students’ achievement has been examined in different contexts. However, considering experience as one of the effective teachers’ features is controversial. Harris and Sass (2011) studied the various types of teacher’s training courses and their productivity in promoting teachers’ effectiveness and students’ achievement. In their study, they equated teachers’ effectiveness with their productivity. The result of their study revealed that pre-service and in-service teachers’ productivity increases with experience; interestingly enough, it was observed that the increase was significant in the first few years.

Chambless (2012) claimed that many teachers whose content knowledge was sufficient were experts in the subject matter. However, their oral proficiency and their expertise in the content area were not evaluated, and this may affect the way that language learners welcome teachers. Therefore, it goes without saying that the teachers’ speaking skills is what makes the first impression on language learners. In a recent study, Faez et al. (2019) conducted a meta-analysis to examine the potential relationship between language proficiency and teaching ability. They observed a moderate relationship between language proficiency and teaching self-efficacy. Therefore, they concluded that self-efficacy should not be limited to the teachers’ language proficiency.

Moreover, the teachers’ personality in the classrooms has been considered a critical factor for success in their work (Santilli et al., 2011). To date, different subcategories of teachers’ personality have been studied (e.g., Akyıldız & Çelik, 2020; Li & Li, 2019; Oryan & Ravid, 2019; Sato, 2020).

Self-efficacy is another factor contributing to language teachers’ effectiveness, which has been extensively investigated in recent years (e.g., Choi & Lee, 2016; Moradkhani et al., 2017). As Wang and Sun (2020) rightly highlighted, since Bandura’s publication on self-efficacy in 1977, we have witnessed a growing body of research in this field. According to the research to date, self-efficacy is distinguished from teachers’ effectiveness, for self-efficacy is defined as the beliefs teachers hold about themselves. Therefore, it may be considered as a subcategory of language teachers’ effectiveness. The research findings support the pivotal importance of self-efficacy in teachers’ effectiveness (e.g., Hoang & Wyatt, 2021; Thompson, 2020; Thompson & Dooley, 2019; Thompson & Woodman, 2019).

The Study

As the literature indicates, language teachers’ effectiveness has always been a controversial issue in language teaching research. This issue is more critical in EFL contexts as there are few opportunities for practicing new languages. Although many people who live in EFL contexts may not find any opportunity to use English or any other foreign language, they are still willing to learn them. Due to an increase in the willingness to learn new languages, especially English, institutes and educational systems are looking for effective language teachers. They welcome teachers who can be categorised as successful and effective by their institutes (Noorbakhsh et al., 2018). That is why this study aims to explore language teachers’ effectiveness in an EFL context (Iran). We hope this study’s findings may shed light on the importance of effective language teachers in such contexts and how they are evaluated as effective. To this end, the following research question guided this study: What are the factors contributing to language teachers’ effectiveness in the Iranian language learning context?

Method

The present study was a mixed-methods study aimed at exploring the factors contributing to foreign language teachers’ effectiveness. The study was conducted in two phases. The first phase employed qualitative methods (theme analysis and interviews), and the second phase used a quantitative method (factor analysis) to answer the study’s research question.

Participants

In the first phase of the study, directed at extracting and verifying the factors contributing to teacher effectiveness, 13 EFL lecturers, as experts in applied linguistics, participated in this research project (one woman and 12 men). They were required to have a PhD, to have graduated from state universities and have at least three years of teaching experience at universities. These lecturers came from four state universities in Iran. They were considered experienced lecturers for their teaching experience at universities ranged from 5 to 40 years.

In the second phase of the study, which validated a teacher’s effectiveness questionnaire, 93 EFL teachers participated, ranging in age from 20 to 45 years. About 26.9% were men, and the rest were women. All of them had academic English degrees and were teaching in private-sector language institutes. Seventeen participants held a BA in English, and 76 held an MA in English language teaching. They were asked to report their years of experience in language teaching in institutes. The majority had less than five years of experience (about 34.4%). Twenty-nine per cent had between five to eight years of experience, 25.8% between nine to 12 years, less than 6% between 13 to 16 years, about 2% between 17 to 20 years, and the rest (around 2%) more than 20 years. They took part in the study through an online questionnaire shared in specialised groups on different social media outlets, namely Telegram and WhatsApp.

Procedure

Relevant Studies

The first instrument used to identify the factors contributing to language teachers’ effectiveness was the relevant studies. We tried to find the most recent and relevant studies published in the refereed journals in the field. The studies were reviewed and subjected to thematic analysis to extract the items related to the language teachers’ effectiveness to be judged by the experts.

Expert Questionnaire (Semi-Structured Interview)

Based on the thematic analysis of the literature review, 40 items were developed to be rated by the experts. These 40 items included statements about language teachers’ effectiveness. The constructs underlying this questionnaire (see Appendix A) were labelled as assessment literacy (Items 6, 12, 20, 24, 27, 29, 35), content and pedagogical knowledge (Items 2, 9, 11, 22, 31, 34), experience (Items 1, 17, 21, 30, 33), oral proficiency (Items 3, 5, 16, 26, 28, 39), personality type (Items 7, 8, 10, 13, 14, 15, 18, 23, 25, 37, 40) and self-efficacy (Items 4, 19, 32, 36, 38). We identified the major categories and their corresponding subcategories. The participants were asked to respond on a 5-point Likert-type scale (from strongly agree to strongly disagree). One open-ended question at the end of the questionnaire asked the respondents to provide additional comments.

Language Teachers’ Effectiveness: The First Draft Questionnaire

Based on the responses collected in the first step of the study, we came up with a 21-item questionnaire in the Likert scale format. Two new items were added: creativity, which was grouped under personality type, and first language (L1) use when considered necessary, classified as a subcategory of experience following the experts’ suggestions and comments obtained from the interviews. The experts’ comments and suggestions were also considered in reviewing items and their wording. Overall, 24 items were prepared at this stage. Then, the items were distributed among the English language teachers working at different institutes at this stage. The new questionnaire also included six constructs (see Appendix B). However, the number of items in each construct changed as follows: assessment literacy (Items 3, 10, 19), content and pedagogical knowledge (Items 4, 7, 15, 18), experience (Items 11, 17, 24), oral proficiency (Items 1, 2, 13, 14, 22), personality type (Items 5, 6, 8, 12, 21, 23) and self-efficacy (Items 9, 16, 20).

Results

An extensive and intensive review of the literature was conducted to extract a comprehensive list of factors contributing to language teachers’ effectiveness to address the study’s goal. After performing the review, six main categories were extracted (see Table 1).

Table 1 Factors Qualitatively Extracted From the Literature and From Interviews 

Factors Example Study
Assessment literacy Teachers’ assessment literacy will help teachers use more valid information about their learners to teach more effectively (Pastore & Andrade, 2019).
Content and pedagogical content knowledge Teachers should be aware of the context and the appropriate instruments and techniques they might need for more effective and transparent lesson presentations (Liakopoulou, 2011).
Experience The role of experience in teachers’ effectiveness is more significant in the first years of teaching (Staiger & Rockoff, 2010).
Oral proficiency Language teachers’ oral proficiency is considered to be the first impression on learners. It can affect the way learners welcome a teacher (Chambless, 2012).
Personality type (subcategories: creativity, extrovert vs. introvert, discipline, gesture, flexibility) Personality is an indivisible part of the effects that teachers have in any educational system, and it is one of the key factors in their effectiveness (Penner, 1984).
Self-efficacy In many studies, researchers have tried to find factors contributing to teachers’ self-efficacy and, therefore, to their effectiveness. For instance, the effect of the teachers’ language proficiency on their self-efficacy (Choi & Lee, 2016).

After the experts rated the items presented to them, those items obtaining more than 80% agreement from experts (Items 3, 5, 6, 9, 10, 11, 13, 19, 20, 21, 25, 26, 28, 31, 32, 33, 34, 35, 36, 37, 39) were selected to be included in the first draft of the questionnaire, which would be distributed to the EFL teachers. Besides these 21 items, three items were also added following the experts’ suggestions and comments. They were about teachers’ creativity and the L1 use in classrooms. About 10 (out of 13) experts suggested teachers’ creativity be included, and eight mentioned that appropriate L1 use in language classrooms should be considered in an EFL context. In Appendix B, creativity (Items 6 and 23) and selective use of L1 (Item 24) have been added to the 21 previously extracted items. The main categories of these two items were also discussed with the experts suggesting them. Creativity was then defined as one of the subcategories of the personality type and selective use of L1 was considered one of the subcategories of experience. A Chi-square analysis was conducted to obtain the Iranian EFL teachers’ attitude towards factors contributing to the effectiveness of language teachers (see Table 2).

Table 2 The Construct Validation 

Sample adequacy Approx. Chi-Square df Sig.
.568 623.317 276 .000

Based on the analysis, the agreed sample adequacy is 0.6 or above. According to Table 2, sampling adequacy was about 0.57, close to the one agreed upon (0.6). Regretfully, because of the situation caused by the COVID-19 pandemic, it was impossible to collect more data during this phase. Subsequently, we decided to accept this value and continue with the study. Additionally, Bartlett’s Test of Sphericity value should be 0.05 or smaller; Table 3 shows that it was .000, that is, Bartlett’s test was significant, so the factor analysis was appropriate.

Table 3 The Reliability Statistics 

Cronbach’s Alpha N
.755 24

Table 3 verifies a good level of reliability for the questionnaire. Accordingly, the reliability of the items was .775, which is acceptable. Figure 1 confirms that nine factors were above one. Therefore, it can be concluded that the nine factors were extracted. In Table 4, the item’s loading factor is also provided.

Figure 1 The Scree Plot for the Item’s Factor Load 

Table 4 Results From Factor Analysis of Language Teachers’ Effectiveness Questionnaire 

Language teachers’ effectiveness items Factor loading
1 2 3 4 5 6 7 8 9
Factor 1: Oral proficiency
1. I communicate well in English .34 -.32 .33
2. I pronounce words clearly .69 -.36 -.47
13. I consider my oral proficiency as one of the first factors that impress my students .37
14. I adjust my speaking speed to the level I am teaching .44 .39 .32
22. I emphasise my oral proficiency as one of the main input tools for language learners .50
Factor 2: Personality
5. I am punctual -.49 .39
6. I am creative in using tasks and activities -.32 .46
8. I am aware of my gestures in the classroom -.32 .33
21. I am open to using various techniques .30 .42
23. I am creative in presenting lessons -.40 .33
Factor 3: Content and pedagogical content knowledge
4. I am prepared for questions in the content area .45 -.32
15. I know the social norms of the class where I teach .44
Factor 4: Self-efficacy
16. I use my experience to improve my self-efficacy .45
9. I am self-confident -.47 .61
Factor 5: Experience
11. I use my learning experience as well as my teaching experience -.54 .34
17. I use my colleagues’ experience .33
Factor 6: Assessment literacy
3. I assess my students fairly -.39 .32
10. I consider course objectives when assessing my students .44 -.35
19. I use assessment results to improve classroom productivity -.34 .30 .32

The items excluded from Table 4 (Items 7, 12, 18, 20, and 24) were not found appropriate for the questionnaire. According to the results, Items 7, 12, and 18 had no loading in any factors or in any other items. Item 20 loaded negatively only in Factor 5, and Item 24 loaded in three factors, all negative. In this table, the factors and their items were confirmed. We then concluded: factor one included Items 1, 2, 13, 14, and 22 for oral proficiency. Factor two included Items 5, 6, 8, 21, and 23 for the personality type. Factor 3 was eliminated because only two items were loaded negatively (Items 4 and 15). Factors 4 and 5 included two items (9 and 16 in Factor 4; 11 and 17 in Factor 5), which measured the content and pedagogical content knowledge and self-efficacy. Factor 7 was also eliminated because only one item was loaded negatively. Factor 8 included Items 3, 10, and 19 related to assessment literacy. Item 1 loaded in Factor 9, but as it was loaded in Factor 1 and was related to the other items loaded in the same factor, it was decided to ignore it and finish the table with six factors: 1, 2, 4, 5, 6, and 8. We finally developed the final questionnaire with 18 items (Appendix C).

Discussion

This study attempted to explore the factors contributing to language teachers’ effectiveness in an EFL context and develop a questionnaire involving constructs in this definition. After developing 40 statements according to the literature review, personality type had the most items. Eleven items were included for personality type, seven for assessment literacy, six for content and pedagogical content analysis, six for oral proficiency, five for experience, and five for self-efficacy. In the following questionnaire, which included 24 items, most items pertained to personality type (personality type = 6; oral proficiency = 5; assessment literacy, experience, and self-efficacy, each got three; and content and pedagogical content knowledge = 4). According to the literature, it was expected that more items would be devoted to personality type. However, in the final questionnaire (see Appendix C), with 18 items selected after factor analysis, the number of items for personality type and oral proficiency was the same. Each had five items. Evidently, based on the results, teachers’ personality is arguably an indivisible part of teacher’s effectiveness (Santilli et al., 2011).

The interesting point about personality type is that two items of creativity remained in the final questionnaire. Therefore, it confirms Li and Li’s (2019) point that creativity is an essential factor for language teachers’ effectiveness. It may be concluded that language learners and language institutes should look for innovative teachers regarding teaching activities and strategies. Such innovation allows teachers to be more prepared for their classroom, and to offer students attractive and motivating lessons. Otherwise, they might be considered boring teachers with no specific techniques and strategies. As Li and Li have mentioned, creative teachers can produce creative language learners; those who can think outside the box (Akyıldız & Çelik, 2020).

Oryan and Ravid (2019) see good teachers as those who are open to new methods and strategies. While developing the questionnaire, we realized that two important teaching strategies, often overlooked, have to do with the teacher’s body language (gestures) and discipline management. As many researchers (Bowcher & Zhang, 2020; Fatemi et al., 2016; Sato, 2020) rightly argue, teachers’ care of their gestures and nonverbal behaviour is strongly associated with their success and effectiveness. Moreover, another factor under this category is the teachers’ discipline, presented as teacher’s punctuality. It has benefits for students, but it also helps teachers manage their classrooms effectively (Jeloudar & Yunus, 2011). The only remaining point in teachers’ discipline and personality type is the teachers being “extrovert vs. introvert.” According to Fatemi et al. (2016), students favour extroverted teachers, those who show their care for students through verbal and nonverbal behaviour. However, the results showed that teachers are not so interested in considering this aspect as part of their effectiveness. The item developed for this aspect did not obtain enough agreement to be included in the final questionnaire.

Regarding teachers’ oral proficiency, and as Bateman (2008) has shown, the recent passion for developing speaking skills when learning new languages has affected attention to oral proficiency in teachers and learners. Further, Chambless (2012) has mentioned that teachers lacking oral proficiency, but being experts in the content area, may be less welcomed by language learners. This result shows a similar finding and shows that teachers are aware of the need of language learners to be proficient speakers. Oral proficiency obtained five items in the final questionnaire (the same as personality type).

The next factor with three items is assessment literacy. In the pilot phase of the questionnaire, none of its items was deleted. It shows that the respondents believe they have enough knowledge of this factor and that different approaches are vital for a language teacher’s effectiveness. Considering the factors agreed upon by experts and language teachers, three aspects of assessment have been included: teachers’ fairness, course objectives and mutual relationship between assessment and class productivity. According to Hao and Johnson (2013), if teachers take into consideration course objectives in their assessments, their interpretation shall be more valid, and their class productivity improved. These items have been validated in the final questionnaire. Teachers’ fairness is affected by their experience (Asl et al., 2014). Due to the relationship between experience and assessment, when considering experience items in the questionnaire, we observed that using colleagues’ experience and teaching and learning experience help language teachers to be fair and effective.

In the relevant literature, teaching experience was considered a controversial factor for language teachers’ effectiveness. Harris and Sass (2011) hold that experience positively affects teachers’ effectiveness during the first years of their profession. Henry et al. (2011) confirmed that it derives from a sense of satisfaction that preservice language teachers feel as they obtain a wider experience during the first years of teaching. However, one point should be kept in mind. The number of years is important for a teacher to be considered experienced, and so is the number of classes and courses they have held. A teacher with two years of experience having had a maximum of six sessions per week is not the same as a teacher having the same years of experience but 18 sessions per week. We therefore decided to include teaching experience in the questionnaire, but no clear criterion regarding the number of teaching years was provided. Only Item 24 in Appendix B was eliminated after the pilot. Considering the remaining items, it may be concluded that experience and its effects are not limited to the first years of teaching. One of the items is “using colleagues’ experience” because even experienced teachers may use their colleagues’ experience for teaching new classes.

Content and pedagogical content knowledge, self-efficacy, and experience had the same number of items (two items each). In the literature, content knowledge and the ability to effectively present that knowledge to audiences was considered necessary. It was mentioned that teachers have many sources from which to obtain content knowledge, such as preservice training and in-service courses, to name but a few (Grieser & Hendricks, 2018). Interestingly, content and pedagogical content knowledge lost two items during the pilot phase. Since the research’s target was language teachers’ effectiveness, this is a point that should be further analysed. One reason for this loss may be the easy access to many sources to obtain knowledge, such as websites and educational applications. Therefore, if teachers are not sure about some aspect of language, such as idioms or similar issues that are mainly cultural, they may ask students to research them or develop a project, and even devise some tasks. Thus, we believe that easy access to content knowledge explains why this factor did not obtain many questionnaire items. However, this does not apply to knowledge of words and grammar; they are the basis of the content knowledge that each language teacher should have.

Finally, we identified the self-efficacy factor. According to the literature review, language teachers’ self-efficacy is directly and indirectly affected by many factors (Afshar et al., 2015), such as teaching experience and language proficiency. Based on Moradkhani et al. (2017), we initially decided to include one item related to the relationship between reflective thinking and self-efficacy. Item 20 in Appendix B represented this relationship, but, interestingly, this item was deleted during the pilot. This seems to show that language teachers did not see reflective thinking as an integral part of their self-efficacy and, consequently, of their effectiveness as a whole.

Conclusions

The main output of the present study was to validate a questionnaire on language teachers’ effectiveness that other studies may use to address this issue in similar contexts. Furthermore, the main contribution of the present study to the growing body of research on the promotion of teacher training courses is that it develops an understanding of language teachers’ effectiveness from their own point of view. This study was an attempt to make language teachers look at their effectiveness and to promote their vocation. The data collected from this study, highlighted in the literature, investigated factors related to language teachers’ effectiveness and tried to categorise them into major themes. The relatively high number of items for oral proficiency shows the importance of this factor in language teaching. Oral proficiency and language teachers’ ability to speak and communicate the target language well is fundamental for effectiveness. Furthermore, to be effective, a language teacher not only should be competent in one area like language usage, but also should care about personality, verbal and nonverbal behaviour, assessment literacy, self-efficacy, oral proficiency, and other factors that may be needed in the particular teaching context. In most factors, professional experience plays a role. However, the number of years by itself cannot predict teacher’s effectiveness, for it depends largely on the person’s engagement. A teacher might be in this profession for a short period of time but be more committed, while another might have been teaching for a long time but is less engaged.

Primarily, this study attempted to encourage teachers to be aware of the multiple aspects effectiveness in their profession has. This study’s findings can be informative and useful for language teachers and stakeholders directing institutes, teacher training courses, and teacher education programs in academia. As seen in the review of the literature, language teachers’ effectiveness is a multi-faceted construct, and teachers should not improve one aspect at the cost of others. They should think about their effectiveness and try to improve their weak aspects. According to the findings of this study, it is highly recommended that teachers develop their speaking skills, as it is the one skill that leaves a lasting first impression on their learners. Meta-cognition is also recommended so that teachers are more responsible in their evaluations and consider how they affect their classrooms’ productivity. Furthermore, educational institutions can use a teachers’ self-evaluation to compare it with their classroom achievement results. Such comparisons may be used to improve the productivity of training programs, teachers’ effectiveness, and language courses.

It is suggested that future researcher investigates the validity of our questionnaire in an array of similar and different educational contexts. We need more studies on the contextual and ecological variables that shape teachers’ effectiveness. We also need mixed-methods longitudinal cross-sectional research to have a more complete and accurate picture of teachers’ effectiveness in the long term. The outbreak of COVID-19 tested teachers’ computer literacy as online platforms made education possible. Accordingly, this research field should also include technological pedagogical content knowledge as a variable, for it is considered a crucial skill required from teachers who use digital technologies (Schmid et al., 2021; for a recent review, see Njiku et al., 2020). It is suggested, therefore, that researchers study foreign language teacher’s effectiveness in various contexts as research in this field is still in its infancy in terms of conclusive findings.

References

Afshar, H. S., Rahimi, A., Ghonchepour, A., & Saedpanah, E. (2015). The impact of teaching experience on Iranian EFL teachers’ sense of efficacy and their preparation of English teacher distinctive characteristics. Procedia: Social and Behavioral Sciences, 192, 714-719. https://doi.org/10.1016/j.sbspro.2015.06.069Links ]

Akyıldız, S. T., & Çelik, V. (2020). Thinking outside the box: Turkish EFL teachers’ perceptions of creativity. Thinking Skill and Creativity, 36, 1-14. https://doi.org/10.1016/j.tsc.2020.100649Links ]

Asl, E. S., Asl, N. S., & Asl, A. S. (2014). The erosion of EFL teachers’ content and pedagogical content knowledge throughout the years of teaching experience. Procedia: Social and Behavioral Sciences, 98, 1599-1605. https://doi.org/10.1016/j.sbspro.2014.03.583Links ]

Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191-215. https://doi.org/10.1037/0033-295X.84.2.191Links ]

Bateman, B. E. (2008). Student teachers’ attitude and beliefs about using the target language in the classrooms. Foreign Language Annals, 41(1), 11-28. https://doi.org/10.1111/j.1944-9720.2008.tb03277.xLinks ]

Bowcher, W. L., & Zhang, Z. (2020). Pointing at words: Gestures, language and pedagogy in elementary literacy classrooms in China. Linguistics and Education, 55, 1-13. https://doi.org/10.1016/j.linged.2019.100779Links ]

Chambless, K. S. (2012). Teachers’ oral proficiency in target language: Research on its role in language teaching and learning. Foreign Language Annals, 45(s1), 141-162. https://doi.org/10.1111/j.1944-9720.2012.01183.xLinks ]

Choi, E., & Lee, J. (2016). Investigating the relationship of target language proficiency and self-efficacy among nonnative EFL teachers. System, 58, 49-63. https://doi.org/10.1016/j.system.2016.02.010Links ]

Coombe, C., Vafadar, H., & Mohebbi, H. (2020). Language assessment literacy: What do we need to learn, unlearn, and relearn? Language Testing in Asia, 10, 1-16. https://doi.org/10.1186/s40468-020-00101-6Links ]

Faez, F., Karas, M., & Uchihara, T. (2019). Connecting language proficiency to teaching ability: A meta-analysis. Language Teaching Research. https://doi.org/10.1177/1362168819868667Links ]

Fatemi, M. A., Ganjali, R., & Kafi, Z. (2016). EFL teachers’ personality type and their effectiveness in teaching: Investigating the relationship. Global Advanced Research Journal of Educational Research and Review, 4(10), 189-195. [ Links ]

Galluzo, G. R. (2005). Performance assessment and renewing teacher education: The possibilities of the NBPTS standards. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 78(4), 142-145. https://doi.org/10.3200/TCHS.78.4.142-145Links ]

Giraldo, F. (2021). A reflection on initiatives for teachers’ professional development through language assessment literacy. Profile: Issues in Teachers’ Professional Development, 23(1), 197-213. https://doi.org/10.15446/profile.v23n1.83094Links ]

Goodwin, A. L., Low, E. L., Cai, L., & Yeung, A. S. (2019). A longitudinal study on starting teachers’ retention intentions: Do pre-teaching work experience and length of working years make a difference? Teaching and Teachers Education, 83, 148-155. https://doi.org/10.1016/j.tate.2019.03.015Links ]

Grieser, D. R., & Hendricks, K. S. (2018). Review of literature: Pedagogical content knowledge and string teacher preparation. Applications of Research in Music Education, 37(1), 13-19. https://doi.org/10.1177/8755123318760970Links ]

Han-Tosunoglu, C., & Lederman, N. G. (2021). Developing an instrument to assess pedagogical content knowledge for biological socioscientific issues. Teaching and Teacher Education, 97, 103-217. https://doi.org/10.1016/j.tate.2020.103217Links ]

Hao, S., & Johnson, R. L. (2013). Teachers’ classroom assessment practices and fourth graders’ reading literacy achievement: An international study. Teaching and Teacher Education, 29, 53-63. https://doi.org/10.1016/j.tate.2012.08.010Links ]

Harris, D. N., & Sass, T. R. (2011). Teacher training, teacher quality and student achievement. Journal of Public Economics, 95(7-8), 798-812. https://doi.org/10.1016/j.jpubeco.2010.11.009Links ]

Henry, G. T., Bastien, K. C., & Fortner, C. K. (2011). Stayers and leavers: Early-career teacher effectiveness and attrition. Educational Researcher, 40(6), 271-280. https://doi.org/10.3102/0013189X11419042Links ]

Hoang, T., & Wyatt, M. (2021). Exploring the self-efficacy beliefs of Vietnamese pre-service teachers of English as a foreign language. System, 96, 102-422. https://doi.org/10.1016/j.system.2020.102422Links ]

Hunt, B. C. (2009). Teacher effectiveness: A review of the international literature and its relevance for improving education in Latin America. Partnership for Educational Revitalization in the Americas. [ Links ]

Jeloudar, S. Y, & Yunus, A. S. (2011). Exploring the relationship between teachers’ social intelligence and classroom discipline strategies. International Journal of Psychological Studies, 3(2), 149-155. https://doi.org/10.5539/ijps.v3n2p149Links ]

Kremmel, B., & Harding, L. (2020). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100-120. https://doi.org/10.1080/15434303.2019.1674855Links ]

Levi, T., & Inbar-Lourie, O. (2020). Assessment literacy or language assessment literacy: Learning from the teachers. Language Assessment Quarterly, 17(2), 168-182. https://doi.org/10.1080/15434303.2019.1692347Links ]

Li, Z., & Li, L. (2019). An examination of kindergarten teachers’ beliefs about creative pedagogy and their perceived implementation in teaching practices. Thinking Skills and Creativity, 32, 17-29. https://doi.org/10.1016/j.tsc.2019.03.001Links ]

Liakopoulou, M. (2011). The professional competence of teachers: Which qualities, attitudes, skills, and knowledge contribute to a teachers’ effectiveness? International Journal of Humanities and Social Sciences, 1(21), 66-78. [ Links ]

Mitchell, M., & Bradshaw, C. (2013). Examining classroom influences on student perceptions of school climate: The role of classroom management and exclusionary discipline strategies. Journal of School Psychology, 51(5), 599-610. https://doi.org/10.1016/j.jsp.2013.05.005Links ]

Moradkhani, S., Raygan, A., & Moein, M. S. (2017). Iranian EFL teachers’ reflective practices and self-efficacy: Exploring possible relationships. System, 65, 1-14. https://doi.org/10.1016/j.system.2016.12.011Links ]

Njiku, J., Mutarutinya, V., & Maniraho, J. F. (2020). Developing technological pedagogical content knowledge survey items: A review of literature. Journal of Digital Learning in Teacher Education, 36(3), 150-165. https://doi.org/10.1080/21532974.2020.1724840Links ]

Noorbakhsh, Z., Pishghadam, R., & Saboori, F. (2018). Stroke and gender identity in teacher success: From learners’ viewpoint. Sri Lanka Journal of Social Sciences, 41(1), 39-48. https://doi.org/10.4038/sljss.v41i1.7591Links ]

Nosrati, R. (2020). Language teachers’ effectiveness: Contributing factors [Unpublished master’s thesis]. Iran University of Science and Technology, Tehran, Iran. [ Links ]

Oryan, S., & Ravid, R. (2019). The experiences of pre-service teachers delivering a study unit on multiculturalism, racism and prejudice. Teaching and Teacher Education, 86, 1-10. https://doi.org/10.1016/j.tate.2019.102911Links ]

Pane, D. M. (2010). Viewing classroom discipline as negotiable social interaction: A communities of practice perspective. Teaching and Teacher Education, 26(1), 87-97. https://doi.org/10.1016/j.tate.2009.05.002Links ]

Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128-138. https://doi.org/10.1016/j.tate.2019.05.003Links ]

Penner, J. G. (1984). Why many college teachers cannot lecture: How to avoid communication breakdown in the classroom. Charles C. Thomas. [ Links ]

Pishghadam, R., Baghaei, P., & Shahriyari Ahmadi, H. (2011). Development and validation of English language teacher competency test using item response theory. The International Journal of Education and Psychology Assessment, 8(2), 54-68. [ Links ]

Santilli, V., Miller, A. N., & Katt, J. (2011). A comparison of the relationship between instructor nonverbal immediacy and teacher credibility in Brazilian and U.S. classrooms. Communication Research Reports, 28(3), 266-274. https://doi.org/10.1080/08824096.2011.588583Links ]

Sato, R. (2020). Gestures in EFL classroom: Their relations with complexity, accuracy, and fluency in EFL teachers’ L2 utterances. System, 89, 102-215. https://doi.org/10.1016/j.system.2020.102215Links ]

Schmid, M., Brianza, E., & Petko, D. (2021). Self-reported technological pedagogical content knowledge (TPACK) of pre-service teachers in relation to digital technology use in lesson plans. Computers in Human Behavior, 115, 106-586. https://doi.org/10.1016/j.chb.2020.106586Links ]

Shulman, L. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1-23. https://doi.org/10.17763/haer.57.1.j463w79r56455411Links ]

Staiger, D. O., & Rockoff, J. E. (2010). Searching for effective teachers with imperfect information. Journal of Economic Perspectives, 24(3), 97-118. https://doi.org/10.1257/jep.24.3.97Links ]

Thompson, G. (2020). Exploring language teacher efficacy in Japan. Multilingual Matters. https://doi.org/10.21832/THOMPS5396Links ]

Thompson, G., & Dooley, K. (2019). Exploring the key domains where teacher efficacy beliefs operate for Japanese high-school English teachers. Asia Pacific Education Review, 20(3), 503-518. https://doi.org/10.1007/s12564-019-09607-yLinks ]

Thompson, G., & Woodman, K. (2019). Exploring Japanese high school English teachers’ foreign language teacher efficacy beliefs. Asia-Pacific Journal of Teacher Education, 47(1), 48-65. https://doi.org/10.1080/1359866X.2018.1498062Links ]

Vogt, K., Tsagari, D., Csépes, I., Green, A., & Sifakis, N. (2020). Linking learners’ perspectives on language assessment practices to teachers’ assessment literacy enhancement (TALE): Insights from four European countries. Language Assessment Quarterly, 17(4), 410-433. https://doi.org/10.1080/15434303.2020.1776714Links ]

Wang, C., & Sun, T. (2020). Relationship between self-efficacy and language proficiency: A meta-analysis. System, 95, 102-366. https://doi.org/10.1016/j.system.2020.102366Links ]

Zamani, R., & Ahangari, S. (2016). Characteristics of an effective English language teacher (EELT) as perceived by learners of English. International Journal of Foreign Language Teaching and Research, 4(14), 69-88. [ Links ]

How to cite this article (APA, 7th ed.): Nayernia, A., Nosrati, R., & Mohebbi, H. (2022). The factors contributing to language teachers’ effectiveness in an EFL learning context: A questionnaire validation study. Profile: Issues in Teachers’ Professional Development, 24(2), 63-79. https://doi.org/10.15446/profile.v24n2.93571

About the Authors

Akram Nayernia Is an assistant professor of Applied Linguistics in Iran University of Science and Technology. Her main research areas are language testing and assessment, teacher education, and ESP. She has presented and published several articles in these areas.

Rana Nosrati Is a PhD student at Tarbiat Modares University, Tehran, Iran, majoring at TEFL. She got her MA from Iran University of Science and Technology in 2020. Her areas of interest include teacher education, teacher development, and language learning. She has presented and published several articles in these areas.

Hassan Mohebbi Is an editorial board member of Language Testing in Asia (Springer), Asian-Pacific Journal of Second and Foreign Language Education (Springer), Language Teaching Research Quarterly (EUROKD), and Australian Journal of Applied Linguistics (Book Reviews Editor). His main research interests are writing, individual differences, assessment literacy, ESP, EAP, and ERPP.

Appendix A: Questionnaire to Obtain Experts’ Opinions

Dear Professor,

It would be appreciated if you, as an expert, participate in this data collection process for an MA thesis entitled Language Teacher Effectiveness: Contributing Factors (Nosrati, 2020), at Iran University of Science and Technology. Your attitudes and identity will be kept confidential.

Regards.

Please enter your information

Name:

Years of teaching at university:

The university you teach at:

You shall find 40 statements about effective language teachers. Please mark with an asterisk (*) the option that best represents your opinion regarding each statement.

Effective language teachers should: Strongly agree Agree Don’t know Strongly disagree Disagree
1. Be experienced
2. Have a high level of topical knowledge
3. Speak English well
4. Believe in their ability
5. Pronounce words appropriately
6. Assess students fairly
7. Treat students in a friendly manner
8. Be flexible in their discipline
9. Be prepared for possible questions in the content area
10. Be punctual
11. Know how to present the content
12. Use different methods of assessment
13. Be aware of their gestures in the classroom
14. Care for their physical appearance
15. Be aware of the negative and positive effects of distance between them and their students
16. Be a good oral proficiency model for learners
17. Abstain from teaching at course levels in which they have no experience
18. Have a sense of humour
19. Be self-confident
20. Consider course objectives in their assessment
21. Use their learning experience as well as their teaching experience
22. Know how to react when their preparation does not correspond to their teaching assignments
23. Give regular assignments to their students
24. Know and use different interpretation models in assessments
25. Be motivational for language learners
26. Work on their oral proficiency as one of the first impression factors on learners
27. Assess all aspects of language
28. Adapt their speech to the level of teaching
29. Use dynamic assessments to help students learn while being assessed
30. Increase their experience in the first years of teaching as much as possible
31. Know the social norms of the class
32. Use their experience to improve their self-efficacy
33. Use their colleagues’ experience
34. Consider the context for effective lesson presentation
35. Use assessment results as a tool for improving class productivity
36. Practice reflective thinking to improve their self-efficacy
37. Be open to using new and various strategies
38. Have a high level of emotional intelligence
39. Work on their oral proficiency as one of the main input tools for language learners
40. Show their emotions (such as interest, enthusiasm, and anger) to students

Appendix B: Pilot Questionnaire

Items Strongly agree Agree Don’t know Strongly disagree Disagree
1. I communicate well in English well
2. I pronounce words appropriately
3. I assess students fairly
4. I am prepared for questions in the content area
5. I am punctual
6. I am creative in using tasks and activities
7. I know how to present the content
8. I am aware of my gestures in the classroom
9. I am self-confident
10. I consider course objectives in my assessment
11. I use my learning experience as well as teaching experience
12. I can motivate students
13. I consider my oral proficiency as one of the first factors that impress my students
14. I adjust my speaking to the level at which I am teaching
15. I know the social norms of the class in which I am teaching
16. I use my experience to improve my self-efficacy
17. I use my colleagues’ experience
18. I consider the context for effective lesson presentation
19. I use assessment results to improve classroom productivity
20. I practice reflective thinking to improve my self-efficacy
21. I am open to using various teaching techniques
22. I emphasise my oral proficiency as one of the main input tools for language learners
23. I am creative in presenting a lesson
24. I use the students’ native language if necessary

Appendix C: Validated Questionnaire. EFL Language Teachers’ Effectiveness

Items of language teachers’ effectiveness Strongly agree Agree Don’t know Strongly disagree Disagree
1. I communicate well in English well
2. I pronounce words appropriately
3. I assess students fairly
4. I am prepared for questions on the content
5. I am punctual
6. I am creative in using tasks and activities
7. I am aware of my gestures in the classroom
8. I am self-confident
9. I consider course objectives in my assessment
10. I use my learning experience as well as teaching experience
11. I emphasise my oral proficiency as one of the main tools of input for language learners
12. I adjust my speaking to the level at which I am teaching
13. I use my experience to improve my self-efficacy
14. I know the social norms of my class
15. I use my colleagues’ experience
16. I use assessment results to improve classroom productivity
17. I am open to using various techniques
18. I am creative in presenting lessons

Received: February 12, 2021; Accepted: February 24, 2022

This is an Open Access article distributed under the terms of the Creative Commons license Attribution-NonCommercial-NoDerivatives 4.0 International License. Consultation is possible at https://creativecommons.org/licenses/by-nc-nd/4.0/

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License