SciELO - Scientific Electronic Library Online

 
vol.11 issue3School experience of an offending teenager associated with the consumption and sale of psychoactive substances in BogotáAnalysis of the implementation of the National Telecommunications System in Emergencies as a tool for risk management: cases from Bogotá and Medellín author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Revista Logos Ciencia & Tecnología

Print version ISSN 2145-594XOn-line version ISSN 2422-4200

LogosCyT vol.11 no.3 Bogotá Sep./Dec. 2019  Epub Dec 28, 2019

https://doi.org/10.22335/rlct.v11i3.939 

Investigation article

Influence of first-generation antihistamines on aviation pilots performance

Influencia de antigripales con antihistamínicos de primera generación en el desempeño de pilotos de aviación

Influência de drogas anti-gripe com anti-histamínicos de primeira geração no desempenho de pilotos de aviação

Laura Daniela Rojas-Vargasa 

María Alejandra Albornoz-Larrotab 

Gloria Juliana Arias-Paredesc 

César Augusto Moreno-Baracaldod 

Ricardo Otero-Caicedoe 

a http://orcid.org/0000-0003-1859-8883 Pontificia Universidad Javeriana, Bogotá, Colombia

b http://orcid.org/0000-0003-1525-2596 Pontificia Universidad Javeriana, Bogotá, Colombia

c http://orcid.org/0000-0002-4026-0822 Pontificia Universidad Javeriana, Bogotá, Colombia

d http://orcid.org/0000-0001-9626-8447 Pontificia Universidad Javeriana, Bogotá, Colombia

e http://orcid.org/0000-0002-0358-8538 Pontificia Universidad Javeriana, Bogotá, Colombia


SUMMARY

According to different studies carried out by the United States Federal Aviation Administration, possible causal links have been found between fatal accidents and the consumption of first-generation antihistamines. The fundamental aim of this project is to analyze through a study with pilots, how the consumption of over-the-counter flu medicine affect their flight performance. We collected the data using a static flight simulator. Eight pilots with more than 150 hours of flight experience completed specific tests exposed to a consumption of first-generation antihistamines or a placebo. A two-factor ANOVA test confirmed that the consumption of first-generation antihistamine does influence pilot performance (p<0.05). Through observation, we found that pilots decreased their capacity to remember basics activities and their ability to react in an emergency in flight.

Keywords: antihistamine; performance; pilots; flight simulator

RESUMEN

Según diferentes estudios realizados por la Administración Federal de Aviación de Estados Unidos, se han encontrado posibles relaciones de causalidad entre accidentes fatales y el consumo de antihistamínicos de primera generación. El objetivo fundamental de este trabajo es analizar mediante un estudio con pilotos, como el consumo de antigripales de venta libre afecta el desempeño de estos. Este experimento se realizó con un simulador de vuelo estático. Se contaron con 8 pilotos de aviación con más de 150 horas de vuelo de experiencia para realizar las pruebas específicas en diferentes niveles de dificultad (básico y avanzado). La prueba ANOVA confirmó que el consumo de antihistamínicos de primera generación influye en el rendimiento del piloto (p<0.05). A través de la observación, se encontró que se reducen las capacidades de recordar las actividades básicas y las capacidades de reaccionar en una emergencia en vuelo.

Palabras clave: antihistamínico; desempeño; pilotos; simulador de vuelo

SUMÁRIO

De acordo com diferentes estudos realizados pela Administração Federal de Aviação dos Estados Unidos, possíveis relações causais foram encontradas entre acidentes fatais e o consumo de anti-histamínicos de primeira geração. O principal objetivo deste trabalho é analisar, por meio de um estudo com pilotos, como o consumo de anti-gripe vendido sem receita médica afeta o desempenho destes. Este experimento foi realizado com um simulador de voo estático. Havia 8 pilotos de aviação com mais de 150 horas de voo para realizar testes específicos em diferentes níveis de dificuldade (básico e avançado). Foi realizado um teste ANOVA de dois fatores e o valor de (p<0.05) foi encontrado, indicando que o consumo de anti-histamínicos de primeira geração influencia o desempenho do piloto. Através da observação, verificou-se que a capacidade de recordar atividades básicas a capacidade de reagir em uma emergência de vôo é reduzida.

Palavras-chave: anti-histamínico; desempenho; pilotos; simulador de voo

The aircraft industry has been growing steadily on economic, social, cultural and political impacts. The continue growing of air transport have established metrics such as World Governance Indicators, the Social Progress Imperative and the Environmental Performance Index (Kiliç, Uyar, & Karaman, 2019). However, one of the most important indicators for the aviation industry is a safe operation in the air.

The air operations safety in each country has different requirements, but in all of them, medicines, hallucinogenic substances and alcohol consumption are banned. One of the most common diseases is the flu and to alleviate its symptoms, it is usual to prescribe antihistamines (AHs). The AHs are the established primary treatment for the symptomatic relief of allergic disorders such as flu, allergic rhinitis (AR) and urticaria. Prevalence rates of AR vary greatly across populations, with a range between 5 and 50% of the global population suffering from the condition (Mullol et al., 2008).

Different studies have established the influence that antihistamines have on the technical capacities to develop an activity. It has been found that the consumption of medicines or other substances diminishes the psycho-physical capacities, being a risk for the safety of the flights (Rogers et al., 2017). Some of the effects generated by the consumption of medicines are drowsiness and/or visual alterations. One of the most relevant studies has found that currently all substances such as medicine, alcohol and drugs are considered dangerous for aeronautical personnel because they generate adverse reactions that may involve decreased flight performance (Kapur, Parand, Soukup, Reader, & Sevdalis, 2016). The sedative effects of first-generation antihistamines at therapeutic dose levels are able to potentiate the CNS-impairing effects of ethanol in producing more performance decrement than the simple additive effects. (Pasko et al., 2017).

Biological samples collected from fatally injured pilots in aviation accidents involving all types of aircraft, including amateur-built aircraft, are submitted to the Civil Aerospace Medical Institute (CAMI) for accident investigation. The pilots percentage detected with prescription drugs was 26% for amateur-built aircraft, 16% for non-amateur built aircraft and 18% for all aircraft. Ethanol/drug use and medical condition were determined to be a cause or factor in 42 (11%) of the 385 ethanol/drug-positive amateur-built aircraft accidents investigated by the NTSB (Chaturvedi, Craft, Hickerson, Rogers, & Soper, 2013). However, aircraft mechanical failures are still one of the main accident causes (Australian Transport Safety Bureau, 2006).

In late 2001, the United States National Transportation Board (NTSB) and the United States Food and Drug Administration (FDA) considered the labeling of drugs that have the potential to impair performance (Qidwai, Watson, & Weiler, 2002). In addition, they need to analyze the effects of flu medicine as a factor involved in the reduction of neuromotor capacities in pilots.

For the Colombian context, the aeronautical regulation differs from the USA regulation. In this sense, the Colombian regulation, which is the RAC 215, sets the service of routes, the navigations systems, the national regulations and the airside requirements (Reglamentos Aeronáuticos de Colombia," Aeronaútica Civil, Bogotá-Colombia, 2018). In addition, the RAC 13 says that any aeronautical license holder must inform if anybody is on medical treatment with prescribed medications (Reglamentos Aeronáuticos de Colombia," Aeronaútica Civil, Bogotá-Colombia, 2018).

Previous studies have identified factors that may cause low-performance in pilots maneuvering abilities. Lopez, Previc, Fischer, Heitz, y Engle, (2012), analyzed the cognitive performance of ten air force pilots in a simulator. The authors found that the lack of sleep and fatigue are an important element that affects pilots' capabilities and should be taken into consideration to prevent air accidents. Similarly, the fatigue is one of the major causes of stress in pilots. Wilson, Caldwell, y Russell, (2007) conducted a study to establish that performance measures for fatigue are correlated positively due to the difficulty of the task. Therefore, the authors conduct a psychomotor surveillance test in two experimental emulators, a battery of multi-attribute tasks and a static single-task aircraft simulator. The research concluded that the multi-attribute task represents a higher effort and decrease profoundly the pilot performance.

Beside the lack of sleep and fatigue, the age also influences the pilot performance. Causse, Dehais, y Pastor (2011) executed a test involving age ranges in order to find a correlation within flight performance. These found that pilots over fifty-five years tend to have lower performance compared to younger pilots.

The pilot diet and body comfort are other factors that influence pilot's performance. Lindseth et al. (2011) conducted an experiment that set a specific diet. This study concluded that a high-fat and carbohydrates diet generates better cognitive performance compared to a high-protein diet. On the other hand, body comfort and temperature are also factors that influence psychological and motor performance, especially when they are in more difficult situations (Li et al., 2015; Faerevik & Reinertsen, 2003; Landman, Groen, van Paassen, Bronkhorst, & Mulder, 2017; Petruzzello, Gapin, Snook, & Smith 2009).

Recently, researchers have shown an increased interest in aviation accidents, because they are recognized as the most tragic accidents among all modes of transportation due to their severity and the high number of injuries and deaths (Ud-Din & Yoon, 2018). In addition, some toxicological studies of the Federal Aviation Administration (FAA) indicate that from 1475 fatal air accidents between September 30, 2008, and October 01, 2014, about 582 are related to the consumption of first-generation anti-histamines. In addition, the FAA indicates that the use of first-generation antihistamines has as secondary effects vestibular illusions, spatial disorientation and cognitive impairment (Gildea, Hileman, & Paskoff, 2018).

Working in the aviation industry produces extra stressors such as, varying schedules, time away from home, and jet lag, which are all unique to the aviation industry. However, there is no denying that pilots, along with others that work in high-standardized industries, operate with an extremely small margin of error. It was not until 2010 that pilots suffering from depression were able to receive prescribed medication and remain on flight duty. This led to concern within the industry that pilots may not be reporting mental health issues as to avoid being grounded and losing their livelihood (Winter, Rice, Rains, & Milner, 2017).

Many researchers have used simulators to measure the training of some activity. The aeronautical industry was one of the pioneers in the training of non-technical skills in simulation, in which it was recognized that the training of pilots only in high-level technical skills was not enough to ensure the safety of passengers (Helmreich, 1997). As for drug efficacy tests in different investigations it has been determined that to measure drug efficacy it is necessary to have two groups to which one to test the drug (treatment group) and another takes a placebo drug (control group). However, the different drugs are currently being tested using medical devices that allow the formulation of the drug to be optimized according to established parameters (Wang et al., 2019; Martínez-Cuadrón et al., 2019).

For these reasons, it is crucial to control the medicine consumption of pilots after, before and during on flight. So far, the researchers have paid attention the decrease of capabilities due to medications (i.e. antihistamines), or the low-performance caused by fatigue and task difficulty, separately. However, no studies have been found relating pilots performance under medications varying task complexity. Then, the aim of this study is to get insights of influence on consumption of flu-medicine and the pilots' performance during their professional practice.

In this paper, we evaluated the potential influence of flu-medicine in the flight performance. For this, we carried out a controlled experiment in a static flight simulator considering the influence of a well-known antihistamine. This document is organized as follows. Section 2 presents the experiment protocol, the materials, methods and data collection procedure. The results of the experiment are presented in section 3. In Section 4, we made a discussion related to the experiments results and its limitations. At the end, Section 5 rounds up the paper with the conclusions and points out the main challenges to be addressed as future work.

Materials and methods

A. Materials

The development of this study was carried out in a static flight simulator of the company B-Plane (Bogota, Colombia). Two types of aircraft were configured depending on the type of test, CESSNA 182RG and King Air 350.

B. Method

Description of the sample

Eights pilots with an average flight hour of 2835 ± 801 experience were selected. The volunteers were four men and four women in the 25 - 50 years age range.

Study Factors

The test had two different stimuli: medication consumption and the complexity of the test. Different test configuration is shown in table 1. We use two levels of test complexity to evaluate if medicament consumption affects in the same way in different real flight situations.

Table 1 Study Factors. 

A treatment group (medication intake) and a control group (placebo intake) were determined. Both groups performed the tests at different levels of difficulty.

The medication used was PAX Noche® that contains chlorpheniramine maleate 2 mg. As the active ingredient, it has chlorpheniramine, which is a primary generation of anti-histamine with some side effect like somnolence, dizziness.

Regardless to task difficulty, basic tasks is represented in a CESSNA 182RG single-engine plane on the runway Villavicencio city. Advanced task is represented in a King Air 350 twin-engine with a failure in one engine during take-off on the runway Manizales city, which is 7000 feet high and is surrounded by mountains, being of greater difficulty compared to the first runway. Moreover, the pilots had to communicate with the control tower by radio during the flight. Table 2 shows the procedure for each difficulty in more detail.

Table 2 Description of tests by difficulty. 

Each pilot carried out the four different tests, two under the consumption of the medicine and the other two under placebo consumption.

Fig. 1 Static flight simulator. 

Test Design

The static flight simulator has projectors that show the landscape related to the runway, with three monitors representing the cockpit, the right and left view of the plane and the control console. In relation to the medicine, several boxes containing the flu medicine were purchased, so that they all belong to the same batch to avoid variations.

In addition, as the experiment can take several days of data collection, we ensured that the environment was the same for all test and we recommended the pilots to sleep at least 7 hours and to maintain a balanced diet.

Type of experimental design

We collected 32 observations under a 22 within-subjects factorial design.

Evaluation of performance

For this experiment, the response variable is the pilot's performance, evaluated with a score varying from zero to ten, where zero is the lowest score and ten the highest. Flight instructors made the assessment and established the score based on the rubrics of aircraft manuals. At the test beginning, the instructor verified whether the participants had knowledge about basic as descriptive information of airplane, its components, height level, overall length, wheelbase length, etc. Besides, the evaluation was made with airspeed limitations, communication with control tower, the powerplant describes maximum continues power, weight and loading distribution, flight limits authorized maneuvers with the right speeds, flight load factor limits and kinds of operation limits.

Data Logging

We did not inform the pilots about the degree of difficulty of the tests, nor about the effects that the consumption of the medicine had. The order of data collection was random. The medicament was taken one hour before the start of the test to guarantee its effect.

Results

A. Descriptive analysis

In the descriptive analysis of the data, differences are shown between the data obtained for the stimulus and difficulty factors, with respect to test score. Boxplot in figure 2 shows that there were differences in the performance during the development of each type of test. In the test with stimulus and without stimulus, the performance rating of the maneuver was 8.02 ± 1.51 and 9.06 ± 0.654. In the case of basic and advanced difficulty, the scores were 9.52 ± 0.217 and 7.56 ± 1.10 respectively.

Fig. 2 Descriptive analysis: Boxplot of stimulus and difficulty factors with the response variable. 

Carrying out the analysis from the stimulus and difficulty combination, it was obtained, when there is no stimulus and the difficulty is basic, the score is 9.59 ± 0.192; without stimulus and advanced difficulty 8.53 ± 0.491; with stimulus and basic 9.45 ± 0.23. Finally, with stimulus and advanced 6.58 ± 0.399. It observed a decrease in the basic skills test that is not as evident as in the advanced test. For this reason, the finding of the current study suggests that it is possible that at an emergency time, they do not have the necessary skills to meet the needs of the moment. Boxplot are shown in figure 2.

B. Inferential analysis

Model effects

Inferential analysis of the data was performed based on the effects model (Equation 1). For this, the following hypotheses were determined.

Equation 1 present the response variable y ijk explained by µ, the response mean, τi the effect of the medicament, αj the effect of task complexity, (τα)ij the effect of the interaction term, β k the effect of the difference of each pilot and ε ijk , the random error.

Proof of assumptions

We used the Levene tests for homoscedasticity, results show that the variance is equal across the groups (p>0.05). To determine the residuals normality, we used the Kolmogorov-Smirnov test, which results indicate that they can be considered as normal (p>0.05). Due the assumptions of ANOVA are met; we use this approach to analyze the results of this factorial design using software R.

The ANOVA results show that there is a significant effect of medicament consumption F(1,21) = 65.292,(p<0.05), difficulty level F(1,21) = 230.827,(p< 0.05) and interaction between the stimulus and the difficulty level F(1,21) = 49.222 (p<0.05).

Discussion

Results show that both, the medicament consumption and the task difficulty have a significant effect in the task score. Boxplot shows that, under medicament consumption the performance was lower. Moreover, task scores were significantly lower when the task was complex.

In addition, the Medicament-Difficulty interaction was also significant. Based on the boxplot, this means that the medicament consumption has a bigger effect when the task is complex.

We observed that participants taking the medication did not have the same energy to do the tests. In particularly the flu drugs generate drowsiness, loss attention. Further, the decisions took under effects medication on the advanced test for pilots were not appropriated, caused a total or partial plane damaged or going off the landing track.

It is relevant to mention that the results obtained showed that there is a relationship between the consumption of anti-flu drugs and fatal accidents. This can be supported from the accidents reported by the Federal Aviation Administration of United States when they associated some aircraft accident with consume of antihistamines (Gildea et al., 2018).

Conclusion

In this research, we studied the effect of a flu medicament consumption, PAX Noche® which is a primary generation of antihistamine with some side effect like somnolence, on the pilots' performance during a simulated test.

Results show that if a pilot is under this kind of medication their performance will decrease 11%. Moreover, the performance decrease will be bigger if the task is considered complex 23%. Evidence suggest that antihistamine consumption should be considered as a fundamental factor in the professional practice of pilots, as it can affect flight safety. It is suggested that aeronautical entities and risk centers must consider avoiding pilots to flight when they are consuming this kind of medicament.

We suggest for future research to use a larger sample and evaluate more levels of task complexity. It is also needed to study factors such as pressure and hypoxia.

References

Australian Transport Safety Bureau. (2006). Accidents and Incidents Involving Alcohol and Drugs in Australian Civil Aviation, (January 1975), 1-24. [ Links ]

Causse, M., Dehais, F., & Pastor, J. (2011). Executive Functions and Pilot Characteristics Predict Flight Simulator Performance in General Aviation Pilots. The International Journal of Aviation Psychology, 21(3), 217-234. http://dx.doi.org/10.1080/10508414.2011.582441. [ Links ]

Chaturvedi, A. K., Craft, K. J., Hickerson, J. S., Rogers, P. B., & Soper, J. W. (2013). Toxicological findings in fatally injured pilots of 979 amateur-built aircraft accidents. Aviation Space and Environmental Medicine, 84(2), 134-141. http://dx.doi.org/10.3357/ASEM.3285.2013. [ Links ]

Faerevik, H., & Reinertsen, R. E. (2003). Effects of wearing aircrew protective clothing on physiological and cognitive responses under various ambient conditions. Ergonomics, 46(8), 780-799. http://dx.doi.org/10.1080/0014013031000085644. [ Links ]

Gildea, K. M., Hileman, C. R., & Paskoff, L. N. (2018). Antihistamines and Fatal Aircraft Mishaps in Instrument Meteorological Conditions, (July). [ Links ]

Helmreich, R. L. (1997). Managing Human Error in Aviation. Scientific American, 276(5), 62-67. https://doi.org/10.1038/scientificamerican0597-62. [ Links ]

Kapur, N., Parand, A, Soukup, T., Reader, T., & Sevdalis, N. (2016). Aviation and healthcare: a comparative review with implications for patient safety. JRSM Open, 7(1), 205427041561654. http://dx.doi.org/10.1177/2054270415616548. [ Links ]

Kiliç, M., Uyar, A, & Karaman, A S. (2019). What impacts sustain-ability reporting in the global aviation industry? An institutional perspective. Transport Policy, 79(April), 54-65. http://dx.doi.org/10.1016/j.tranpol.2019.04.017. [ Links ]

Landman, A., Groen, E. L., van Paassen, M. M. (René., Bronk-horst, A. W., & Mulder, M. (2017). The Influence of Surprise on Upset Recovery Performance in Airline Pilots. International Journal of Aerospace Psychology, 27(1-2), 2-14. http://dx.doi.org/10.1080/10508414.2017.1365610. [ Links ]

Li, J., Tian, Y., Ding, L., Zou, H., Ren, Z., Shi, L.,... Wang, N. (2015). Simulating extreme environments: Ergonomic evaluation of Chinese pilot performance and heat stress tolerance. Work, 51(2), 215-222. http://dx.doi.org/10.3233/WOR-141842. [ Links ]

Lindseth, G. N., Lindseth, P. D., Jensen, W. C., Petros, T. V., Hel-land, B. D., & Fossum, D. L. (2011). Dietary effects on cognition and pilots' flight performance. International Journal of Aviation Psychology, 21(3), 269-282. http://dx.doi.org/10.1080/10508414.2011.582454. [ Links ]

Lopez, N., Previc, F. H., Fischer, J., Heitz, R. P., & Engle, R. W. (2012). Effects of sleep deprivation on cognitive performance by United States Air Force pilots. Journal of Applied Research in Memory and Cognition, 1(1), 27-33. http://dx.doi.org/10.1016/j.jarmac.2011.10.002. [ Links ]

Martínez-Cuadrón, D., Gil, C., Serrano, J., Rodríguez, G., Pérez-Oteyza, J., García-Boyero, R.,... Montesinos, P. (2019). A precision medicine test predicts clinical response after idarubicin and cytarabine induction therapy in AML patients. Leukemia Research, 76(November 2018), 1-10. http://dx.doi.org/10.1016/j.leukres.2018.11.006. [ Links ]

Mullol, J., Valero, A., Alobid, I., Bartra, J., Navarro, A., Chivato, T.,... Bousquet, J. (2008). Allergic Rhinitis and its impact on asthma update (ARIA 2008). The perspective from Spain. J Investig Clin Immunol, 18(5), 327-334. http://dx.doi.org/10.1111/j.1398-9995.2007.01620.x. [ Links ]

Paśko, P., Rodacki, T., Domagata-Rodacka, R., Palimonka, K., Marcinkowska, M., & Owczarek, D. (2017). Second generation H1 - antihistamines interaction with food and alcohol-A systematic review. Biomedicine and Pharmacotherapy, 93(2017), 27-39. http://dx.doi.org/10.1016/j.biopha.2017.06.008. [ Links ]

Petruzzello, S. J., Gapin, J. I., Snook, E., & Smith, D. L. (2009). Perceptual and physiological heat strain: Examination in firefighters in laboratory- and field-based studies. ERGONOMICS. http://dx.doi.org/10.1080/00140130802550216. [ Links ]

Qidwai, J. C., Watson, G. S., & Weiler, J. M. (2002). Sedation, cognition, and antihistamines. Current Allergy and Asthma Reports, 2(3), 216-222. http://dx.doi.org/10.1007/s11882-002-0022-1. [ Links ]

Reglamentos Aeronáuticos de Colombia," Aeronáutica Civil, Bogotá-Colombia, 2018. (n.d.). R A C 215. [ Links ]

Reglamentos Aeronáuticos de Colombia," Aeronáutica Civil, Bogotá-Colombia, 2018. (2018). R A C 13. [ Links ]

Rogers, P., Hileman, C., Salazar, G., Cliburn, K., Paskoff, L., Hathaway, W.,... Tejera Villalaz, V. H. (2017). Pilots using selective serotonin reuptake inhibitors compared to other fatally injured pilots. Accident Analysis and Prevention, 107(June), 86-91. http://dx.doi.org/10.1016/j.aap.2017.07.023. [ Links ]

Ud-Din, S., & Yoon, Y. (2018). Analysis of Loss of Control Parameters for Aircraft Maneuvering in General Aviation. Journal of Advanced Transportation, 2018, 1-19. http://dx.doi.org/10.1155/2018/7865362. [ Links ]

Wang, J., Helder, L., Shao, J., Jansen, J. A., Yang, M., & Yang, F. (2019). Encapsulation and release of doxycycline from electro-spray-generated PLGA microspheres: Effect of polymer end groups. International Journal of Pharmaceutics, 564(April), 1-9. http://dx.doi.org/10.1016/j.ijpharm.2019.04.023. [ Links ]

Wilson, G. F., Caldwell, J. A., & Russell, C. A. (2007). Performance and psychophysiological measures of fatigue effects on aviation related tasks of varying difficulty. International Journal of Aviation Psychology , 17(2), 219-247. http://dx.doi.org/10.1080/10508410701328839. [ Links ]

Winter, S. R., Rice, S., Rains, T., & Milner, M. (2017). A longitudinal study on the alteration of consumer perceptions and the use of pilot medication. Journal of Air Transport Management, 59, 100-106. http://dx.doi.org/10.1016/j.jairtraman.2016.12.004. [ Links ]

Para citar este artículo / To reference this article / Para citar este artigo: Rojas, L.D., Albornoz, M.A., Arias, G.J., Moreno, C.A., & Otero, R. (2019). Influence of first-generation antihistamines on aviation pilots performance. Revista Logos Ciencia & Tecnología, 11(3), 59-66. http://dx.doi.org/10.22335/rlct.v11i3.939

Received: June 06, 2019; Revised: October 31, 2019; Accepted: November 12, 2019

* Autor para correspondencia. Correo electrónico: paperdoepuj@outlook.com

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License