SciELO - Scientific Electronic Library Online

 
vol.46 número2Safety of oral anticoagulants in advanced chronic kidney diseaseTruth in medical literature índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Em processo de indexaçãoCitado por Google
  • Não possue artigos similaresSimilares em SciELO
  • Em processo de indexaçãoSimilares em Google

Compartilhar


Acta Medica Colombiana

versão impressa ISSN 0120-2448

Acta Med Colomb vol.46 no.2 Bogotá jan./jun. 2021  Epub 21-Nov-2021

https://doi.org/10.36104/amc.2021.1884 

Review

Types of randomized clinical trials published in PubMed over 40 years

MARIANA MARTÍNEZ-FRANCOa  * 

ANTONIO ROBERTO NIRTA-PÉREZb 

JORGE HERNANDO DONADO-GÓMEZc 

a Médica Uni versidad de Antioquia; Medellín (Colombia).

b Médico Universidad de Antioquia; Medellín (Colombia).

c Internista; Magíster Epidemiología Hospital Pablo Tobón Uribe, Docente OcasionalUniversidad de An tioquia. Medellín (Colombia).


Abstract

Introduction:

there are several variations of randomized clinical trials. Trials can be classi fied by design as parallel, cross-over, factorial, assignment by group, n-of-1, paired, withdrawal, adaptive and pragmatic; and by purpose as superiority, non-inferiority and equivalence. Given this heterogeneity, the Consolidated Standards of Reporting Trials (CONSORT) were introduced in 1996 to provide a guideline for reporting randomized clinical trials.

Objective:

to describe the publication tendency of the various types of randomized clinical trials over 40 years, with reference to the publication of CONSORT and its extensions.

Methods:

the PubMed tool was used to search for randomized clinical trials published between 1979 and 2018, classifying them according to the varieties described.

Results:

a total of 472,114 published articles were found; 90.2% did not report the type of design and 98.2% did not report the purpose. Among the articles that reported the variety of randomized clinical trial, the predominant design was cross-over (5.9%), followed by parallel groups (2.34%); while the most common purpose was superiority (0.84%). After the launch of CONSORT, there was an increased proportion of articles published with the following designs: parallel groups; difference in proportions 1.89 95% CI (1.1-2.7); paired 1.07 95% CI (0.2-1.9); and pragmatic 4.73 95% CI (4.4-5.1); and for the purpose of non-inferiority 5.97 95% CI (5.6-6.3).

Discussion:

most articles on randomized clinical trials do not mention their type in the title and abstract. The proportion of articles that did, increased slightly after CONSORT was published. (Acta Med Colomb 2021; 46. DOI:https://doi.org/10.36104/amc.2021.1884).

Key words: clinical trial; epidemiological study design; publications; epidemiological study characteristics; assessment of therapeutic intervention results

Resumen

Introducción:

existen múltiples variantes del ensayo clínico aleatorizado; según diseño: grupos paralelos, cruzado, factorial, asignación por grupos, N de 1, pareado, retiro, adaptativo y pragmático; y por propósito: superioridad, no inferioridad y equivalencia. Debido a esta heterogeneidad, en 1996 se introdujo el CONSORT (Consolidated Standards of Reporting Trials) para suministrar una guía para el reporte de los ensayos clínicos aleatorizados.

Objetivo:

describir la tendencia de publicación de los tipos de ensayos clínicos aleatorizados durante 40 años, en relación con la publicación del CONSORT y sus extensiones.

Métodos:

se utilizó la herramienta PubMed para realizar una búsqueda de ensayos clínicos aleatorizados publicados entre 1979 y 2018, discriminándolos según las variantes descritas.

Resultados:

se encontraron 472 114 artículos publicados, el 90.2% no reportó tipo de diseño y 98.2% no reportó propósito. Entre los artículos que reportaron la variante de ensayos clínicos aleatorizados, el diseño predominante fue el cruzado (5.9%), seguido por grupos paralelos (2.34%); mientras que el propósito más frecuente fue el de superioridad (0.84%). Hubo un aumento en la proporción de artículos por variante publicados después del lanzamiento del CONSORT para los diseños de: grupos paralelos; diferencia de proporciones 1.89 IC 95% (1.1-2.7); pareado 1.07 IC 95% (0.2-1.9); pragmático 4.73 IC 95% (4.4-5.1); y para el propósito de no inferioridad 5.97 IC 95% (5.6-6.3).

Discusión:

la mayoría de los artículos sobre ensayos clínicos aleatorizados no mencionan en su título y resumen la variante de estos. La proporción de artículos que sí lo hicieron, aumentó discre tamente después de la publicación del CONSORT. (Acta Med Colomb 2021; 46. DOI:https://doi.org/10.36104/amc.2021.1884).

Palabras clave: ensayo clínico; diseño de investigaciones epidemiológicas; publicaciones; ca racterísticas de estudios epidemiológicos; evaluación de resultados de intervenciones terapéuticas

Introduction

Clinical trials are prospective studies in humans compar ing the effects of an intervention with a control 1.

They date back to the eighteenth century, when Lind described the characteristics of what would be the first documented clinical trial, carried out with a small sample of scurvy patients 2.

Today, randomized controlled trials are considered to contribute the greatest level of evidence for healthcare interventions. Due to their growing popularity, multiple variants of the original design have emerged, now known as "parallel group" studies, which consist in selecting a sample of patients and randomly assigning them to one of two or more groups 3.

The other variants include:

  • Cluster: used when individual assignment is not appro priate due to the possibility of intervention "contamina tion" among the participants. In this case, assignments are made by groups or "clusters," which may be geo graphic zones, institutions or groups of patients seen by a physician 4,5.

  • Cross over: in this case, each participant acts as his/her own control, receiving the intervention and the compara tor during different periods, with a washout time between each 4,5,19.

  • N-of-1: a variant used when the available evidence is not useful for a particular patient. Therefore, a crossover study is performed with this patient in which he/she acts as his/ her own control and receives the study intervention and comparator alternately and randomly, in several cycles. The entire population consists of a single patient and the study results cannot be extrapolated to other patients 6.

  • Factorial: allows two or more interventions to be evalu ated in a single study. The interventions are randomly assigned such that the participant may receive no inter vention, only one, or perhaps all of them 4,5,19.

  • Paired: in this design, the randomized unit is not an in dividual but rather an organ or body site, such that each participant may receive two or more treatments in differ ent parts of the body. Other terms used to describe it are "within person", "split body", "split face", "split mouth" or "contralateral" 7.

  • Withdrawal: the aim of this variant is to evaluate the response to discontinuation or reduction of the dose of an intervention which has already been tolerated and has proven beneficial 4,5.

  • Adaptive: this is one of the most recent variants of random ized controlled trials, which consists in allowing variability in the participants, the size of the sample, the intervention and the outcomes according to the study's preliminary re sults. This permissiveness must be stipulated in the research protocol 8.

  • Pragmatic: these designs seek to maximize the generalizability of study results, and therefore they are carried out in "usual practice" settings, with a broad range of participants and taking into account clinically significant outcomes like mortality and morbidity. Their counterparts are explanatory trials, which are a more widely used and have much more controlled conditions in an effort to prove a causal hypoth esis, decreasing the potential implementation capacity of this hypothesis 9.

In addition to the design variants, new purposes for random ized controlled trials have emerged over time. The classical purpose is superiority, which seeks to determine if an interven tion is more effective than the reference. However, studies may also evaluate whether an intervention is not inferior, or whether both interventions are the same. These purposes correspond to noninferiority and equivalence studies, respectively 3,19.

Due to the importance of randomized controlled trials today and the growing research in methodology, a group of experts has been developing a tool since 1996 to improve the quality of reporting and decrease its associated biases: the Consolidated Standards of Reporting Trials (CONSORT). The third version, the CONSORT 2010 statement, is currently in force: updated guidelines for reporting parallel group randomized controlled trials 10. Its extensions have also been published, with guidelines for publishing cluster designs available since 2004 11,12, noninferiority and equivalence since 2006 13,14, pragmatic since 2009 9, N-of-1 since 2015 15, and within person since 2017 7.

This article seeks to describe the publication tendencies of the different randomized controlled trial variants over 40 years, from 1979 to 2018, and their relationship with the launching of CONSORT guidelines, specifically with regard to the guidelines for including the randomized controlled trial subtype in the article's title and abstract.

Materials and methods

This was an observational study using the PubMed tool to search for randomized controlled trials published between 1979 and 2018.

First, the number of randomized controlled trials pub lished during this period was identified, and then a search strategy was implemented for each of the following designs: parallel group studies, cluster studies, cross over studies, N-of-1 studies, factorial studies, paired studies, withdrawal studies, adaptive studies and pragmatic studies.

A bibliographic search was also performed based on the purpose of the clinical trials, considering the three existing possibilities: superiority, noninferiority and equivalence studies.

The search terms were selected based on the following criteria:

  • For designs with an existent CONSORT extension, the CONSORT recommended term was used.

  • For designs not yet included in CONSORT or for which no particular term is recommended for reporting, the study name was combined with the terms "study", "de sign" and "trial".

The search strategies employed may be found in the supplementary material (Annex 1).

The search results were reported separately by two of the authors (MMF and ARNP) and their concordance was assessed using the kappa coefficient. The data are presented as absolute and relative frequencies. A comparison of the data before and after the respective CONSORT publication was performed using the difference in proportions test. A p < 0.05 was considered to be statistically significant. The Epidat version 4.2 statistical package was used 22.

This study did not require ethics committee approval as the unit of analysis was published clinical trials.

Results

According to the bibliographic search performed be tween 1979 and 2018, a total of 472,114 articles labeled as "randomized controlled trials" were published, and 94.58% were published in English, followed by 1.7% in Chinese and 1.25% in German. The remaining languages like French, Spanish, Portuguese, Japanese, Italian and Russian accounted for less than 1%. A total of 90.2% (426,071) of these articles did not mention the design variant used in their titles or abstracts. The remaining percentage was distributed as follows: 28,246 (5.9%) were of the cross over variant, 11,064 (2.34%) were parallel groups, 2,056 (0.4%) were clusters, 1,796 (0.38%) were factorial, 1,548 (0.32%) were pragmatic, 847 (0.17%) were paired, 246 (0.05%) were adaptative, 141 (0.02%) were withdrawal and 99 (0.02%) were N-of-1 (Figure 1).

Figure 1 Distribution of articles on randomized controlled trials published between 1979 and 2018, by methodological design. 

In the search by purpose, 98.2% (463,999) did not specify the purpose. In the remainder, there were 3,985 (0.84%) articles on superiority, 1,850 (0.39%) on noninferiority and 1,716 (0.36%) on equivalence randomized controlled trials (Figure 2). The distribution by five-year periods of the types of randomized controlled trials according to design and purpose may be found in Tables 1 and 2.

Figure 2 Distribution of articles on randomized controlled trials published between 1979 and 2018, by purpose. 

Table 1 Frequencies of types of randomized controlled trials published, by five-year period (by design). 

Table 2 Frequencies of types of randomized controlled trials published by five-year group (by purpose). 

Figures 3 and 4 show the publication tendency of the different clinical trial variants throughout the years, separated by five-year periods.

Figure 3 Tendency, by five-year period, of articles on randomized controlled trials published between 1979 and 2018, classified by methodological design. Period 1 (1979- 1983), Period 2 (1984-1988), Period 3 (1989-1993), Period 4 (1994-1998), Period 5 (1999-2003), Period 6 (2004-2008), Period 7 (2009-2013), Period 8 (2014-2018). 

Figure 4 Tendency, by five-year period, of articles on randomized controlled trials published between 1979 and 2018, classified by purpose. Period 1 (1979-1983), Period 2 (1984-1988), Period 3 (1989-1993), Period 4 (1994-1998), Period 5 (1999-2003), Period 6 (2004-2008), Period 7 (2009-2013), Period 8 (2014-2018). 

The proportion of published articles identified by the ran domized controlled trial variant in their title or abstract following the launching of CONSORT and its respective extensions increased for parallel group, N-of-1, paired, and pragmatic designs, and for the purpose of noninferiority, but decreased for equivalence. These were statistically significant changes in all cases except for N-of-1 and equivalence (Table 3).

Table 3 Difference in proportions in the pattern of publication before and after CONSORT. 

The evaluation of overall concordance in data gathering between researchers (MMF and ARNP) found a kappa coef ficient (K) of 0.88 95% CI (0.82-0.95), which indicates a very good performance according to Cohen's criteria 21,22).

Discussion

Throughout the 40 years of publications reviewed in PubMed, we found that more than 90% of the articles did not report the type of clinical trial presented, nor its pur pose, in the title or abstract. However, we found a slight, but statistically significant, increase in the rate of reporting these characteristics in the years following the launching of CONSORT and its extensions. This indicates that the guide lines for publishing clinical trials dictated by CONSORT are beginning to be adopted by the scientific community, although, as has been shown in previous studies, an adequate adherence has not been achieved 16-18,20.

On the other hand, a surprising finding is that most of the articles that reported their classification were cross over studies. The predominant design was expected to be parallel groups, since this was the initial model, although the cross over design is known to be used more in basic sciences than in clinical sciences 3. However, one possibility is that most of the unclassified articles are parallel group designs, which, being the baseline model for the other designs, is assumed to be the design when an alternative is not specified.

As expected, the publication tendency of all randomized controlled trials increased progressively over the years. A greater variety in these studies was introduced around 1990, with a growing report of cluster, N-of-1, paired, adaptive, withdrawal, pragmatic and factorial studies. Prior to this date, only cross over and parallel group variants were re ported as such.

Superiority clinical trials continue to increase over time and account for most of the articles that report their purpose. The articles on noninferiority randomized controlled trials appeared around the year 2000, and they are also increas ingly reported, while equivalence studies have tended to stabilize since then.

Study weaknesses include the fact that the complete text of the articles was not reviewed, and only one bibliographic database was consulted. However, PubMed is the most important bibliographic database worldwide. In addition, duplicates were not controlled for, and thus the actual number of randomized controlled trials is probably over estimated. However, with the existing tools for identifying duplicate publications, this occurs less and less frequently, and it does not justify the lack of adherence to CONSORT found. Publications without an English abstract were not considered either, since they could not be analyzed by the researchers. However, these currently represent a minority of the studies. As a strength, few publications like this one were found. One of the most important of these is the 2012 Cochrane review 16 which evaluated the effect of adherence to CONSORT on the completeness of clinical trial reports, and whose conclusion was that the quality of reporting did improve in journals which adopted CONSORT. The review by Susvirkar et al. in 2018 18 evaluated the adherence of clinical trial articles published in two high-impact journals (the Journal of the American Medical Association and the British Medical Journal) to the CONSORT guidelines, which, although close to 80%, showed poor adherence to identification of the article as a clinical trial in the title and a description of its design, among others.

No articles were found evaluating the publication of clinical trials by type of design, and therefore this could be a starting point for new studies on the topic, as well as serve to incentivize adherence to the CONSORT recommendations, improving the quality of scientific production.

References

1. Friedman LM, Furberg CD, Demets DL, Reboussin DM, Granger CB. Intro duction to Clinical Trials. En: Fundamentals of Clinical Trials. 5th ed. Springer; 2015. p. 2. [ Links ]

2. Lilienfeld A. CETERIS PARIBUS. The evolution of the clinical trial. Bull Hist Med. 1982;56:1-18. [ Links ]

3. Argimon Pallás JM, Jiménez Villa J. Estudios experimentales I: el ensayo clínico aleatorio. En: Métodos de investigación clínica y epidemiológica. 4a ed. Barcelona: Elsevier España; 2013. p. 33-48. [ Links ]

4. Friedman LM, Furberg CD, Demets DL. Basic study design. En: Fundamentals of Clinical Trials. 5th ed. Springer; 2015. p. 89-121. [ Links ]

5. Argimon Pallás JM, Jiménez Villa J. Estudios experimentales II: otros diseños. En: Métodos de investigación clínica y epidemiológica. 4a ed. Barcelona: Elsevier España ; 2013. p. 49-63. [ Links ]

6. Guyatt G, Rennie D, Meade M, Cook D. Advanced topics in the validity of therapy trials: N-of-1 randomized controlled trials. En: Association AM, editor. Users' Guides to the Medical Literature, A Manual for Evidence-Based Clinical Practice. 2nd ed. Mc-Graw Hill; 2008. p. 179-92. [ Links ]

7. Pandis N, Chung B, Scherer RW, Elbourne D, Altman DG. CONSORT 2010 statement: extension checklist for reporting within person randomised trials. BMJ. 2017;180(3):j2835. [ Links ]

8. Mistry P, Dunn JA, Marshall A. A literature review of applied adaptive design methodology within the field of oncology in randomised controlled trials and a proposed extension to the CONSORT guidelines. BMC Med Res Methodol. 2017;17(1):1-9. [ Links ]

9. Zwarentein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: An extension of the CONSORT statement. J Chinese Integr Med. 2009;7(4):392-7. [ Links ]

10. Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 23 de marzo de 2010;340(mar23 1):c332-c332. [ Links ]

11. Marion KC, Diana RE, Douglas GA. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328. [ Links ]

12. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: Extension to cluster randomised trials. BMJ. 2012;345(7881):1-21. [ Links ]

13. Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJW. CONSORT Group for the. Reporting of Noninferiority and Equivalence Randomized Trials. JAMA. 8 de marzo de 2006;295(10):1152. [ Links ]

14. Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJW. Reporting of noninferiority and equivalence randomized trials (for the CONSORT Group). J Am Med Assoc. 2012;308(24):2594-604. [ Links ]

15. Vohra S, Shamseer L, Sampson M, Bukutu C, Schmid CH, Tate R, et al. CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement. BMJ. 14 de mayo de 2015;350(may14 17):h1738-h1738. [ Links ]

16. Turner, L., Shamseer, L., Altman, D. G., Schulz, K. F., & Moher, D. Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane reviews. Systematic Reviews, 1(1), 60. https://doi.org/10.1186/2046-4053-1-60Links ]

17. Jin, Y., Sanger, N., Shams, I., Luo, C., Shahid, H., Samaan, Z. Does the medical literature remain inadequately described despite having reporting guidelines for 21 years?-A systematic review of reviews: an update. Journal of Multidisciplinary Healthcare, Volume 11, 495-510. https://doi.org/10.2147/JMDH.S155103Links ]

18. Susvirkar, A., Gada, P., Figer, B., Thaker, S., Thatte, U., & Gogtay, N. An as sessment of the compliance of randomized controlled trials published in two high impact journals with the CONSORT statement. The National Medical Journal of India, 31(2), 79. https://doi.org/10.4103/0970-258X.253165Links ]

19. Lazcano-Ponce E, Salazar-Martínez E, Gutiérrez-Castrellón P, et al. Ensayos clínicos aleatorizados: variantes, métodos de aleatorización, análisis, considera ciones éticas y regulación. salud publica mex. 2004;46(6):559-584. [ Links ]

20. Reveiz Ludovic, Villanueva Eleana, Iko Chimaraoke, Simera Iveta. Compliance with clinical trial registration and reporting guidelines by Latin American and Caribbean journals. Cad. Saúde Pública [Internet]. 2013 June [cited 2020 Nov 03]; 29( 6 ): 1095-1100. Available from: Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2013000600006&lng=en . Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2013000600006&lng=en. https://doi.org/10.1590/S0102-311X2013000600006 . [ Links ]

21. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960; 20: 37-46. https://doi.org/10.1177/2F001316446002000104Links ]

22. Manterola Carlos, Grande Luis, Otzen Tamara, García Nayely, Salazar Paulina, Quiroz Guissela. Confiabilidad, precisión o reproducibilidad de las mediciones. Métodos de valoración, utilidad y aplicaciones en la prác tica clínica. Rev. chil. infectol. [Internet]. 2018 [citado 2020 Nov 03] ; 35(6): 680-688. Disponible en: Disponible en: https://scielo.conicyt.cl/scielo.php?script=sci_arttext&pid=S0716-10182018000600680&lng=es . Disponible en: https://scielo.conicyt.cl/scielo.php?script=sci_arttext&pid=S0716-10182018000600680&lng=es. http://dx.doi.org/10.4067/S0716-10182018000600680 . [ Links ]

23. Epidat: programa para análisis epidemiológico de datos. Versión 4.2, julio 2016. Consellería de Sanidade, Xunta de Galicia, España; Organización Panamericana de la salud (OPS-OMS); Universidad CES, Colombia. [ Links ]

Annex 1. Search strategy.

Supplementary material

  • Randomized controlled trial: randomized controlled trial, Alter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Parallel groups: parallel group[Title/Abstract], filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Cluster: cluster randomised[Title/Abstract] Alter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Cross over: filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • N-of-1: n of 1[Title/Abstract], filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Factorial: factorial trial[Title/Abstract] OR factorial study[Title/Abstract] OR factorial design[Title/ Abstract] OR factorial randomised[Title/Abstract], filter: Randomized Controlled Trial, Date of publication from 1979/01/01 to 2018/12/31.

  • Paired: "Within person design"[Title/Abstract] OR "Within person trial"[Title/Abstract] OR "Split-mouth design"[Title/Abstract] OR "Split-mouth trial"[Title/Abstract] OR "Split-face design"[Title/ Abstract] OR "Split-face trial"[Title/Abstract] OR "Split-body design"[Title/Abstract] OR "Split-body trial"[Title/Abstract] OR "Contralateral design"[Title/Abstract] OR "Contralateral trial"[Title/ Abstract] OR "Matched pair design"[Title/Abstract] OR "Matched pair trial"[Title/Abstract] OR "Pair-matching design"[Title/Abstract] OR "Pair-matching trial"[Title/Abstract] OR "Randomized paired design"[Title/Abstract] OR "Randomized paired trial"[Title/Abstract] OR "randomised paired design"[Title/Abstract] OR "randomised paired trial"[Title/Abstract] OR "Within person study"[Title/Abstract] OR "Within person studies"[Title/Abstract] OR "Split-mouth study"[Title/ Abstract] OR "Split-mouth studies"[Title/Abstract] OR "Split-face study"[Title/Abstract] OR "Split-face studies"[Title/Abstract] OR "Split-body study"[Title/Abstract] OR "Split-body studies"[Title/ Abstract] OR "Contralateral study"[Title/Abstract] OR "Contralateral studies"[Title/Abstract] OR "Matched pair study"[Title/Abstract] OR "Matched pair studies"[Title/Abstract] OR "Pair-matching study"[Title/Abstract] OR "Pair-matching studies"[Title/Abstract] OR "Randomized paired study"[Title/Abstract] OR "Randomized paired study"[Title/Abstract] OR "randomised paired studies"[Title/Abstract] OR "randomised paired studies"[Title/Abstract]; filter: Random ized Controlled Trial, Publication date from de 1979/01/01 to 2018/12/31.

  • Withdrawal: withdrawal study[Title/Abstract] OR withdrawal trial[Title/Abstract] OR withdrawal design[Title/Abstract] filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Adaptive: adaptive randomised[Title/Abstract] OR adaptive trial[Title/Abstract] OR adaptive study[Title/Abstract] OR adaptive design[Title/Abstract]; filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Pragmatic: pragmatic trial[Title/Abstract] OR pragmatic randomised[Title/Abstract] OR prag matic study[Title/Abstract] OR pragmatic design[Title/Abstract]; filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Superiority: superiority[Title/Abstract]; filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Noninferiority: noninferiority[Title/Abstract]; filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

  • Equivalence: equivalence[Title/Abstract]; filter: Randomized Controlled Trial, Publication date from 1979/01/01 to 2018/12/31.

Received: May 19, 2020; Accepted: December 09, 2020

* Correspondencia: Dra. Mariana Martínez- Franco. Medellín (Colombia). E-Mail: mariana.martinezf@udea.edu.co

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License