SciELO - Scientific Electronic Library Online

 
vol.50 issue3Polypharmacy among HIV infected people aged 50 years or older author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Colombia Médica

On-line version ISSN 1657-9534

Colomb. Med. vol.50 no.3 Cali July/Sept. 2019

https://doi.org/10.25100/cm.v50i3.4259 

Editorial

The quality of research with real-world evidence

Mauricio Palacios1 

1 Editor en Jefe, Revista Colombia Médica, Universidad del Valle. Cali, Colombia.


Most of the medical practice has not been proven by controlled clinical trials, and there are no plans to conduct such trials in order to decrease clinician uncertainty. This happens partly due to the difficulty of making designs with scientific and ethical validity, the costs of this type of research and the time required to generate results, which can be several years. Clinical trials do not have the capability to generate evidence that allows to make decisions in some sectors of clinical care and public health, such as when an epidemic occurs. Therefore, medical science is based on observational studies, past practices and therapeutic tradition 1.

Observation of clinical data that have defined a clinical behavior precedes the clinical trial. The knowledge about scurvy, the fact that this pathology is considered a nutritional deficiency and its treatment with citrus fruits, originated thanks to the collection of clinical data on sailors, soldiers and prisoners of the British Crown in the 18th and 19th centuries 2. This clinical evidence, which was collected uniformly and served to produce new knowledge, is what is now known as Real World Data (RWD). A modern definition of RWD would be one that talks about data obtained by any non-interventionist methodology that is collected prospectively and retrospectively from observations of routine clinical practice, and which comes from various sources including data from patients, doctors, hospitals, payers, social data, etc 3.

Although the leading role of RWD was replaced in the mid-20th century by the controlled clinical trial that offered greater scientific rigidity, in recent decades RWD have regained vigour due to technology that allows the storage and retrieval of large volumes of information about many of aspects of clinical care.

The current contribution to this way of acquiring knowledge is the evaluation method called Real Word Evidence (RWE). The RWE is the compilation of all the evidence routinely collected on patients from clinical systems into an understandable and homogeneously analysable data set (big data) facilitated by the technology, which reflects the reality of treatment in the best possible and comparable way 4. RWE is derived from the RWD analysis.

The progression of the contribution of RWE research has been greater in areas of epidemiological surveillance, that collects real-time evidence on emerging diseases 5, and in pharmacovigilance, that uses it to monitor and quantify adverse drug and therapeutic effects 6. The use of RWE is now proposed to approve therapeutic indications for medications 7, and the use of this information in single-arm clinical trials to define drug efficacy in orphan diseases has recently been accepted 8,9.

The greatest strength of RWE studies is their external validity. Despite including controlled clinical trials to make their recommendations, 44% of Cochrane Reviews concluded that "the evidence is insufficient for clinical practice" 10. This happens because clinical trials only represent small, homogeneous populations and are not generalizable to most of the study population 11.

Producing quality RWE research requires an adequate design that takes into account the major limitations of observational studies: confounding, selection, and information biases, especially when seeking causality 7,12. The design and planning of RWE studies are essential to produce science, because the large amount of information that these databases have can overwhelm the researcher and make them believe that they are contributing scientifically when they are not contributing new knowledge 13.

The editor's mission in RWE research evaluations is to achieve the principles of the scientific process: discovery, transparency, and replicability 14,15. To guarantee the rigor and methodological transparency that supports the research with databases, the RECORD (Reporting of studies Conducted using Observational Routinely-collected health Data) and RECORD-PE (pharmacovigilance) guides were created, which are an expansion of the STROBE guidelines that take into account specific problems of research results using routinely collected health data 15,16. The purpose of these guidelines is to promote the quality of RWD sources and RWE studies publications, so that the findings of these investigations are taken into account in clinical practice, systematic reviews and evaluations of health technologies 17. As their authors warn, these are guidelines for the presentation of scientific reports and should not be taken as guidelines for designing research with RWD.

Colombia Médica adheres to the RECORD and RECORD-PE statements in the journal's instructions and will encourage the use of these resources by our authors, peer reviewers and associate editors, with the conviction of publishing the best version of their manuscripts.

The publication of these guides is a great help to publishers due to the growing demand for RWE research publication requests. But it's not enough; the ethical evaluation of these investigations also requires that the ethics committees evolve, because the analyses cannot be considered from the point of view of ethics in traditional research. The right to autonomy is very difficult to protect and if great efforts are made to avoid traceability, the quality of data will be affected. Transparency should emerge as an important value in researchers, both in the clarity of the elaboration of the research question (especially in exploratory studies) and in the availability of data to be reviewed by other researchers 18.

References

1. Frieden TR. Evidence for Health Decision Making - Beyond Randomized, Controlled Trials. Drazen JM, Harrington DP, McMurray JJV, Ware JH, Woodcock J, editors. N Engl J Med. 2017; 377(5):465-75. Doi: 10.1056/NEJMra1614394. [ Links ]

2. Harrison M. Scurvy on sea and land: Political economy and natural history, c. 1780-c. 1850. J Marit Res. 2013;15(1):7-25. [ Links ]

3. Makady A, de Boer A, Hillege H, Klungel O, Goettsch W. What is real-world data? A review of definitions based on literature and stakeholder interviews. Value Health. 2017; 20(7):858-65. doi: 10.1016/j.jval.2017.03.008. [ Links ]

4. Maissenhaelter BE, Woolmore AL, Schlag PM. Real-world evidence research based on big data: Motivation-challenges-success factors. Onkologe (Berl). 2018;24(Suppl 2):91-98. doi: 10.1007/s00761-018-0358-3. [ Links ]

5. Briere JB, Bowrin K, Taieb V, Millier A, Toumi M, Coleman C. Meta-analyses using real-world data to generate clinical and epidemiological evidence: a systematic literature review of existing recommendations. Curr Med Res Opin. 2018; 34(12):2125-2130. doi: 10.1080/03007995.2018.1524751. [ Links ]

6. Moore N, Blin P, Droz C. Pharmacoepidemiology. In: Handbook of Experimental Pharmacology. Springer; 2019. p. 433-51. [ Links ]

7. Yuan H, Ali MS, Brouwer ES, Girman CJ, Guo JJ, Lund JL, et al. Real-world evidence: what it is and what it can tell us according to the international society for pharmacoepidemiology (ISPE) comparative effectiveness research (CER) special interest group (SIG). Clin Pharmacol Ther. 2018;104(2):239-241. doi: 10.1002/cpt.1086. [ Links ]

8. Lee D, Brereton N, Dhanasiri S, Kulasekararaj A. The role of real-world evidence in UK reimbursement: case study of lenalidomide in myelodysplastic syndrome deletion 5q. Pharmacocon Open. 2019; 3(3):351-358. doi: 10.1007/s41669-018-0110-3. [ Links ]

9. Schuller Y, Biegstraaten M, Hollak CEM, Klümpen HJ, Gispen-De Wied CC, Stoyanova-Beninska V. Oncologic orphan drugs approved in the EU - Do clinical trial data correspond with real-world effectiveness? Orphanet J Rare Dis. 2018; 13(1):214. doi: 10.1186/s13023-018-0900-9. [ Links ]

10. Villas Boas PJF, Spagnuolo RS, Kamegasawa A, Braz LG, Polachini Do Valle A, Jorge EC, et al. Systematic reviews showed insufficient evidence for clinical practice in 2004: What about in 2011? the next appeal for the evidence-based medicine age. J Eval Clin Pract. 2013; 19(4): 633-7. doi: 10.1111/j.1365-2753.2012.01877.x. [ Links ]

11. Courtright K. POINT: Do randomized controlled trials ignore needed patient populations? Yes. Chest. 2016; 149(5):1128-30. doi: 10.1016/j.chest.2016.01.029. [ Links ]

12. Schneeweiss S. Learning from big health care data. N Engl J Med. 2014; 370(23):2161-3. doi: 10.1056/NEJMp1401111. [ Links ]

13. Khosla S, White R, Medina J, Ouwens M, Emmas C, Koder T, et al. Real world evidence (RWE) - a disruptive innovation or the quiet evolution of medical evidence generation? F1000Research. 2018; 7: 111. doi: 10.12688/f1000research.13585.2. [ Links ]

14. Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014; 383(9913):267-76. doi: 10.1016/S0140-6736(13)62228-X. [ Links ]

15. Benchimol EI, Smeeth L, Guttmann A, Harron K, Moher D, Peteresen I, et al. The reporting of studies conducted using observational routinely-collected health data (RECORD) Statement. PLoS Med. 2015;12(10): e1001885. doi: 10.1371/journal.pmed.1001885. [ Links ]

16. Langan SM, Schmidt SA, Wing K, Ehrenstein V, Nicholls SG, Filion KB, et al. The reporting of studies conducted using observational routinely collected health data statement for pharmacoepidemiology (RECORD-PE). BMJ. 2018; 363: k3532. Doi: 10.1136/bmj.k3532 [ Links ]

17. Oehrlein EM, Graff JS, Perfetto EM, Mullins CD, Dubois RW, Anyanwu C, et al. Peer-reviewed journal editors' views on real-world evidence. Int J Technol Assess Health Care. 2018; 34(1):111-9. doi: 10.1017/S0266462317004408. [ Links ]

18. Lipworth W, Mason PH, Kerridge I, Ioannidis JPA. Ethics and epistemology in big data research. J Bioeth Inq. 2017; 14(4):489-500. doi: 10.1007/s11673-017-9771-3. [ Links ]

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License