Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines
Abstract
Transparent reporting of animal studies is key to ensure reproducibility. The primary guideline for
reporting animal studies is the ARRIVE (Animal Research: Reporting of In Vivo Experiments). We aimed to evaluate
the compliance to the updated ARRIVE guidelines (version 2.0, date 2020) in animal studies published in journals
indexed by the Turkish Academic Network and Information Centre (ULAKBIM TR Index). This was a retrospective
analysis of reporting quality of animal studies published in journals listed in ULAKBIM TR Index between January 2010
and August 2021. The percentage of articles that fully reported each " of the ARRIVE Essential 10: Compliance
Questionnaire was calculated, and effects of journal- and article-related factors were evaluated. Totally, 235 articles
published in 89 journals were included into the analysis. The mean percentage of fully reported items was 59.1%±10.9%,
the least reported items being those related with bias— “blinding”, “allocation to study groups”, “assessment of
statistical assumptions”, “excluded animals”, and “sample size calculation” (0.9%-10.6%). The journal’s publisher,
frequency, language, being indexed in the Science Citation Index Expanded, and the ratio of animal studies had no
significant effect on this percentage (p>0.05). However, journals supporting the ARRIVE guidelines had significantly
higher compliance (62.1%±10.1% vs. 58.2%±11.0% for supporters and non-supporters, respectively; p=0.017, 95%CI -7.0
to -0.7). Articles published after 2015 had higher compliance to the ARRIVE guidelines than those published previously
(60.9%±10.4% vs. 57.9%±11.1%, respectively; p=0.037, 95%CI -5.8 to -0.2). Although progress has been made, compliance
to the ARRIVE guidelines is still low in animal studies published in journals listed in ULAKBIM TR Index—Turkey's
scientific journal database that covers over 800 peer-review journals. In order to increase the reporting quality and
reproducibility of animal studies, it is imperative to raise awareness among researchers and journals, and to enforce the
ARRIVE guidelines in editorial policy of journals.
Keywords
Bibliographic database experimental animal model ethics guideline adherence journal article
References
- [1] Lewis DI. Animal experimentation: implementation and application of the 3Rs. Emerg Top Life Sci. 2019; 3(6): 675 679. [crossref]
- [2] McGonigle P, Ruggeri B. Animal models of human disease: challenges in enabling translation. Biochem Pharmacol. 2014; 87(1):162-171. [crossref]
- [3] Akhtar A. The flaws and human harms of animal experimentation. Camb Q Healthc Ethics. 2015; 24(4): 407-419. [crossref]
- [4] Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol. 2010; 8(6): e1000412. [crossref]
- [5] Percie du Sert N, Hurst V, Ahluwalia A, Alam S, Avey MT, Baker M, Browne WJ, Clark A, Cuthill IC, Dirnagl U, Emerson M, Garner P, Holgate ST, Howells DW, Karp NA, Lazic SE, Lidster K, MacCallum CJ, Macleod M, Pearl EJ, Petersen OH, Rawle F, Reynolds P, Rooney K, Sena ES, Silberberg SD, Steckler T, Würbel H. The ARRIVE guidelines 2.0: updated guidelines for reporting animal research. J Physiol. 2020; 598(18): 3793-3801. [crossref]
- [6] Delgado-Ruiz RA, Calvo-Guirado JL, Romanos GE. Critical size defects for bone regeneration experiments in rabbit calvariae: systematic review and quality evaluation using ARRIVE guidelines. Clin Oral Implants Res. 2015; 26(8): 915-930. [crossref]
- [7] Leung V, Rousseau-Blass F, Beauchamp G, Pang DSJ. ARRIVE has not ARRIVEd: Support for the ARRIVE (Animal Research: Reporting of in vivo Experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia. PLoS One. 2018; 13(5): e0197882.
- [8]Enserink, M. Sloppy reporting on animal studies proves hard to change. Science 2017; 357: 1337–1338. [crossref]
- [9] Gosselin RD. Insufficient transparency of statistical reporting in preclinical research: a scoping review. Sci Rep. 2021; 11(1): 3335. [crossref]
- [10] Zhao B, Jiang Y, Zhang T, Shang Z, Zhang W, Hu K, Chen F, Mei F, Gao Q, Zhao L, Kwong JSW, Ma B. Quality of interventional animal experiments in Chinese journals: compliance with ARRIVE guidelines. BMC Vet Res. 2020; 16(1): 460. [crossref]
- [11] Liu Y, Zhao X, Mai Y, Li X, Wang J, Chen L, Mu J, Jin G, Gou H, Sun W, Feng Y. Liu Y, et al. Adherence to ARRIVE Guidelines in Chinese Journal Reports on Neoplasms in Animals. PLoS One. 2016; 11(5): e0154657. [crossref]
- [12] Gupta SK. A study to assess the methodological quality of in vivo animal experiments published in Indian journal of pharmacology: A retrospective, cross-sectional, observational study. Indian J Pharmacol. 2019; 51(1): 11-16. [crossref]
- [13] Bezdjian A, Klis SFL, Peters JPM, Grolman W, Stegeman I. Quality of reporting of otorhinolaryngology articles using animal models with the ARRIVE statement. Lab Anim. 2018; 52(1): 79-87. [crossref]
- [14] Nam MH, Chun MS, Seong JK, Kim HG. Ensuring reproducibility and ethics in animal experiments reporting in Korea using the ARRIVE guideline. Lab Anim Res. 2018; 34(1): 11-19. [crossref]
- [15] The Turkish Academic Network and Information Centre (ULAKBIM). https://ulakbim.tubitak.gov.tr/en (accessed Sep 01, 2021).
- [16] TR Index: Bibliographic / full text database containing articles in the fields of Science and Social Sciences developed by TUBITAK ULAKBIM. https://trdizin.gov.tr/en/home/ (accessed Sep 01, 2021).
- [17] Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EW, Crystal RG, Darnell RB, Ferrante RJ, Fillit H, Finkelstein R, Fisher M, Gendelman HE, Golub RM, Goudreau JL, Gross RA, Gubitz AK, Hesterlee SE, Howells DW, Huguenard J, Kelner K, Koroshetz W, Krainc D, Lazic SE, Levine MS, Macleod MR, McCall JM, Moxley RT 3rd, Narasimhan K, Noble LJ, Perrin S, Porter JD, Steward O, Unger E, Utz U, Silberberg SD. A call for transparent reporting to optimize the predictive value of preclinical research. Nature. 2012; 490(7419): 187-191. [crossref]
- [18] Ormandy EH, Weary DM, Cvek K, Fisher M, Herrmann K, Hobson-West P, McDonald M, Milsom W, Rose M, Rowan A, Zurlo J, von Keyserlingk MAG. Animal Research, Accountability, Openness and Public Engagement: Report from an International Expert Forum. Animals (Basel). 2019; 9(9): 622. [crossref]
- [19] Alemán-Laporte J, Alvarado G, Sa Garcia-Gomes M, Fonseca Brasil Antiorio AT, Zúñiga-Montero M, Cabrera Mori CM. Quality of Adherence to the ARRIVE Guidelines in the Material and Methods Section in Studies Where Swine Were Used as Surgical Biomodels: A Systematic Review (2013-2018). Animals (Basel). 2019; 9(11): 947. [crossref]
- [20] Jasińska-Stroschein M, Orszulak-Michalak D. Reporting experimental studies on animals - The problems with translating of outcomes to clinical benefits. Methodological and statistical considerations: The example of pulmonary hypertension. Eur J Pharmacol. 2021; 897: 173952. [crossref]
- [21] Ting KH, Hill CL, Whittle SL. Quality of reporting of interventional animal studies in rheumatology: a systematic review using the ARRIVE guidelines. Int J Rheum Dis. 2015; 18(5): 488-494. [crossref]
- [22] Gulin JE, Rocco DM, García-Bournissen F. Quality of Reporting and Adherence to ARRIVE Guidelines in Animal Studies for Chagas Disease Preclinical Drug Research: A Systematic Review. PLoS Negl Trop Dis. 2015; 9(11): e0004194. [crossref]
- [23] Avey MT, Moher D, Sullivan KJ, Fergusson D, Griffin G, Grimshaw JM, Hutton B, Lalu MM, Macleod M, Marshall J, Mei SH, Rudnicki M, Stewart DJ, Turgeon AF, McIntyre L; Canadian Critical Care Translational Biology Group. The Devil Is in the Details: Incomplete Reporting in Preclinical Animal Research. PLoS One. 2016; 11(11): e0166733. [crossref]
- [24] Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Int J Surg. 2021; 88: 105906. [crossref]
- [25] Information Note on Ethics Committee Approval, 2020 The Scienific and Technologıcal Research Council of Turkey (TUBITAK) [online]. https://tubitak.gov.tr/sites/default/files/20689/ekbn_2020.pdf (accessed Sep 01, 2021).
Details
| Primary Language | English |
|---|---|
| Subjects | Medical Pharmacology |
| Journal Section | Reviews |
| Authors | |
| Publication Date | June 28, 2025 |
| Published in Issue | Year 2022 Volume: 26 Issue: 4 |