Research Article
BibTex RIS Cite

Adaptation of Joanna Briggs Institute (JBI) Critical Appraisal Tools for Cohort and Case-Control Study Checklists into Turkish

Year 2023, Volume: 13 Issue: 3, 359 - 366, 15.01.2024
https://doi.org/10.53478/yuksekogretim.1190017

Abstract

In a systematic review, evaluating the methodological quality of the studies to be included is essential. This study aims to adapt the Joanna Briggs Institute (JBI) Critical Appraisal Tools, Checklists for Cohort and Case-Control Studies into Turkish to assess the quality of studies in cohort and case-control research design. The study examined the language equivalence of the Checklists for the JBI Cohort and Case- Control Studies through back-translation. Their content validity was analyzed by expert opinions, and their reliability was examined through inter-rater reliability analysis. The content validity index (CVI) was used to evaluate the expert opinions. Reliability was evaluated by Kappa analysis. The relationship between the evaluators was examined using the Spearman Correlation analysis. Expert evaluations revealed CVI=0.930 for cohort studies and CVI=0.942 for case-control studies. The Kappa value was 0.478 for cohort studies and 0.619 for case-control studies. The relationship between evaluators was calculated as r=.802 for cohort studies and r=.753 (p<.005) for case-control studies. It was determined that the Turkish version of the “JBI Critical Appraisal Checklist for Cohort and Case- Control Studies” is a valid tool that can be used to evaluate the quality of studies with cohort and case-control research design.

References

  • Akgül, A. (2005). Tıbbi araştırmalarda istatistiksel analiz teknikleri- spss uygulamaları. Emek Yayınları.
  • Alpar, R. (2014). Spor, sağlık ve eğitim bilimlerinden örneklerle uygulamalı istatistik ve geçerlik-güvenirlik-spss’de çözümleme adımları ile birlikte. Detay Yayıncılık.
  • Aromataris, E., & Munn, Z. (Eds). (2020). JBI manual for evidence synthesis. JBI, https://doi.org/10.46658/JBIMES-20-01.
  • Barker, T.H., Stone, J. C., Sears, K., Klugar, M., Leonardi-Bee, J., Tufanaru, C., Aromataris, E., & Munn, Z. (2023). Revising the JBI quantitative critical appraisal tools to improve their applicability: an overview of methods and the development process. JBI Evidence Synthesis, 21(3), 478-493. https:// doi.10.11124/jbıes-22-00125.
  • Baş, T. (2006). Anket nasıl hazırlanır, uygulanır, değerlendirilir. Seçkin Yayıncılık.
  • Boland, A., Cherry, M.G., Dickson, R. (2017). “Doing a systematic review: A student’s guide 2013”, SAGE.
  • Boutron, I., Page, M.J., Higgins, J.P.T., Altman, D.G., Lundh, A., Hróbjartsson, A. (2021). Chapter 7: Considering bias and conflicts of interest among the included studies. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (Eds). Cochrane handbook for systematic reviews of ınterventions version 6.2 (updated February 2021). Cochrane.
  • Bown, M.J., & Sutton, A.J. (2010). Quality control in systematic reviews and meta-analyses. European Journal of Vascular and Endovascular Surgery, 40(5),669-677. https://doi:10.1016/j.ejvs.2010.07.011
  • Buccheri, R.K., & Sharifi, C. (2017). Critical appraisal tools and reporting guidelines for evidence-based practice. Worldviews on Evidence-Based Nursing, 14(6),463–472. https://doi.org/10.1111/ wvn.12258
  • Capili, B., & Anastasi, J. (2021). Cohort studies. AJN, The American Journal of Nursing, 121(12), 45-48. https://doi.org/10.1097/01. naj.0000803196.49507.08
  • Dol, J., Hughes, B., Bonet, M., Dorey, R., Dorling, J., Grant, A., Langlois, E.V., Monaghan, J., Ollivier, R., Parker, R., Roos, N., Scott, H., Shin, H.D., & Curran, J. (2023). Timing of neonatal mortality and severe morbidity during the postnatal period: a systematic review. JBI Evidence Synthesis, 21(1), 98. https:// doi.10.11124/JBIES-21-00479
  • Ergin, E., & Akın, B. (2018). The Turkish adaptation of a quality assessment tool for quantitative studies: validity and reliability analyses. Türkiye Klinikleri Journal of Nursing Sciences, 10(4),292- 308.
  • Farrah, K., Young, K., Tunis, M.C., Zhao, L.(2019). Risk of bias tools in systematic reviews of health interventions: an analysis of PROSPERO-registered protocols. Systematic reviews, 8(1), 280. https://doi.org/10.1186/s13643-019-1172-8
  • Higgins, J., & Altman, D.G. (2011). Chapter 8: Assessing risk of bias in included studies. In: Higgins J, Green S, (Eds). Cochrane Handbook for Systematic Reviews of Inter-ventions Version 5.0. The Cochrane Collaboration.
  • Holopainen, A., & Hakulinen, T. (2019). New parents’ experiences of postpartum depression: A systematic review of qualitative evidence. JBI Evidence Synthesis, 17(9), 1731-1769. https:// doi.10.11124/JBISRIR-2017-003909
  • Hur, G., Cinar, N., Suzan, O.K. (2022). Impact of COVID-19 pandemic on nurses’ burnout and related factors: A rapid systematic review. Archives of Psychiatric Nursing, 41, 248-263. https://doi.org/10.26650/JARHS2022-1100929
  • Hür, G., Zengin, H., Karakaya Suzan, Ö., Kolukısa, T., Eroğlu, A., Çınar N. (2022). Joanna Briggs Enstitüsü (JBI) randomize kontrollü çalışmalar için kalite değerlendirme aracı’nın türkçe’ye uyarlanması. Sağlık Bilimlerinde İleri Araştırmalar Dergisi, 5,112- 117. https://doi.org/10.26650/JARHS2022-1100929
  • Jarde, A., Losilla, J.M., Vives, J., Rodrigo, M.F. (2013). Q-Coh: A tool to screen the methodological quality of cohort studies in systematic reviews and meta-analysis. International Journal of Clinical and Health Psychology, 13(2),138-146. https://doi. org/10.1016/S1697-2600(13)70017-6
  • Jeffs, E., Ream, E., Taylor, C., Bick, D. (2018). Clinical effectiveness of decongestive treatments on excess arm volume and patientcentered outcomes in women with early breast cancerrelated arm lymphedema: a systematic review. JBI database of systematic reviews and implementation reports, 16(2), 453. https:// doi.10.11124/JBISRIR-2016-003185
  • The Joanna Briggs Institute (JBI). Critical Appraisal Tools. https://jbi. global/critical-appraisal-tools (15 Mayıs 2022)
  • Katrak, P., Bialocerkowski, A.E., Massy-Westropp, N., Kumar, S., Grimmer, K.A.(2004). A systematic review of the content of critical appraisal tools. BMC Medical Research Methodology, (4),22. https://doi.org/10.1186/1471-2288-4-22
  • Keeler, C., & Curtis, A.C. (2022). Case-control studies. The American Journal of Nursing, 122(2),51–56. https://doi.org/10.1097/01. NAJ.0000820584.29051.80
  • Kılıç, S. (2015). Kappa test. Psychiatry and Behavioral Sciences, 5(3), 142-144.
  • Moola, S., Munn, Z., Tufanaru, C., Aromataris, E., Sears, K., Sfetcu, R., et al. (2020). Chapter 7: Systematicreviews of etiology and risk . In: Aromataris E, Munn Z (Editors). JBI Manual for Evidence Synthesis. JBI. https://jbi-global-wiki.refined.site/ space/MANUAL
  • Munn, Z., Moola, S., Riitano, D., Lisy, K. (2014). The development of a critical appraisal tool for use in systematic reviews addressing questions of prevalence. Int J Health Policy Manag, 3(3),123–128. https://doi.org/10.15171/ijhpm.2014.71
  • Munn, Z., Stone, J. C., Aromataris, E., Klugar, M., Sears, K., Leonardi-Bee, J., & Barker, T. H. (2023). Assessing the risk of bias of quantitative analytical studies: introducing the vision for critical appraisal within JBI systematic reviews. JBI Evidence Synthesis, 21(3), 467-471. https://doi.10.11124/ JBIES-22-00224
  • Nahcivan, N., Seçginli, S. (2017). Sistematik derlemeye dahil edilen nicel araştırmaların metodolojik kalitesi nasıl değerlendirilir. Türkiye Klinikleri Journal of Public Health Nursing-Special Topics, (1), 10-19.
  • Nahcivan, N.O., & İncirkus, K. (2015). Reporting characteristics of systematic and literature reviews published in nursing journals in Turkey. The 2nd International Clinical Nursing Research Congress, Abstract Book, 24-27 June, Istanbul.
  • Pearce, N. (2016). Analysis of matched case-control studies. BMJ, 352. https://doi.org/10.1136/bmj.i969
  • Pölkki, T., Kanste, O., Kääriäinen, M., Elo, S., Kyngäs, H. (2014). The methodological quality of systematic reviews published in highimpact nursing journals: a review of the literature. J Clin Nurs, 23(3-4),315-332.
  • Quigley, J.M., Thompson, J.C., Halfpenny, N.J., Scott, D.A. (2019). Critical appraisal of nonrandomized studies-A review of recommended and commonly used tools. Journal of Evaluation in Clinical Practice 25(1), 44–52. https://doi.org/10.1111/jep.12889
  • Sterne, J.A.C., Hernán, M.A., McAleenan, A., Reeves, B.C., Higgins, J.P.T. (2021). Chapter 25: Assessing risk of bias in a nonrandomized study. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (Eds). Cochrane Handbook for Systematic Reviews of Interventions version 6.2 (updated February 2021).
  • Townshend, K., Jordan, Z., Stephenson, M., & Tsey, K. (2016). The effectiveness of mindful parenting programs in promoting parents’ and children’s wellbeing: a systematic review. JBI Evidence Synthesis, 14(3).139-180. https://doi.10.11124/ JBISRIR-2016-2314
  • Ueki, S., Yamagami, Y., & Makimoto, K. (2019). Effectiveness of vibratory stimulation on needle-related procedural pain in children: a systematic review. JBI Evidence Synthesis, 17(7), 1428- 1463. https://doi.10.11124/JBISRIR-2017-003890
  • Yurdugül, H. (2005). Ölçek Geliştirme Çalışmalarında Kapsam Geçerliği için Kapsam Geçerlik İndekslerinin Kullanılması. Pamukkale Üniversitesi Eğitim Fakültesi, XIV. Ulusal Eğitim Bilimleri Kongresi, 28-30 Eylül Denizli.
  • Zengin, H., Suzan, O.K., Hur, G., Kolukısa,T., Eroglu, A., Cinar, N. (2023). The effects of kangaroo mother care on physiological parameters of premature neonates in neonatal intensive care unit: A systematic review. Journal of Pediatric Nursing, 71, 18-27. Bu

Joanna Briggs Enstitüsü (JBI) Kritik Değerlendirme Araçlarından Kohort ve Vaka Kontrol Çalışmaları için Kontrol Listelerinin Türkçe’ye Uyarlaması

Year 2023, Volume: 13 Issue: 3, 359 - 366, 15.01.2024
https://doi.org/10.53478/yuksekogretim.1190017

Abstract

Sistematik derlemelerde dahil edilen çalışmaların metodolojik kalitesinin değerlendirilmesi önemlidir. Bu çalışma ile Kohort ve vaka kontrol araştırma tasarımındaki çalışmaların kalitesini değerlendirmek için “Joanna Briggs Enstitüsü (JBI) Kritik Değerlendirme Araçlarından Kohort ve Vaka Kontrol Çalışmaları için Kontrol Listelerinin Türkçe’ye Uyarlaması” amaçlanmıştır. JBI Kohort ve Vaka Kontrol Çalışmaları için Kontrol Listeleri’nin dil eşdeğerliği geri-çeviri yöntemi; kapsam geçerliği uzman görüşüne başvurularak; güvenirliği gözlemciler arası güvenirlik ile incelenmiştir. Uzman görüşlerinin değerlendirilmesi için kapsam geçerlik indeksi (KGİ) kullanılmıştır. Güvenilirlik, Kappa analizi ile değerlendirilmiştir. Değerlendiriciler arasındaki ilişki Spearman Korelasyon analizi ile bakılmıştır.Uzman değerlendirmelerine göre kohort çalışmaları için KGİ=0.930, vaka
kontrol çalışmaları için KGİ=0.942 olarak bulunmuştur. Kohort çalışmaları için kappa katsayısı 0.478, vaka kontrol çalışmaları için kappa katsayısı ise 0.619 bulunmuştur. Değerlendiriciler arasındaki ilişki kohort çalışamaları için r=.802, vaka kontrol çalışmaları için ise r=.753 (p<.005) olarak hesaplanmıştır.Türkçe’ye uyarlanan “Kohortve Vaka Kontrol Çalışmaları İçin Kritik Değerlendirme Kontrol Listeleri’nin kohort ve vaka kontrol araştırma tasarımına sahip çalışmaların kalitesini değerlendirmede kullanılabilecek güvenli bir araç olduğu belirlenmiştir.

References

  • Akgül, A. (2005). Tıbbi araştırmalarda istatistiksel analiz teknikleri- spss uygulamaları. Emek Yayınları.
  • Alpar, R. (2014). Spor, sağlık ve eğitim bilimlerinden örneklerle uygulamalı istatistik ve geçerlik-güvenirlik-spss’de çözümleme adımları ile birlikte. Detay Yayıncılık.
  • Aromataris, E., & Munn, Z. (Eds). (2020). JBI manual for evidence synthesis. JBI, https://doi.org/10.46658/JBIMES-20-01.
  • Barker, T.H., Stone, J. C., Sears, K., Klugar, M., Leonardi-Bee, J., Tufanaru, C., Aromataris, E., & Munn, Z. (2023). Revising the JBI quantitative critical appraisal tools to improve their applicability: an overview of methods and the development process. JBI Evidence Synthesis, 21(3), 478-493. https:// doi.10.11124/jbıes-22-00125.
  • Baş, T. (2006). Anket nasıl hazırlanır, uygulanır, değerlendirilir. Seçkin Yayıncılık.
  • Boland, A., Cherry, M.G., Dickson, R. (2017). “Doing a systematic review: A student’s guide 2013”, SAGE.
  • Boutron, I., Page, M.J., Higgins, J.P.T., Altman, D.G., Lundh, A., Hróbjartsson, A. (2021). Chapter 7: Considering bias and conflicts of interest among the included studies. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (Eds). Cochrane handbook for systematic reviews of ınterventions version 6.2 (updated February 2021). Cochrane.
  • Bown, M.J., & Sutton, A.J. (2010). Quality control in systematic reviews and meta-analyses. European Journal of Vascular and Endovascular Surgery, 40(5),669-677. https://doi:10.1016/j.ejvs.2010.07.011
  • Buccheri, R.K., & Sharifi, C. (2017). Critical appraisal tools and reporting guidelines for evidence-based practice. Worldviews on Evidence-Based Nursing, 14(6),463–472. https://doi.org/10.1111/ wvn.12258
  • Capili, B., & Anastasi, J. (2021). Cohort studies. AJN, The American Journal of Nursing, 121(12), 45-48. https://doi.org/10.1097/01. naj.0000803196.49507.08
  • Dol, J., Hughes, B., Bonet, M., Dorey, R., Dorling, J., Grant, A., Langlois, E.V., Monaghan, J., Ollivier, R., Parker, R., Roos, N., Scott, H., Shin, H.D., & Curran, J. (2023). Timing of neonatal mortality and severe morbidity during the postnatal period: a systematic review. JBI Evidence Synthesis, 21(1), 98. https:// doi.10.11124/JBIES-21-00479
  • Ergin, E., & Akın, B. (2018). The Turkish adaptation of a quality assessment tool for quantitative studies: validity and reliability analyses. Türkiye Klinikleri Journal of Nursing Sciences, 10(4),292- 308.
  • Farrah, K., Young, K., Tunis, M.C., Zhao, L.(2019). Risk of bias tools in systematic reviews of health interventions: an analysis of PROSPERO-registered protocols. Systematic reviews, 8(1), 280. https://doi.org/10.1186/s13643-019-1172-8
  • Higgins, J., & Altman, D.G. (2011). Chapter 8: Assessing risk of bias in included studies. In: Higgins J, Green S, (Eds). Cochrane Handbook for Systematic Reviews of Inter-ventions Version 5.0. The Cochrane Collaboration.
  • Holopainen, A., & Hakulinen, T. (2019). New parents’ experiences of postpartum depression: A systematic review of qualitative evidence. JBI Evidence Synthesis, 17(9), 1731-1769. https:// doi.10.11124/JBISRIR-2017-003909
  • Hur, G., Cinar, N., Suzan, O.K. (2022). Impact of COVID-19 pandemic on nurses’ burnout and related factors: A rapid systematic review. Archives of Psychiatric Nursing, 41, 248-263. https://doi.org/10.26650/JARHS2022-1100929
  • Hür, G., Zengin, H., Karakaya Suzan, Ö., Kolukısa, T., Eroğlu, A., Çınar N. (2022). Joanna Briggs Enstitüsü (JBI) randomize kontrollü çalışmalar için kalite değerlendirme aracı’nın türkçe’ye uyarlanması. Sağlık Bilimlerinde İleri Araştırmalar Dergisi, 5,112- 117. https://doi.org/10.26650/JARHS2022-1100929
  • Jarde, A., Losilla, J.M., Vives, J., Rodrigo, M.F. (2013). Q-Coh: A tool to screen the methodological quality of cohort studies in systematic reviews and meta-analysis. International Journal of Clinical and Health Psychology, 13(2),138-146. https://doi. org/10.1016/S1697-2600(13)70017-6
  • Jeffs, E., Ream, E., Taylor, C., Bick, D. (2018). Clinical effectiveness of decongestive treatments on excess arm volume and patientcentered outcomes in women with early breast cancerrelated arm lymphedema: a systematic review. JBI database of systematic reviews and implementation reports, 16(2), 453. https:// doi.10.11124/JBISRIR-2016-003185
  • The Joanna Briggs Institute (JBI). Critical Appraisal Tools. https://jbi. global/critical-appraisal-tools (15 Mayıs 2022)
  • Katrak, P., Bialocerkowski, A.E., Massy-Westropp, N., Kumar, S., Grimmer, K.A.(2004). A systematic review of the content of critical appraisal tools. BMC Medical Research Methodology, (4),22. https://doi.org/10.1186/1471-2288-4-22
  • Keeler, C., & Curtis, A.C. (2022). Case-control studies. The American Journal of Nursing, 122(2),51–56. https://doi.org/10.1097/01. NAJ.0000820584.29051.80
  • Kılıç, S. (2015). Kappa test. Psychiatry and Behavioral Sciences, 5(3), 142-144.
  • Moola, S., Munn, Z., Tufanaru, C., Aromataris, E., Sears, K., Sfetcu, R., et al. (2020). Chapter 7: Systematicreviews of etiology and risk . In: Aromataris E, Munn Z (Editors). JBI Manual for Evidence Synthesis. JBI. https://jbi-global-wiki.refined.site/ space/MANUAL
  • Munn, Z., Moola, S., Riitano, D., Lisy, K. (2014). The development of a critical appraisal tool for use in systematic reviews addressing questions of prevalence. Int J Health Policy Manag, 3(3),123–128. https://doi.org/10.15171/ijhpm.2014.71
  • Munn, Z., Stone, J. C., Aromataris, E., Klugar, M., Sears, K., Leonardi-Bee, J., & Barker, T. H. (2023). Assessing the risk of bias of quantitative analytical studies: introducing the vision for critical appraisal within JBI systematic reviews. JBI Evidence Synthesis, 21(3), 467-471. https://doi.10.11124/ JBIES-22-00224
  • Nahcivan, N., Seçginli, S. (2017). Sistematik derlemeye dahil edilen nicel araştırmaların metodolojik kalitesi nasıl değerlendirilir. Türkiye Klinikleri Journal of Public Health Nursing-Special Topics, (1), 10-19.
  • Nahcivan, N.O., & İncirkus, K. (2015). Reporting characteristics of systematic and literature reviews published in nursing journals in Turkey. The 2nd International Clinical Nursing Research Congress, Abstract Book, 24-27 June, Istanbul.
  • Pearce, N. (2016). Analysis of matched case-control studies. BMJ, 352. https://doi.org/10.1136/bmj.i969
  • Pölkki, T., Kanste, O., Kääriäinen, M., Elo, S., Kyngäs, H. (2014). The methodological quality of systematic reviews published in highimpact nursing journals: a review of the literature. J Clin Nurs, 23(3-4),315-332.
  • Quigley, J.M., Thompson, J.C., Halfpenny, N.J., Scott, D.A. (2019). Critical appraisal of nonrandomized studies-A review of recommended and commonly used tools. Journal of Evaluation in Clinical Practice 25(1), 44–52. https://doi.org/10.1111/jep.12889
  • Sterne, J.A.C., Hernán, M.A., McAleenan, A., Reeves, B.C., Higgins, J.P.T. (2021). Chapter 25: Assessing risk of bias in a nonrandomized study. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (Eds). Cochrane Handbook for Systematic Reviews of Interventions version 6.2 (updated February 2021).
  • Townshend, K., Jordan, Z., Stephenson, M., & Tsey, K. (2016). The effectiveness of mindful parenting programs in promoting parents’ and children’s wellbeing: a systematic review. JBI Evidence Synthesis, 14(3).139-180. https://doi.10.11124/ JBISRIR-2016-2314
  • Ueki, S., Yamagami, Y., & Makimoto, K. (2019). Effectiveness of vibratory stimulation on needle-related procedural pain in children: a systematic review. JBI Evidence Synthesis, 17(7), 1428- 1463. https://doi.10.11124/JBISRIR-2017-003890
  • Yurdugül, H. (2005). Ölçek Geliştirme Çalışmalarında Kapsam Geçerliği için Kapsam Geçerlik İndekslerinin Kullanılması. Pamukkale Üniversitesi Eğitim Fakültesi, XIV. Ulusal Eğitim Bilimleri Kongresi, 28-30 Eylül Denizli.
  • Zengin, H., Suzan, O.K., Hur, G., Kolukısa,T., Eroglu, A., Cinar, N. (2023). The effects of kangaroo mother care on physiological parameters of premature neonates in neonatal intensive care unit: A systematic review. Journal of Pediatric Nursing, 71, 18-27. Bu
There are 36 citations in total.

Details

Primary Language Turkish
Subjects Studies on Education
Journal Section Original Empirical Research
Authors

Özge Karakaya Suzan 0000-0003-4526-4619

Tuğçe Kolukısa 0000-0002-5114-9951

Gülşah Hür 0000-0002-1905-4135

Hamide Zengin 0000-0002-2389-6466

Ayşe Eroğlu 0000-0001-9515-1167

Elif Erbay Özdede 0000-0003-3843-4691

Seda Tecik 0000-0003-2707-5371

Nursan Çınar 0000-0003-3151-9975

Publication Date January 15, 2024
Published in Issue Year 2023 Volume: 13 Issue: 3

Cite

APA Karakaya Suzan, Ö., Kolukısa, T., Hür, G., Zengin, H., et al. (2024). Joanna Briggs Enstitüsü (JBI) Kritik Değerlendirme Araçlarından Kohort ve Vaka Kontrol Çalışmaları için Kontrol Listelerinin Türkçe’ye Uyarlaması. Yükseköğretim Dergisi, 13(3), 359-366. https://doi.org/10.53478/yuksekogretim.1190017

TÜBA Higher Education Research / Review (TÜBA-HER) is indexed in ESCI, TR Dizin, EBSCO, and Google Scholar.

Publisher




112 Vedat Dalokay Street, Çankaya , 06700 Ankara, Türkiye

3415434156  34153 34146 34148 34155 34157 3415834160

Yükseköğretim Dergisi / TÜBA Higher Education Research/Review (TÜBA-HER) does not officially endorse the views expressed in the articles published in the journal, nor does it guarantee any product or service advertisements that may appear in the print or online versions. The scientific and legal responsibility for the published articles belongs solely to the authors.

Images, figures, tables, and other materials submitted with manuscripts must be original. If previously published, written permission from the copyright holder must be provided for reproduction in both print and online versions. Authors agree to transfer all publication rights to the Turkish Academy of Sciences (TÜBA), the publisher of the journal, upon acceptance of their manuscript for publication. Copyright of all published content (text and visual materials) belongs to the journal. No payment is made to the authors under the name of copyright or any other title, and no article processing charges are requested. However, the cost of reprints, if requested, is the responsibility of the authors.

In order to promote global open access to scientific knowledge and research, TÜBA allows all content published online (unless otherwise stated) to be freely used by readers, researchers, and institutions. Such use (including linking, downloading, distribution, printing, copying, or reproduction in any medium) is permitted under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License, provided that the original work is properly cited, not modified, and not used for commercial purposes. For permission regarding commercial use, please contact the publisher.