doi: 10.5455/mjhs.2022.03.006
Original Article
Breast Cancer Screening Programme in Riyadh Peripheral Provinces: Coverage Rate, Participation Rate, and Recall Rate
1Riyadh Region General Directorate of Health Affairs
Abstract
Background and Aims: Assessing the performance of Breast Cancer screening programmes is essential to detect and remedy weaknesses and to improve the quality of the screening services. This study aimed to assess the coverage rate, participation rate, and recall rate of the Breast Cancer Screening in Riyadh Region. Methods: This was a retrospective study in 11 Riyadh peripheral provinces. We used secondary data of women referred for screening and women who underwent mammography screening. Outcomes of the study included: Coverage rate by invitation; Coverage rate by examination; Participation rate; Recall rate. Results: The invitation coverage rate was 5.2%, and it was highest among women in the age group 50-59 years (32.7%). The examination coverage rate was 1.1%, with women in the age group 50-59 years constituting the highest proportion (7%). The participation rate was 21.4% and was highest among women in the age group 50 to 69 years (22.4%). The recall rate was 10.1% and was highest among women in the age group < 40 years (18.6%). Conclusion: In this study to assess the performance of the breast cancer screening programme, we detected low coverage and participation rates, most probably due to the opportunistic approach followed in inviting the target population, in addition to the geographical accessibility problem of the mammography testing sites. The recall rate aligned with the level set by the Saudi National Breast Cancer Screening Programme.
Keywords Breast cancer screening · coverage rate · participation rate · recall rate · Saudi Arabia
Introduction:
Breast cancer (BC) accounted for 11.7% and 6.9% of global cancer cases and deaths in 2020 respectively. It is the most frequent type of cancer affecting women, accounting for 2,261,419 new cases and 684,996 deaths among them in 20201-3.
In Saudi Arabia, BC is the most frequently occurring type of cancer among females, accounting for 30.9% of all cancer cases in 2017. The Age Standardized Rate (ASR) was 29.7/100,000 for the Saudi female population. Regarding mortality, BC ranked as the ninth cause of death among females in 20104,5. Riyadh region ranked as the second region of the kingdom regarding BC burden, with an ASR of 37/100,0004. The BC burden is expected to increase in Saudi Arabia due to the increased life expectancy, population growth, fertility-related factors, and lifestyle-related factors2,5,6
Despite the increase in BC incidence, the global cancer estimates show decreasing mortality trends. The factors contributing to this decline in mortality include the early detection of BC through the use of screening mammography and the provision of therapy to the detected cases3,7. Mammography, by detecting the earlier stages of BC, contributes to preventing around 20% to 40% of BC-associated deaths3,8,9.
The Saudi National Breast Cancer Screening Programme (SNBCSP) was launched in 2012 with the main goal of reducing breast cancer associated mortality through early detection. One of the SNBCSP strategies is to screen asymptomatic women at average risk (aged 40 to 69 years) and those at increased risk to BC using mammography10. Women eligible for screening are referred from Primary Health Care Centers (PHCC) to hospitals where mammography is performed. Women for whom the findings of the screening mammography examination are interpreted as positive are referred for further assessment on recall. Due to the lack of a system that identifies all eligible women at the community level and invites them to screening, the programme follows an opportunistic approach based on referring eligible women seeking care from PHCCs.
Assessing the performance of BC screening programmes is essential to detect and remedy weaknesses, improve the quality of screening services, optimize resources use and ultimately reduce BC associated mortality7,11,12. Performance indicators used for monitoring BC screening programmes include coverage rate, participation rate, and recall rate11,12.
Coverage rate is an important indicator for the evaluation of the effectiveness of the screening programme13. Coverage rate is defined as the degree to which the eligible population within a specific period of time is covered by the screening programme 12-14. There are two types of coverage rate indicators; coverage rate by invitation, which is the percent of eligible women invited for screening, and coverage rate by examination, which is the percent of eligible women actually screened12,14.
A performance indicator that is related to the coverage rate is the participation rate. This is also an indicator of the effectiveness of the BC screening programme, and is defined as the proportion of women who undergo mammography screening out of the invited/referred women 11,12,14.
Coverage and Participation rates depend on the degree of availability and accessibility to the health facilities providing BC screening services and the characteristics of the eligible population13
Another important performance indicator for BC screening programmes is the recall rate, which refers to the proportion of women asked to attend for further investigation out of all the women who had a mammography screening test. These women are recommended to attend to investigate an abnormal screening examination finding14. The recall rate is an important indicator of the quality and efficiency of the BC screening services9.
Previous studies assessing the performance of breast cancer screening campaigns in different regions of Saudi Arabia reported modest coverage rates ranging from 15% in Dammam to 52% in Jeddah. The recall rate reported by previous studies was better, ranging from 7.9% in the Eastern Region15 to 10.9% in Riyadh2. However, these were mainly pilot projects of limited scale; prior to establishing the National organized BC screening programme by the Ministry of Health. To our knowledge, no studies have been conducted to assess the performance of this current organized BC screening programme in the context of Riyadh Peripheral Provinces (RPP). Regular assessment of this programme is vital to monitor its implementation and evaluate the continuous efforts to improve its performance. The aim of this study was to assess the coverage rate, participation rate, and recall rate of the BC Screening Programme in RPPs.
Materials and Methods
Study setting and population:
Riyadh Region constitutes the central Riyadh Province, surrounded by 30 peripheral provinces. The Ministry of Health is almost the sole provider of health services in RPPs, providing care through government hospitals and a network of 313 PHCCs. Other health care providers in RPPs include other governmental sectors, such as the Ministry of National Guard, and the private sector. The services of the National Breast Cancer Screening Programme are currently provided in eleven of these RPPs, in the radiology departments of twelve general hospitals.
We conducted this retrospective study in the eleven RPPs where BC screening services are currently provided. To assess the coverage rates, the study population was women at average risk to breast cancer and eligible for breast cancer screening, residing in the catchment areas of the eleven RPPs (1,799 women). To assess the participation rate, the study population consisted of records of women at average risk to breast cancer who were referred for screening mammography (2600 women). To assess the recall rate, the study population was women at average risk and women at increased risk to breast cancer who underwent mammography screening (1884 women) at the designated BC screening centers in RPPS. The study included the records of all types of study populations from October 2020 to June 2021.
Study variables and outcomes:
The study utilized secondary data stored in two electronic databases: Database (1): The eligible referred women database, which included data collected from women at average risk to BC invited and referred to undergo mammography screening (e.g. province, health center name, participant age). These data were collected by the primary health care center staff at the time of the referral. Database (2): The screened women database, which included data collected from women at average risk and increased risk to BC who underwent mammography screening (e.g. province, participant age, result of the mammography screening). These data were collected by the hospital staff where the screening was performed. We matched women from database (1) with women from database (2) to identify which women in database (1) had complied with the referral recommendations and underwent screening mammography. Women in database (1) who had results of mammography screening recorded for them in database (2) were considered to have complied, and women who had no recoded results were considered to have not complied. Outcomes of the study were the Mammography Screening Coverage rate by invitation, the Mammography Screening Coverage rate by examination, the Mammography Screening Participation rate, and the Mammography Screening Recall rate.
Data analysis:
The data were analyzed using the Statistical Package for Social Sciences (SPSS) version 21. The coverage rate by invitation was calculated by dividing the number of women at average risk to BC referred for screening by the total number of women at average risk to BC and eligible for screening. The coverage rate by examination was calculated by dividing the number of women at average risk to BC who underwent screening by the total number of women at average risk to BC and eligible for screening. The participation rate was calculated by dividing the number of women at average risk to BC who underwent screening by the total number of women at average risk to BC referred for a screening. Finally, the recall rate was calculated by dividing the number of women at average risk or increased risk to BC who had mammography results interpreted as suspected by the number of women at average risk or increased risk to BC who underwent screening. The study protocol was approved by the Central Institutional Review Board of the Ministry of Health (IRB log No:21-86 M).
Results
In the period from October 2020 to June 2021, 2234 eligible women were referred for mammography screening. As shown in table (1), the highest proportion of the referred women was in the age group 40 to 49 years old (45.2 %), while women in the age group 70 and above constituted the lowest proportion (1.6%). Table (1) also shows that in the same period 1637 women at average risk and increased risk to BC underwent screening mammography. Almost half of these screened women were in the age group 40 to 49 years old, while women in the age group 70 and above were the least screened groups (1.1%).
Coverage by invitation:
The proportion of women at average risk referred to perform screening mammography was only 5.2% of all women at average to BC and eligible for screening in the catchment area of the 11 provinces. The invitation coverage rate was highest among women in the age group 50-59 years (32.7%), while women in the age group 70 years and above were the least invited group, with only 8.6% of them referred for screening (table2).
Coverage by examination:
The proportion of women at average risk to BC who underwent screening mammography was only 1.1% of all the women at average risk to BC and eligible for screening in the catchment area of the 11 provinces. Coverage by examination was highest among women in the age group 50-59 years (7%). Only 1% of women in the age group 70 years and above were screened (table 2).
Participation rate:
Table (3) shows that around one fifth of the women who had been referred for screening had actually complied with the invitation and underwent the screening. Women in the age group 50 to 69 years old had the highest compliance, where 22.4% of them underwent the screening mammography. Women in the age group 70 and above had the least compliance, with a participation rate of only 11.4%.
Recall rate:
Table (4) shows that 10.1% of the women who underwent mammography screening were recalled for further assessment based on the interpretation of their mammography screening results. The highest recall rate was among the women in the age group less than 40 years old (18.6%) and the least was among the age group 40 to 49 years (9.3%).
Discussion
Our study aimed to assess the coverage rates, participation rate, and recall rate of the BC screening programme at RPPs.
Our results showed that the coverage rates (by investigation and by examination) were low. In the RPP, only 5.2% of the women at average risk to BC had been referred to perform BC screening by mammography, while only 1.1% of the target population actually underwent the mammography screening.
Due to the COVID 19 epidemic during the study period, the SNBCSP set a coverage target of only 5.3% of the eligible population to be screened. Based on the targets set by the SNBCSP, our results demonstrate that the invitation coverage rate was achieved. However, the examination coverage rate was well below the target set by the programme. The coverage rate from our study is lower than that reported from Al Qaseem region, where 17.9% of the target population was covered during a pilot BC screening project16. Our rate was also low when compared to coverage rates from other countries. In the European Union countries, the average invitation coverage was 78.9%, ranging from 21% to 100%, and the average examination coverage was 49.2%, ranging from 17% to 84%17.
The success of the BC screening programmes in lowering BC mortality depends on the degree to which the target population is covered18,19. The coverage rates in turn depend – partly- on the cancer screening programme implementation status. Population-based BC screening progammes implement a systemic approach to identify the eligible women in the programme area. These women are then personally invited to attend for screening, thus leading to universal coverage of the eligible women19,20. Such programmes need to be highly organized in the sense that the targeted population, the screening test, the screening interval, and the programme policy and protocols are clearly stated to assure the reliability and effectiveness of the invitational activities17,21. Such population-based, organized programmes are associated with high coverage rates.
On the other hand, BC screening programme implementation could follow an opportunistic approach, where the invitations for screening are initiated during encounters between women and health care providers in health facilities. Opportunistic screening is a passive kind of screening, and it excludes those who do not have regular contact with health facilities. Therefore, unlike population-based screening, it is associated with a lower rate of screening among the general population22,23.
In RPP, the BC screening programme is an organized programme, with nationally set guidelines that define the eligible women, the screening procedures, the frequency of screening, and follow-up and management of screen-detected abnormalities10. However, it differs from Al Qaseem pilot project and the European programmes in that it follows an opportunistic approach for identifying and referring eligible women for screening, an approach that is associated with low population coverage as mentioned above23. Within the European Union, the countries that did not apply population-based BC screening programmes had low invitation and examination coverage rates18,20,21,24.
Nevertheless, the fact that the Saudi BC screening programme is an organized one, provides an opportunity for increasing the coverage despite the opportunistic approach of invitation, because organized systems set the ground for educating the healthcare providers, reminding them, and compelling them to comply with the screening recommendations23. This could be improved through interventions such as provider’s assessment and feedback, which has been found to increase screening for breast cancer25. Efforts to encourage eligible women to self-refer themselves using strategies such as group education, and one-on-one education, could further improve the situation25.
Our results showed a relatively better participation rate in RPP, where around one-fifth of the women referred for mammography screening had, in reality, undergone screening. Our rate was within the range of participation rates reported from the European countries (6.2% to 83.5%)19. However, it was well below the participation rate reported from the BC screening pilot project in Jeddah region, where 52% of the invited women took the screening test26.
Besides the organization of a BC screening programme, the participation rate relies on the affordability and accessibility to the health services22,23. As with other organized BC screening programmes23, the SNBCSP services are publicly funded and are provided to eligible women free of charge, thus removing the financial barrier. However, the geographical accessibility to BC screening centers in RPP may constitute a deterrent to utilizing these screening services. In other countries, poor accessibility to health care (longer distance and lack of transportation) decreased the probability of screening, especially in rural areas18,23,27.
In RPP, the mammography screening sites are located in provincial hospitals in the main cities of the provinces, making it difficult for women from remote villages to access them, especially in the absence of a public transport system. Restrictions in traveling alone and lack of public transport were mentioned as factors hindering the ability of women to attend for BC screening in the Eastern Region of Saudi Arabia15. In Jeddah where a high participation rate was observed, mammography screening was provided within the primary health care centers, which were more accessible than hospitals26.
Mobile screening units can be implemented in settings where geographical accessibility is considered an obstacle to attend for BC screening. Such units are specifically beneficial in areas of low population density, such as the situation in RPP. This can reduce the travel time associated with long distances and improve acceptance and compliance with the referral recommendations18,23. Mobile clinics for BC screening have been implemented previously in RPP; however, studies are needed to assess their effect on the uptake of BC screening in this setting.
Examination coverage and participation rates are also affected by individual-level barriers, such as cancer awareness, attitudes and beliefs, anxiety and negative expectations of screening, procedural barriers, socio-demographic and economic characteristics, lifestyle factors and distrust of the medical system18,19,23,24,27. These factors should be thoroughly investigated to identify their possible effects before interventions are designed to improve the situation.
In mammography screening, the recall rate is the frequency with which the results of a screening mammography examination are interpreted as positive, thus recalling women for additional investigations to reach a diagnosis28,29. Our study revealed a recall rate of 10.1%. This rate was slightly less than the recall rate reported in Riyadh in 2013 (10.9%)2, but it was higher than the recall rate reported by the Eastern Region BC screening programme (7.9%)15. Our recall rate complied with the standard level set by the SNBCSP of a recall rate of not more than 10%10.
Globally, different regions set different targets for the recall rate. The American College of Radiology recommends a level of 10% and a range of 5–12% to maximize sensitivity and specificity29,30. Nonetheless, the recall rate reported by the USA was 15.1%31.
The European standard for the acceptable level of recall rate is lower (<5 %), and the average level reported by these countries was 5.2%. However, the range was wide, with some countries reporting a recall rate as low as 1.6 % and others reporting higher rates (11.8%)17.
Recall rate is commonly used as a performance measure in mammography practice and is considered one of the main quality indicators that assess a radiologist's performance28,29.
A too low recall rate may be associated with increased false-negative results and low sensitivity. On the other hand, a too high recall rate may result in lower specificity and high false-positive results, high medical associated expenditure due to unnecessary investigations, patient anxiety, and may also lead to overtreatment23,28,29,32,33. As with other countries, the recall rate reported in our study was higher among younger age groups9,17,29. Younger age is associated with higher breast density, which impacts the mammography image and leads to a higher recall rate9,29. Our recall rate was highest among the age group <40 years, and these are mainly women at increased risk to breast cancer and expected to have high recall rates28. Our results also indicated a high recall rate among older women. These high recall rates should be further investigated to identify the positive predictive values, which is the proportion of the true cancer cases identified by the screening test34. This will give an indication of the accuracy of the screening mammography performed at RPPs. Also, a comparison of the radiological features that led to recall with the final diagnosis may identify the radiological features that necessitate further investigations and inform the radiologist’s decision regarding the interpretation of the mammography images35. Furthermore, identifying factors that lead to the high recall rates, such as those related to the patient population, the radiologist, and the health system, is vital to designing appropriate remedial interventions in RPPs. These recall reduction measures are essential since evidence has shown that when the recall rate exceeds 12%, there is an increase in the false-positive results with little to no gain in the detection rate of BC 29.
The strength of this study is that we ascertained the performance of screening mammography through a review of patient records rather than depending on reports by the patients. However, the use of secondary data has limited our ability to include patient and health system-related data, which could have enabled us to compare the different subgroups of the population. Also, we had access only to data relevant to the peripheral provinces of Riyadh region, which limited the generalizability of the results to the other regions of the country.
Conclusions:
We detected a low coverage and participation rate in BC screening in RPP. This was most probably due to the opportunistic approach followed in inviting the target population, in addition to the geographical accessibility problem of the mammography testing sites. More efforts to increase the demand by the target population, improve the delivery of the screening services by the healthcare providers, and improve accessibility through mobile BC screening units are needed. The recall rate aligned with the acceptable level set by the SNBCSP, but efforts are needed to reduce the recall rate.
References
- International Agency for Research on Cancer. (2020, December 31). Breast Cancer Fact Sheet. World Health Organization. Retrieved July 29, 2021, from https://gco.iarc.fr/today/data/factsheets/cancers/20-Breast-fact-sheet.pdf
- Abulkair O, Tahan F, Musaad S, Al Sheikh S, Al Shahed M, Al Asiri M, et al. A 5 years’ experience of the first public breast cancer screening center in the capital of Kingdom of Saudi Arabia. Pan Arab Journal of Oncology. 2016;9(1): 40 - 46.
- Abulkhair O, Al Tahan F, Young S, Musaad S, Jazieha A. The first national public breast cancer screening program in Saudi Arabia Ann Saudi Med. 2010; 30(5): 350-57.
- Alrawaji A, Alshahrani Z Alzahrani W, Alomran F, Almadou A. Saudi Cancer Registry. (2019, June) Cancer Incidence Report Saudi Arabia. National Health Information Center. Retrieved June 2021, from: https://nhic.gov.sa/eServices/Documents/E%20SCR%20final%206%20NOV.pdf
- El Bcheraoui C, Basulaiman M, Wilson S, Daoud F, Tuffaha M, AlMazroa MA, et al. Breast Cancer Screening in Saudi Arabia: Free but Almost No Takers. PLoS ONE. 2015;10(3): e0119051.
- Abdel-Aziz S, Amin T, Al-Gadeeb M, Alhassar A, Al-Ramadan A, l-Helal M, et al. Perceived Barriers to Breast Cancer Screening among Saudi Women at Primary Care Setting. Asian Pac J Cancer Prev. 2018;18(9): 20-29.
- Barcelos M, Nunes B P, Silva Duro S M, Tomasi E, Lima R D, Chalupowski M N, et al. Utilization of Breast Cancer Screening in Brazil: An External Assessment of Primary Health Care Access and Quality Improvement Program. Health Systems & Reform. 2017;4(1):42–55.
- Parise C, Burleson J. Seidenwurm D. Assessing the Recall Rate for Screening Mammography: Comparing the Medicare Hospital Compare Dataset with the National Mammography Database. Am J Roentgenol. 2018;211(9): 127-132.
- Kim Y, Lee E, Jun J, Shin D-R, Park Y, Kim H-W, et al. Analysis of Participant Factors That Affect the Diagnostic Performance of Screening Mammography: A Report of the Alliance for Breast Cancer Screening in Korea. Korean J Radiol 2017;18(4):624-631
- Breast Cancer Screening Programme. Guidelines of Breast Cancer Screening Programme. Riyadh: Saudi Ministry of Health; 2018.
- Day N, Williams D, Khaw K. Breast cancer screening programmes: the development of a monitoring and evaluation system. Br. J. Cancer.1989; 59(6):954-958.
- Giordano L, Karsa L, Tomatis M, Majek O, Wolf C, Lancucki L, et al. Mammographic screening programmes in Europe: organization, coverage and participation. J Med Screen. 2012;19(1):72 –82
- Ding L, Jidkova S, Greuter M, Van Herck K, Goossens M, Martens P, et al. Coverage determinants of breast cancer screening in Flanders: an evaluation of the past decade. Int J Equity Health. 2020;19(1)212.
- Perry N, Broeders M, de Wolf Cl, Törnberg S, Holland R, von Karsa L. European Commission. European Guidelines for Quality Assurance in Breast Cancer Screening and Diagnosis. 4th ed, Luxembourg: Office for Official Publications of the European Communities; 2006.
- Al Mulhim F A, Syed A, Bagatadah W A and Al Muhanna A F. Breast cancer screening programme: experience from Eastern province, Saudi Arabia. East Mediterr Health J. 2015;21(2):111-19. 27
- Akhtar S S, Nadrah H M, Al-Habdan M A, El Gabbani S A, El Farouk G M K, Abdelgadir M H et al. First organized screening mammography programme in Saudi Arabia: preliminary analysis of pilot round. East Mediterr Health J. 2010;16(10): 1025-31. 15
- Ponti A, Anttila A, Ronco G, Senore C. International Agency for Research on Cancer. Cancer Screening in the European Union Report on the implementation of the Council Recommendation on cancer screening. IARC, Lyon 2017. 16
- Kriaucioniene V and Petkeviciene J. Predictors and Trend in Attendance for Breast Cancer Screening in Lithuania, 2006–2014. Int. J. Environ. Res. Public Health. 2019; 16(22):4535. 17
- Akinyemiju T F. Socio-economic and health access determinants of breast and cervical cancer screening in low-income countries: analysis of the World Health Survey. PLoS One. 2012;7(11): e48834. 18
- Walsh B, Siles M. and O'Neill C. The importance of socio-economic variables in cancer screening participation: A comparison between population-based and opportunistic screening in the EU-15. Health Policy 2011; 101(3): 269-276. 19
- Von Karsa L, Anttila A, Ronco G, Ponti A, Malila N, Arbyn M, et al. Cancer Screening in the European Union Report on the implementation of the Council Recommendation on cancer screening. First Report. European Communities, Brussel, 2008. Available from: https://ec.europa.eu/jrc/sites/default/files/ cancer_screening.pdf. 20
- Xu An-gao. Opportunistic Screening for Colorectal Cancer, Rectal Cancer - A Multidisciplinary Approach to Management, Dr. Giulio A. Santoro (Ed.), ISBN: 978-953-307-758-1, InTech, 2011. Available from: http://www.intechopen.com/books/rectal-cancer-a-multidisciplinary-approach-to-management/opportunisticscreening-for-colorectal-cancer 21
- Miles A, Cockburn J, Smith R A, Wardle J. Perspective from Countries Using Organized Screening Programs. CANCER Supplement. 2004; 101(5): 1201-13. 22
- Eichholzer M, Richard A, Rohrmann S, Schmid S M, Leo C, Huang D J et al. Breast cancer screening attendance in two Swiss regions dominated by opportunistic or organized screening. BMC Health Services Research. 2016; 16(519). 23
- Sabatino S A, Lawrence B, Elder R, Mercer S, Wilson K, Devinney B, et al. Effectiveness of Interventions to Increase Screening for Breast, Cervical, and Colorectal Cancers Nine Updated Systematic Reviews for the Guide to Community Preventive Services. Am J Prev Med. 2012;43(1):97–118. 24
- Baslaim M M, Baroum I H, Salman B A, Baghlaf B S, Al Farsi M A. Breast Cancer Screening Program in Jeddah, Saudi Arabia: Is There a Need for a National Program? Int J Womens Health Wellness. 2016;2(4). 25
- UlyteID A, Wei1 W, Dresse H, Gruebner O, Wyl V, Ba¨hler C, et al. Variation of colorectal, breast and prostate cancer screening activity in Switzerland: Influence of insurance, policy and guidelines. PLoS ONE. 2020; 15(4): e0231409. 26
- Rothschild J, Lourenco A P, Mainiero M B. Screening Mammography Recall Rate: Does Practice Site Matter? Radiology 2013;269(2): 348-53. 28
- Lee C S, Parise C, Burleson J, Seidenwurm D. Assessing the Recall Rate for Screening Mammography: Comparing the Medicare Hospital Compare Dataset With the National Mammography Database. 2018;211(1):127-132. 29
- DiPrete O, Lourenco A P, Baird G L, Mainiero M B. Screening Digital Mammography Recall Rate: Does It Change with Digital Breast Tomosynthesis Experience? Radiology 2018;286(3): 838-44. 30
- Yankaskas B C, Klabunde C N, Ancelle-Park R, Rennert G, Wang H, Fracheboud J. International comparison of performance measures for screening mammography: can it be done? J Med Screen. J Med Screen. 2004;11(4):187-93. 31
- Rauscher G H, Murphy A M, Orsi J M, Dupuy D M, Grabler P M, Weldon C B. Beyond the Mammography Quality Standards Act: Measuring the Quality of Breast Cancer Screening Programs. AJR Am J Roentgenol. 2014;202(1):145-51. 32
- Lee E H, Kim K W, Kim Y J, Shin D-R, Park W M, Lim H S. Performance of Analysis of Participant Factors That Affect the Diagnostic Performance of Screening Mammography: A Report of the Alliance for Breast Cancer Screening in Korea. Korean J Radiol. 2016; 18(4):624-631. 33
- Yankaskas B C, Cleveland R J, Schell M J, Kozar R. Association of Recall Rates with Sensitivity and Positive Predictive Values of Screening Mammography. AJR Am J Roentgenol. 2001;177(3):543-9. 34
- Beruchashwili T, Gvamichava R and Duffy S W. Screening organization and recall rate in a regional breast screening programme. J Med Screen. 2018;25(1): 55–56. 35