- Research article
- Open Access
Preliminary evaluation of the publicly available Laboratory for Breast Radiodensity Assessment (LIBRA) software tool: comparison of fully automated area and volumetric density measures in a case–control study with digital mammography
Breast Cancer Research volume 17, Article number: 117 (2015)
Breast density, commonly quantified as the percentage of mammographically dense tissue area, is a strong breast cancer risk factor. We investigated associations between breast cancer and fully automated measures of breast density made by a new publicly available software tool, the Laboratory for Individualized Breast Radiodensity Assessment (LIBRA).
Digital mammograms from 106 invasive breast cancer cases and 318 age-matched controls were retrospectively analyzed. Density estimates acquired by LIBRA were compared with commercially available software and standard Breast Imaging-Reporting and Data System (BI-RADS) density estimates. Associations between the different density measures and breast cancer were evaluated by using logistic regression after adjustment for Gail risk factors and body mass index (BMI). Area under the curve (AUC) of the receiver operating characteristic (ROC) was used to assess discriminatory capacity, and odds ratios (ORs) for each density measure are provided.
All automated density measures had a significant association with breast cancer (OR = 1.47–2.23, AUC = 0.59–0.71, P < 0.01) which was strengthened after adjustment for Gail risk factors and BMI (OR = 1.96–2.64, AUC = 0.82–0.85, P < 0.001). In multivariable analysis, absolute dense area (OR = 1.84, P < 0.001) and absolute dense volume (OR = 1.67, P = 0.003) were jointly associated with breast cancer (AUC = 0.77, P < 0.01), having a larger discriminatory capacity than models considering the Gail risk factors alone (AUC = 0.64, P < 0.001) or the Gail risk factors plus standard area percent density (AUC = 0.68, P = 0.01). After BMI was further adjusted for, absolute dense area retained significance (OR = 2.18, P < 0.001) and volume percent density approached significance (OR = 1.47, P = 0.06). This combined area-volume density model also had a significantly (P < 0.001) improved discriminatory capacity (AUC = 0.86) relative to a model considering the Gail risk factors plus BMI (AUC = 0.80).
Our study suggests that new automated density measures may ultimately augment the current standard breast cancer risk factors. In addition, the ability to fully automate density estimation with digital mammography, particularly through the use of publically available breast density estimation software, could accelerate the translation of density reporting in routine breast cancer screening and surveillance protocols and facilitate broader research into the use of breast density as a risk factor for breast cancer.
It is increasingly recommended that breast cancer screening recommendations be personalized on the basis of a woman’s risk for breast cancer [1, 2]. This risk is known to be influenced by a number of factors, such as reproductive history , family history , body mass index (BMI) , and genetic traits , which form the basis for most current breast cancer risk assessment models . The National Cancer Institute’s risk assessment tool, the Gail model , is one of the most commonly used risk assessment models and incorporates primarily reproductive and familial risk factors [7, 8]. The Gail model has several advantages, including being validated in large populations and for different racial groups [8–10], based on relatively simple-to-assess risk factors. However, though shown to be well calibrated at the population level, it has only moderate discriminatory accuracy at the individual level , limiting its use for personalized clinical decision making.
An opportunity for improving the discriminatory accuracy of risk assessment models is the incorporation of breast density . Typically estimated via visual assessment either qualitatively by using the American College of Radiology Breast Imaging-Reporting and Data System (BI-RADS) density categories  or quantitatively as percent density (PD %) , mammographic density has been consistently shown to be an independent risk factor for breast cancer [14–22], potentially the strongest after age . This has led to the development of several fully automated breast density algorithms such as the automated ImageJ method  and the standardized measures of area density proposed by Heine et al. . More recently, measures of the volumetric amount of dense tissue have been proposed as more accurate representations of the underlying fibroglandular tissue content and, as such, potentially better predictors of risk [21, 25–29].
To date, studies evaluating the use of volumetric versus area density measures in breast cancer risk assessment have focused primarily on determining which individual measure is a better predictor of risk and have reported mixed results [19–21, 25, 26]. Here, we investigate both individual as well as joint associations between quantitative estimates of volumetric and area density and invasive breast cancer. As a first step, we examine these associations in a case–control setting after adjusting for standard risk factors and BMI. By establishing these associations and evaluating their magnitude, our study provides instrumental evidence toward identifying new promising density measures to be considered in breast cancer risk assessment models  for improving their discriminatory accuracy. In addition, our study is the first to evaluate associations between breast cancer and density measures as estimated by a new publically available breast density estimation software tool . Our long-term hypothesis is that volumetric and area-based density measures, when considered jointly with standard risk factors and BMI, can independently contribute to and improve breast cancer risk assessment, compared with percent density measures or standard risk factors alone.
In this Health Insurance Portability and Accountability Act-compliant study approved by the institutional review board at the University of Pennsylvania (protocol #814186), we retrospectively identified women whose unilateral, invasive breast cancer was diagnosed at age 40 years or older from a previously completed multimodality breast imaging trial in our institution (2002–2006; National Institutes of Health P01 CA85484). The trial recruited a total of 901 women, each of whom met at least one of the following inclusion criteria: they were presenting for staging with newly diagnosed breast cancer, or they had a mammographically detected suspicious finding (BI-RADS of at least 4) after screening or diagnostic evaluation (or both) and were directed to biopsy, or they had an otherwise-suspicious palpable mass directed to biopsy, or they were evaluated to be at a high risk for developing breast cancer as determined by an estimated high lifetime risk of more than 25 % (using either the Gail or Claus risk models), or they had a recently diagnosed contralateral breast cancer. All women received an array of breast imaging modalities, including digital mammography. Informed written consent was obtained prior to study participation. From these women, 317 were diagnosed with primary breast cancer, of which 231 were invasive. Of the 231 women diagnosed with invasive breast cancer, 146 had raw (i.e., “For Processing”) digital mammograms available for analysis (Senographe 2000D and DS; GE Healthcare, Little Chalfont, UK). From this subset of 146 women, 10 were excluded for having bilateral breast cancer and thus not having a cancer-unaffected mammogram available for our analysis, and eight were excluded for having mammograms with artifacts or insufficient image quality (i.e., blur, motion effects, etc.), preventing valid breast density estimates from being obtained accurately with our automated software. An additional 22 women were excluded for being under the age of 40 and therefore not representative of a standard screening population. Thus, a total of 106 women with invasive cancer and no personal history of breast cancer were included in our analysis. No statistically significant differences in risk factor distributions between the included and total excluded women in this study were observed (P > 0.05).
Controls were randomly selected asymptomatic women who had breast cancer screening with digital mammography in our institution over the closest possible overlapping time period (2005–2006) where digital mammography was available to the general screening population and had raw digital mammograms available. Controls were matched to cases at a 1:3 ratio at 5-year age intervals. This resulted in 318 controls available for analysis, yielding a total cohort size of 424 women (average age of 55.1 ± 8.9 years). For density estimation, we used the mediolateral oblique (MLO) view mammogram of the contralateral, unaffected breast of cases as a surrogate of inherent breast tissue properties; MLO mammograms of controls were subsequently side-matched to cases. For this retrospective analysis, the requirement of informed consent was waived under institutional review board approval.
Demographic risk factors
To account for possible confounding of the breast density measures by other known risk factors, we also considered self-reported information regarding standard demographic and reproductive risk factors for breast cancer . For cancer cases, this information was available from the previously completed imaging trial. For controls, this information was obtained from screening questionnaires collected at the time at which the mammograms used in our study were acquired.
As the Gail model  is the current standard for assessing a woman’s risk for breast cancer, we abstracted the available demographic and reproductive information to match, as closely as possible, the risk factor coding used by the Gail model  (Table 1). Age was treated as a categorical variable based on 5-year age intervals, as in the matching process used during the study design. Age at menarche, number of previous benign biopsies, and first-degree family history (i.e., the number of first-degree female relatives with breast cancer) were treated as ordinal variables with the lowest value chosen as the reference group. For age at first live birth (i.e., parity), the Gail model considers whether it occurred prior to age 20, between age 20 and 24, 25 to 29, or after age 29 (i.e., 30 years or older), while nulliparous women are included in the 25- to 29-year age group as they have similar ORs for breast cancer . To approximate the Gail model encoding given that we had only the following three descriptive categories available for age at first live birth in our screening questionnaires, we encoded parity as a nominal variable, comparing women in the under 30-year group and 30-year-or-older group versus nulliparous women as the reference group. We also adjusted for race as a nominal variable by using Caucasian women as the reference group to reflect the Gail model, which has been validated in Caucasian , African-American , and Asian  populations.
In addition, BMI was abstracted from archived clinical records. Based on available height and weight information, women were classified as normal weight (BMI < 25 kg/m2), overweight (25 kg/m2 ≤ BMI < 30 kg/m2), or obese (30 kg/m2 ≤ BMI). In this study, BMI was treated as an ordinal variable.
Breast density measures
Breast density was measured by using fully automated software. Absolute dense area and area percent density (PD %) were estimated by using a publically available software tool , the Laboratory for Individualized Breast Radiodensity Assessment (LIBRA), based on our previously proposed adaptive multi-cluster fuzzy c-means segmentation algorithm . The LIBRA algorithm has been previously validated against the current standard semi-automated Cumulus method , showing similar agreement for both raw (i.e., “For Processing”) and vendor post-processed (i.e., “For Presentation”) digital mammograms (Fig. 1) , for the same vendor used in this study. Briefly, the algorithm first applies an edge-detection algorithm to delineate the boundary of the breast and the pectoral muscle. An adaptive multi-class fuzzy c-means algorithm is applied to identify and partition the image gray levels (Fig. 1b) within the mammographic breast tissue area, B A , into regions (i.e., clusters) of similar x-ray attenuation (Fig. 1c). These clusters are then aggregated by a support-vector machine classifier to a final absolute dense area, D A , segmentation (Fig. 1d). The ratio of the absolute dense area to the total breast area is used to obtain a measure of breast percent density (PD %):
Absolute dense tissue volume and volume percent density (VD %) were automatically assessed by using FDA-cleared software (Quantra™ version 2.0; Hologic Inc., Bedford, MA, USA). The algorithm is based on the widely validated method of Highnam et al.  adapted for digital mammography . Briefly, this method quantifies the thickness of dense (i.e., fibroglandular) tissue within each image pixel based on physical parameters of the breast and the imaging system as well as on imaging physics of individual exposures, such as attenuation coefficients for breast tissue, x-ray spectra for the target material, x-ray energy (i.e., peak kilovoltage), exposure, and organ dose (i.e., decigray). Aggregation of the per-pixel volumes for the entire breast allows estimation of the total breast volume, B V , and dense tissue volume, D V . The ratio of absolute dense tissue volume to absolute breast volume provides a measure of VD % as:
Lastly, for comparison with the automated density measures, we also obtained standard four-category BI-RADS density estimates via retrospective review of archived clinical reports, in which the density assessment was made at the time of routine clinical evaluation by the interpreting breast radiologist for that individual mammography study.
The continuous breast density measures were first log-transformed to account for their skewed distributions. Differences in standard risk factors, BMI, and breast density distributions between cases and controls were assessed by using chi-squared tests for categorical variables and two-sided t tests for continuous variables at the standard α = 0.05 significance level. The associations between PD %, VD %, absolute dense area, and absolute dense volume were assessed by using linear regression and Spearman correlation, as were the associations between the four density measures and BMI. Univariate (i.e., unadjusted) and multivariable (i.e., fully adjusted) logistic regression was performed to assess the association between the different log-transformed breast density measures and breast cancer before and after adjusting for the standard risk factors and BMI. Odds ratios (ORs), 95 % confidence intervals (CIs), and significance were estimated for all risk factors. For categorical variables, we used a test-for-trend analysis, except for race and parity which were treated as nominal variables. ORs for continuous density measures are reported per standard deviation increase based on the distribution of the breast density metrics in the controls. Missing risk factors (Table 1) were accounted for by standard multiple imputation by using bootstrapping  stratified by cancer status, in which 25 imputations were used for this analysis, which is greater than the suggested minimum number of 20.
The area under the curve (AUC) of the receiver operating characteristic (ROC) was used to evaluate the discriminatory capacity of each unadjusted and adjusted breast density model . The adjusted density models are then compared with baseline models fit only on standard risk factors before and after the inclusion of BMI by using DeLong’s test . In addition, we compared the performance of the area and volume method of each type (i.e., absolute and relative percent) by using DeLong’s test to determine whether choice of the density measure influences discriminatory capacity. Finally, as the different breast density measures were expected to be moderately correlated , we applied backward stepwise feature selection with standard variable entry and removal criterion (P enter < 0.05; P removal > 0.1) commonly used in the literature  both to the risk factor-adjusted and fully adjusted models, to identify those measures of breast density with statistically independent associations to breast cancer while simultaneously mitigating the risk of over-parameterizing the individual models . These feature-selected, adjusted main-effects models were then compared with models fitted only on standard risk factors and a model including standard risk factors and area percent density (i.e., PD %), before and after the inclusion of BMI. The performance of these models was also compared by using DeLong’s test. All analyses were performed in Stata 13.1 (StataCorp LP, College Station, TX, USA).
Comparison of risk factors between cases and controls
Women in case and control groups were similar in terms of number of prior benign biopsies (P = 0.36), first-degree family history (P = 0.89), race (P = 0.22), and age at first live birth (P = 0.08) while being significantly different in terms of their BMI (P < 0.001) and age at menarche (P = 0.02). In terms of mammographic density estimated via automated software, higher absolute density estimates were significantly associated with cancer status (P < 0.001), as were the percent density estimates (P ≤ 0.002), regardless of whether area or volumetric density measures were considered, whereas BI-RADS density estimates were not significant (P = 0.65). Table 1 provides a summary of standard risk factors and breast density measures for our case–control groups.
Relationship between area and volumetric breast density
Statistically significant (P < 0.001) correlations were observed between the different quantitative density estimates (Spearman correlation: ρ = 0.24–0.73). Area percent density and absolute dense area had the strongest correlation (ρ = 0.73, 95 % CI 0.69–0.78). Absolute dense volume and area percent density had the weakest correlation (ρ = 0.24, 95 % CI 0.15–0.33). Figure 2 shows correlation and linear regression plots for the different area and volumetric breast density measures.
Relationship between breast density measures and body mass index
Statistically significant (P < 0.05) correlations were observed between the different quantitative density estimates and BMI (Spearman correlation: ρ = −0.31–0.42). Absolute dense volume and BMI had the strongest correlation (ρ = 0.42, 95 % CI 0.38–0.53), whereas absolute dense area and BMI had the weakest correlation (ρ = 0.10, 95 % CI 0.00–0.21). Figure 3 shows correlation and linear regression plots for the different area and volumetric breast density measures versus BMI.
Associations between area and volumetric breast density and breast cancer
Univariate analysis of the standard risk factors (Table 2) shows that BMI (P < 0.001) and age at menarche (P = 0.01) were significantly associated with breast cancer for our study population, with later age at menarche being a protective factor (OR = 0.57, 95 % CI 0.37–0.88) and increasing BMI a risk factor (OR = 2.97, 95 % CI 2.17–4.05). Parity after age 30 years was also observed to be a risk factor (OR = 2.00, 95 % CI 1.00–3.99, P = 0.05), as was parity prior to age 30 (OR = 1.88, 95 % CI 1.04–3.42, P = 0.04). Before adjustment for the standard Gail risk factors and BMI, all four quantitative breast density measures were statistically significantly associated with breast cancer at the standard level (P ≤ 0.002; Table 3). Absolute measures of breast density had a higher discriminatory capacity in distinguishing cancer status (AUC = 0.68–0.71) than percent density measures (AUC = 0.59–0.60; P < 0.05) or the Gail risk factors (Table 2: AUC = 0.51–0.60; P < 0.05) but not higher than BMI (AUC = 0.76). In addition, the discriminatory capacity of absolute dense area and absolute dense volume were not found to be significantly different (P = 0.38), nor were area percent density and volume percent density (P = 0.63).
After adjustment for the Gail risk factors (Table 4), the associations between all four measures and cancer status remained significant and were strengthened, and the discriminatory capacity of the models including absolute measures of density (AUC = 0.74–0.75) was significantly improved (P < 0.003) relative to the model including only Gail risk factors. As with the unadjusted models, no difference was observed in the discriminatory capacity between the absolute (P = 0.57) or percent (P = 0.78) area and volume density measures. Finally, when both the standard Gail risk factors and BMI were adjusted for (Table 5), all four density measures retained statistical significance (P < 0.001), and most had strengthened associations with breast cancer relative to their unadjusted associations as evidenced by the lower P values, or higher ORs, or both. The discriminatory capacities of the absolute dense area (AUC = 0.85), percent dense area (AUC = 0.85), and percent dense volume (AUC = 0.83) metrics were also significantly (P ≤ 0.005) higher than the baseline standard Gail risk factors and BMI model (AUC = 0.80). Furthermore, after adjustment for both Gail risk factor information and BMI, absolute dense area was found to have a significantly (P = 0.009) larger discriminatory capacity (AUC = 0.85) relative to absolute dense volume (AUC = 0.82), whereas the difference between the area and volume percent density measures only approached significance (P = 0.08). In contrast, BI-RADS density was not found to be significantly associated with breast cancer in our study population either before or after adjustment for other risk factors.
In multivariable analysis (Table 6), a logistic regression model based only on standard Gail risk factors had an AUC of 0.64 (95 % CI 0.58–0.71). A model combining these risk factors with the standard area percent density (i.e., PD %) had an improved discriminatory capacity (AUC = 0.68, 95 % CI 0.62–0.74), which was statistically different from the model including only the standard risk factors (P = 0.03). A combined, feature-selected model considering all four different breast density measures in combination with the Gail risk factors had an AUC of 0.77 (95 % CI 0.71–0.82), which was significantly higher than both the model including only the Gail risk factors (P < 0.001) and the model including the Gail risk factors plus area percent density (P < 0.001). In this combined model, absolute dense volume and absolute dense tissue area were jointly significant predictors of breast cancer (P ≤ 0.003), while area percent density, volume percent density, and BI-RADS density estimates were not retained (P > 0.1).
Adjusting for BMI in addition to the Gail risk factors (Table 7) also led to increased discriminatory capacity in all models (AUC = 0.80–0.86). A logistic regression model based only on Gail and BMI risk factors had an AUC of 0.80 (95 % CI 0.75–0.85). The addition of the standard area percent density measure to the Gail-BMI risk factor model led to a statistically significant increase in performance (AUC = 0.85, P < 0.001). A combined, feature-selected model considering all four different breast density measures led to a statistically significant improvement in performance (AUC = 0.86) versus the baseline Gail-BMI model (P < 0.001) but not the Gail-BMI plus area percent density model (P = 0.64). In this combined model, absolute dense area was retained as a significant predictor after feature-selection (P < 0.001); volume percent density was also retained by the feature selection process as it approached significance (P = 0.06).
Additional file 1: Table S1 and Additional file 2: Table S2 provide the full univariate logistic regression tables for absolute area, absolute volume, VD %, and BI-RADS breast density not already included in Tables 6 and 7 after adjustment for the standard Gail risk factors and BMI.
To date, compared with area-based measures of percent density which have been more broadly established as a risk factor, studies evaluating the use of volumetric density measures in breast cancer risk assessment have primarily focused on determining which individual measure is a better predictor of risk and have reported mixed results [19–21, 25, 26]. In this study, we investigated whether different quantitative measures of area and volumetric density are jointly and independently associated with breast cancer. Our results suggest that these novel, fully automated breast density measures may ultimately provide complementary information regarding breast cancer risk relative to both Gail risk factors and BMI. We also found that the strongest associations were obtained when absolute dense area, volume percent density, Gail risk factors, and BMI were considered in combination (AUC = 0.86, Table 7) and that this model yielded a statistically significant increase in discriminatory capacity over a model considering only the standard Gail risk factors and BMI (AUC = 0.80, P < 0.001). Overall, our study serves as a preliminary evaluation that will guide the design of larger prospective studies that will rigorously evaluate the predictive value of fully automated measures in risk assessment. In addition, our study is the first to evaluate the new, publically available LIBRA software  tool in terms of its association with breast cancer, providing preliminary evidence for its potential utility as an eventual marker of breast cancer risk.
Previous studies have investigated the potential value of breast density in breast cancer risk prediction, primarily using digitized film mammograms [22, 40–42]. Chen et al. found that incorporating percent density estimates into the Gail model leads to a moderate improvement in discriminatory capacity, with an AUC of 0.64 versus a baseline performance of 0.60 AUC without the inclusion of density . Similarly, Tice et al. found that BI-RADS density can lead to a modest improvement in risk prediction (AUC = 0.66–0.68) in a pair of very large studies [41, 42]. However, although these studies have shown potential to improve risk prediction using density, discriminatory accuracy remains limited at the individual level . There are several potential explanations. First, visual estimates of density are known to be highly variable among readers , affecting accuracy and standardization [14, 16]. In addition, most studies have not considered the volumetric amount of dense fibroglandular tissue but rather projection estimates of area percent density .
Studies comparing volumetric estimates of breast density to area-based measures have primarily focused on determining which single type of density measure is a better predictor of risk [20, 21, 25, 26] and have reported mixed results. Most of these studies suggest that increased volume of dense tissue is associated with an increased risk of breast cancer [20, 21, 25]; however, only in the study by Shepherd et al.  were the volumetric estimates of breast density found to be stronger predictors of risk than area-based percent density measures. This lack of concordance between studies may be due to several factors. First, most studies to date have analyzed populations with inherently different characteristics. In addition, most previous studies have quantified density by using digitized film mammograms, which are subject to additional sources of variation due to the digitization process and may require user interaction for obtaining the density estimates.
Although the etiological basis of breast density’s association to risk is not yet fully understood , an additional possibility is that both the total amount of glandular tissue in the breast captured by volumetric measures of breast density as well as the distribution of this tissue within the breast reflected by projection (i.e., area-based) measures of density may capture independent information regarding a woman’s risk for breast cancer. In this way, area and volume density measures could be considered components of the parenchymal pattern originally described visually by Wolfe in the 1970s [16, 45]. Wolfe’s patterns were designed in such a way so as to describe not only the amount of radio-opaque tissue in the breast (i.e., potentially best reflected by measures of volume density) but also its distribution throughout the breast by way of the ductal structures (i.e., potentially best reflected by measures of area density). This could, in turn, support our observation that both volumetric and area-based measures of density may be associated with breast cancer risk. For example, Fig. 4 shows a mammogram for which the volume percent density and area percent density are roughly equivalent in magnitude. In contrast, Fig. 5 shows an example which has a relatively lower volumetric density but higher area percent density. Overall, this may suggest that area and volume density could reflect different aspects of a woman’s breast density and parenchymal pattern, with volumetric density measures reflecting the total amount of dense tissue and area-based density being indicative of the extent of the distribution of the dense tissue within the breast, with an increase in either suggesting increased risk. Further investigation in future prospective studies of the role that different density measures might have in risk assessment may be worthwhile.
In our study, the model fit using only standard risk factors had an AUC of 0.64, which is in range of the 0.58 to 0.67 commonly reported in the literature for models based only on demographic risk factors [11, 21, 41]. Standard area percent density, together with Gail risk factors, had an AUC of 0.68 (95 % CI 0.62-0.74), similar to the 0.64-0.66 range often reported for models incorporating mammographic percent density [17, 21, 40, 42]. Shepherd et al. recently reported that adding percent dense tissue area to a fully adjusted model with fibroglandular tissue volume modestly increased AUC from 0.65 to 0.67 . Although it is not directly comparable, we show that an augmented model, which includes both area and volume density, has an appreciably higher performance (AUC = 0.77; P < 0.05), which is further enhanced when also adjusting for BMI (AUC = 0.86; P < 0.05). The improved performance in our study may be partially due to the use of digital mammography and the use of fully automated measures of density, allowing more precise estimates, potentially alleviating the bias introduced by intra-reader variability in manual assessment  or the digitization of screen-film mammograms or both.
It is worth noting that volumetric breast density methods which estimate breast density from two-dimensional (2D) mammography, such as the one used in this work, do not directly measure the “true” volume of the dense fibroglandular tissue in the breast but rather a surrogate estimate based on imaging physics and validated assumptions of the breast anatomy . Recent work by Wang et al. suggests that volumetric breast density estimates made from 2D mammograms correlate strongly with estimates made from true three-dimensional (3D) images, such as those acquired via MRI , although the potential impact this may have on risk assessment has yet to be evaluated. Furthermore, given the increasing interest in the adoption of 3D imaging modalities as a primary screening tool, such as breast tomosynthesis , true 3D breast density assessment may soon be feasible for the general screening population. As such, future work should look toward the development and validation of automated breast density assessment tools for 3D screening modalities.
In our study, we found that BMI has a negative correlation to both area and volume percent density (ρ = −0.32 to −0.16) and positive correlations to absolute dense area (ρ = 0.10) and absolute dense volume (ρ = 0.42), which are similar to what has been seen in prior work . Prior studies have also shown that adjusting breast density measures for BMI and other known risk factors can modify the strength of association between density and cancer risk [15, 18, 50]. Specifically, we found that adjusting our univariate models for either Gail risk factors alone (Table 4) or in combination with BMI (Table 5) strengthens the individual associations between most of the fully automated breast density measures and breast cancer. The association between absolute dense area and breast cancer was largely uninfluenced by the inclusion of BMI. Only in the case of absolute dense volume did the inclusion of BMI lead to an attenuated, though still statistically significant, association with breast cancer, likely due to the positive correlation (ρ = 0.42) between the two metrics leading to an overestimation bias. Furthermore, the magnitude of the association observed for BMI in our study was found to be larger than what may be expected on the basis of prior literature . One potential explanation is that our study includes a large fraction of non-Caucasian women, especially African-American (approximately 26 %), which may play a role in our findings as the association between BMI and breast cancer varies by menopausal status, race, and the breast cancer subtype which develops . Larger studies will be needed in order to fully validate the LIBRA density estimates as an independent breast cancer risk factor.
Although there appear to be significant differences between the individual breast density estimates (Table 3), we observed that, as additional risk factors are considered, the predictive capacity of the different models begins to converge (Tables 4 and 5). This is likely due in part to the fact that the different density measures are partly correlated to each other (e.g., the strongest observed correlation being ρ = 0.73 between area percent density and absolute dense area). Furthermore, a common set of risk factors are used to adjust the models reported in Tables 4 and 5. As a result, the various risk factors are expected to potentially capture some similar information about risk which leads to converging AUC scores. However, the fact that the breast density measures reach statistical significance in the logistic regression models adjusted for the standard risk factors and BMI suggests that they also capture some independent information about breast cancer risk. Larger studies are needed in order to fully clarify how breast density should be incorporated into breast cancer risk prediction models in a way that potentially maximizes this independent information.
Pepe et al. proposed five phases for identifying and validating predictive biomarkers , in which phases 1 and 2 consist of retrospective analysis to determine the biomarker’s capacity to distinguish between individuals with and without the outcome of interest. In this setting, demonstrating strong associations between a biomarker and the outcome of interest (here, breast cancer), after adjustment for potential confounders, is the strongest evidence that a risk model would ultimately benefit from its inclusion . Therefore, our intention was to perform a preliminary association analysis, with the goal of identifying promising predictors from an array of different novel quantitative measures of breast density which could ultimately have value for breast cancer risk assessment. As such, it is worth noting that our dataset includes a wide spectrum of incident breast cancers, being a representative sample of the general population of women diagnosed with breast cancer.
Limitations of our study include that our analysis is confined to a relatively small sample size and the use of a case–control study design, in which we used contralateral mammograms at the time of diagnosis, rather than prospective follow-up. Of note, certain risk factors known to be associated with breast cancer were not found to be significant in our study, specifically family history, prior biopsy count, and BI-RADS breast density. This is likely because our study was underpowered to reliably detect subtle differences between cases and controls for these measures. Furthermore, it is known that the matching process in case–control studies may introduce biases in assessing biomarker performance  because the matching process leads to a skewed distribution of the considered covariates in the study sample relative to the general population . Therefore, the AUCs in our study should be interpreted within the context of the age-matched study design, especially given the individual discriminatory capacity of the BMI risk factor. The AUC comparisons performed in this study must also be considered in the context of our study’s sample size as the sample size required to measure an ROC area difference between two models depends on the correlation of ROC areas for the comparison being made. This may in part explain why the quantitative breast density measures were statistically significant in the logistic regression models, but the increases in AUC of some of the density models were not found to be statistically significant when compared with the baseline risk factor models. As such, our observations will also need to be validated prospectively in larger, independent populations with appropriate adjustment for additional confounders. In addition, although we investigated the association of breast density estimates by using mammograms acquired from a single vendor, additional mammography vendors use different full-field digital mammography technology and will also need to be evaluated with the LIBRA software in order to validate its generalizability. Ultimately, fully automated measures could alleviate the subjectivity in density assessment by visual assessment and provide objective quantitative measures for clinical reporting and guiding personalized screening recommendations.
We demonstrate that novel fully automated area and volumetric-based breast density measures assessed via digital mammography are associated with breast cancer after adjustment for standard risk factors, such as Gail factors and BMI. These quantitative measures, including volumetric and absolute fibroglandular tissue estimates, could ultimately improve breast cancer risk prediction by providing additional information regarding a woman’s risk for breast cancer, compared with standard risk factors alone. In addition, the ability to fully automate density estimation with digital mammography, particularly through the use of publically available breast density estimation software, could accelerate the translation of density reporting in routine breast cancer screening and surveillance protocols. As such, our observations will be instrumental in guiding the design of larger prospective studies that will more rigorously validate the predictive value of such new fully automated, quantitative, breast density measures in larger populations.
Area under the curve
Breast Imaging-Reporting and Data System
Body mass index
Laboratory for Individualized Breast Radiodensity Assessment
- PD %:
Area percent density
Receiver operating characteristic
- VD %:
Volume percent density
Kerlikowske K. Evidence-based breast cancer prevention: the importance of individual risk. Ann Intern Med. 2009;151:750–2.
Gail MH. Personalized estimates of breast cancer risk in clinical practice and public health. Stat Med. 2011;30:1090–104.
Kelsey JL, Gammon MD, John EM. Reproductive factors and breast cancer. Epidemiol Rev. 1993;15:36–47.
Pharoah PD, Day NE, Duffy S, Easton DF, Ponder BA. Family history and the risk of breast cancer: a systematic review and meta-analysis. Int J Cancer. 1997;71:800–9.
Van den Brandt PA, Spiegelman D, Yaun S-S, Adami H-O, Beeson L, Folsom AR, et al. Pooled analysis of prospective cohort studies on height, weight, and breast cancer risk. Am J Epidemiol. 2000;152:514–27.
Easton DF, Ford D, Bishop DT. Breast and ovarian cancer incidence in BRCA1-mutation carriers. Breast Cancer Linkage Consortium. Am J Hum Genet. 1995;56:265–71.
Amir E, Freedman OC, Seruga B, Evans DG. Assessing women at high risk of breast cancer: a review of risk assessment models. J Natl Cancer Inst. 2010;102:680–91.
Gail MH, Brinton LA, Byar DP, Corle DK, Green SB, Schairer C, et al. Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst. 1989;81:1879–86.
Gail MH, Costantino JP, Pee D, Bondy M, Newman L, Selvan M, et al. Projecting individualized absolute invasive breast cancer risk in African American women. J Natl Cancer Inst. 2007;99:1782–92.
Matsuno RK, Costantino JP, Ziegler RG, Anderson GL, Li H, Pee D, et al. Projecting individualized absolute invasive breast cancer risk in Asian and Pacific Islander American women. J Natl Cancer Inst. 2011;103:951–61.
Rockhill B, Spiegelman D, Byrne C, Hunter DJ, Colditz GA. Validation of the Gail et al. model of breast cancer risk prediction and implications for chemoprevention. J Natl Cancer Inst. 2001;93:358–66.
Boyd NF, Lockwood GA, Byng JW, Tritchler DL, Yaffe MJ. Mammographic densities and breast cancer risk. Cancer Epidemiol Biomarkers Prev. 1998;7:1133–44.
D’Orsi CJ, Bassett LW, Berg WA, Feig SA, Jackson VP, Kopans DB. Breast imaging reporting and data system: ACR BI-RADS, Mammography. 4th ed. American College of Radiology: Reston, VA; 2003.
Boyd NF, Guo H, Martin LJ, Sun L, Stone J, Fishell E, et al. Mammographic density and the risk and detection of breast cancer. N Engl J Med. 2007;356:227–36.
Vacek PM, Geller BM. A prospective study of breast cancer risk using routine mammographic breast density measurements. Cancer Epidemiol Biomarkers Prev. 2004;13:715–22.
Harvey JA, Bovbjerg VE. Quantitative assessment of mammographic breast density: relationship with breast cancer risk. Radiology. 2004;230:29–41.
Vachon CM, Brandt KR, Ghosh K, Scott CG, Maloney SD, Carston MJ, et al. Mammographic breast density as a general marker of breast cancer risk. Cancer Epidemiol Biomarkers Prev. 2007;16:43–9.
McCormack VA, dos Santos SI. Breast density and parenchymal patterns as markers of breast cancer risk: a meta-analysis. Cancer Epidemiol Biomarkers Prev. 2006;15:1159–69.
Keller B, Conant E, Oh H, Kontos D. Breast cancer risk prediction via area and volumetric estimates of breast density. In: Maidment ADA, Bakic PR, Gavenonis S, editors. 11th International Workshop on Breast Imaging (IWDM), Lecture Notes in Computer Science (LNCS), vol. 7361. Berlin Heidelberg: Springer-Verlag; 2012. p. 236–43.
Ding J, Warren R, Warsi I, Day N, Thompson D, Brady M, et al. Evaluating the effectiveness of using standard mammogram form to predict breast cancer risk: case–control study. Cancer Epidemiol Biomarkers Prev. 2008;17:1074–81.
Shepherd JA, Kerlikowske K, Ma L, Duewer F, Fan B, Wang J, et al. Volume of mammographic density and risk of breast cancer. Cancer Epidemiol Biomarkers Prev. 2011;20:1473–82.
Nickson C, Arzhaeva Y, Aitken Z, Elgindy T, Buckley M, Li M, et al. AutoDensity: an automated method to measure mammographic breast density that predicts breast cancer risk and screening outcomes. Breast Cancer Res. 2013;15:R80.
Li J, Szekely L, Eriksson L, Heddson B, Sundbom A, Czene K, et al. High-throughput mammographic-density measurement: a tool for risk prediction of breast cancer. Breast Cancer Res. 2012;14:R114.
Heine JJ, Cao K, Rollison DE. Calibrated measures for breast density estimation. Acad Radiol. 2011;18:547–55.
Boyd N, Martin L, Gunasekara A, Melnichouk O, Maudsley G, Peressotti C, et al. Mammographic density and breast cancer risk: evaluation of a novel method of measuring breast tissue volumes. Cancer Epidemiol Biomarkers Prev. 2009;18:1754–62.
Aitken Z, McCormack VA, Highnam RP, Martin L, Gunasekara A, Melnichouk O, et al. Screen-film mammographic density and breast cancer risk: a comparison of the volumetric standard mammogram form and the interactive threshold measurement methods. Cancer Epidemiol Biomarkers Prev. 2010;19:418–28.
Kopans DB. Basic physics and doubts about relationship between mammographically determined tissue density and breast cancer risk. Radiology. 2008;246:348–53.
Jeffreys M, Harvey J, Highnam R. Comparing a new volumetric breast density method (VolparaTM) to cumulus. In: Digital Mammography. Heidelberg, Germany: Springer; 2010. p. 408–13.
Ciatto S, Bernardi D, Calabrese M, Durando M, Gentilini MA, Mariscotti G, et al. A first evaluation of breast radiological density assessment by QUANTRA software as compared to visual classification. Breast. 2012;21:503–6.
Pepe MS, Kerr KF, Longton G, Wang Z. Testing for improvement in prediction model performance. Stat Med. 2013;32:1467–82.
Center for Biomedical Image Computing and Analytics. Laboratory for Individualized Breast Radiodensity Assessment (LIBRA) homepage. https://www.cbica.upenn.edu/sbia/software/LIBRA/index.html. Accessed date: August 19, 2015
Keller BM, Nathan DL, Wang Y, Zheng Y, Gee JC, Conant EF, et al. Estimation of breast percent density in raw and processed full field digital mammography images via adaptive fuzzy c-means clustering and support vector machine segmentation. Med Phys. 2012;39:4903–17.
Byng JW, Boyd NF, Fishell E, Jong RA, Yaffe MJ. The quantitative analysis of mammographic densities. Phys Med Biol. 1994;39:1629–38.
Highnam R, Jeffreys M, McCormack V, Warren R, Davey Smith G, Brady M. Comparing measurements of breast density. Phys Med Biol. 2007;52:5881–95.
Hartman K, Highnam R, Warren R, Jackson V. Volumetric Assessment of Breast Tissue Composition from FFDM Images. In: Krupinski EA, editor. 9th International Workshop on Digital Mammography (IWDM), Lecture Notes in Computer Science (LNCS), vol. 5116. Berlin Heidelberg: Springer-Verlag; 2008. p. 33–9.
Rubin DB. Inference and missing data. Biometrika. 1976;63:581–92.
DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–45.
Draper N, Smith H. Applied Regression Analysis (Wiley Series in Probability and Statistics). New York: Wiley-Interscience; 1998.
Saeys Y, Inza I, Larrañaga P. A review of feature selection techniques in bioinformatics. Bioinformatics. 2007;23:2507–17.
Chen J, Pee D, Ayyagari R, Graubard B, Schairer C, Byrne C, et al. Projecting absolute invasive breast cancer risk in white women with a model that includes mammographic density. J Natl Cancer Inst. 2006;98:1215–26.
Tice JA, Cummings SR, Ziv E, Kerlikowske K. Mammographic breast density and the Gail model for breast cancer risk prediction in a screening population. Breast Cancer Res Treat. 2005;94:115–22.
Tice JA, Cummings SR, Smith-Bindman R, Ichikawa L, Barlow WE, Kerlikowske K. Using clinical factors and mammographic breast density to estimate breast cancer risk: development and validation of a new predictive model. Ann Intern Med. 2008;148:337–47.
Ooms EA, Zonderland HM, Eijkemans MJ, Kriege M, Mahdavian Delavary B, Burger CW, et al. Mammography: interobserver variability in breast density assessment. Breast. 2007;16:568–76.
Vachon CM, Scott CG, Fasching PA, Hall P, Tamimi RM, Li J, et al. Common breast cancer susceptibility variants in LSP1 and RAD51L1 are associated with mammographic density measures that predict breast cancer risk. Cancer Epidemiol Biomarkers Prev. 2012;21:1156–66.
Wolfe JN. Breast patterns as an index of risk for developing breast cancer. AJR Am J Roentgenol. 1976;126:1130–7.
Keller BM, Nathan DL, Gavenonis SC, Chen J, Conant EF, Kontos D. Reader variability in breast density estimation from full-field digital mammograms: the effect of image postprocessing on relative and absolute measures. Acad Radiol. 2013;20:560–8.
Yaffe MJ, Boone JM, Packard N, Alonzo-Proulx O, Huang SY, Peressotti CL, et al. The myth of the 50–50 breast. Med Phys. 2009;36:5437–43.
Wang J, Azziz A, Fan B, Malkov S, Klifa C, Newitt D, et al. Agreement of mammographic measures of volumetric breast density to MRI. PLoS One. 2013;8:e81653.
Friedewald SM, Rafferty EA, Rose SL, Durand MA, Plecha DM, Greenberg JS, et al. Breast cancer screening using tomosynthesis in combination with digital mammography. JAMA. 2014;311:2499–507.
Boyd NF, Martin LJ, Sun L, Guo H, Chiarelli A, Hislop G, et al. Body size, mammographic density, and breast cancer risk. Cancer Epidemiol Biomarkers Prev. 2006;15:2086–92.
Munsell MF, Sprague BL, Berry DA, Chisholm G, Trentham-Dietz A. Body mass index and breast cancer risk according to postmenopausal estrogen-progestin use and hormone receptor status. Epidemiol Rev. 2014;36:114–36.
Berstad P, Coates RJ, Bernstein L, Folger SG, Malone KE, Marchbanks PA, et al. A case–control study of body mass index and breast cancer risk in white and African-American women. Cancer Epidemiol Biomarkers Prev. 2010;19:1532–44.
Pepe MS, Etzioni R, Feng Z, Potter JD, Thompson ML, Thornquist M, et al. Phases of biomarker development for early detection of cancer. J Natl Cancer Inst. 2001;93:1054–61.
Pepe MS, Fan J, Seymour CW, Li C, Huang Y, Feng Z. Biases introduced by choosing controls to match risk factors of cases in biomarker research. Clin Chem. 2012;58:1242–51.
This work was supported in part by the American Cancer Society with a Research Scholar Grant (RSGHP-CPHPS-119586) and the National Institutes of Health/National Cancer Institute with a Population-Based Research Optimizing Screening through Personalized Regimens (PROSPR) Network Grant (1U54CA163313-01). The authors thank Anne Marie McCarthy (University of Pennsylvania) for useful discussions. The LIBRA software package used in this study is publicly available for download from the University of Pennsylvania Center for Biomedical Image Computing and Analytics at .
BMK, JC, and DD declare that they have no competing interests. EFC serves on the scientific advisory board of Hologic Inc. and is clinical reader for Image Matrix (Philadelphia, PA, USA). DK has previously received a travel honorarium from Hologic Inc.
BMK participated in the conception and design of the study, acquisition of data, breast density computation and statistical analysis, and drafting the manuscript. JC participated in the design of the study and in statistical analysis and interpretation of the data and revised the manuscript for important intellectual content. DD participated in the acquisition of data and in drafting the manuscript. EFC participated in the design of the study and in analysis and interpretation of data and revised the manuscript for important intellectual content. DK participated in the conception and design of the study, analysis and interpretation of data, and drafting the manuscript. All authors have read and approved the final manuscript and agree to be accountable for all aspects of the work.
Univariate logistic regression tables for absolute area, absolute volume, VD %, and BI-RADS breast density adjusted for standard risk factors. BI-RADS Breast Imaging-Reporting and Data System, LIBRA Laboratory for Individualized Breast Radiodensity Assessment, N/A not applicable, VD % volume percent density. (PDF 207 kb)
Univariate logistic regression tables for absolute area, absolute volume, VD %, and BI-RADS breast density adjusted for both standard risk factors and BMI. BI-RADS Breast Imaging-Reporting and Data System, BMI body mass index, LIBRA Laboratory for Individualized Breast Radiodensity Assessment, N/A not applicable, VD % volume percent density. (PDF 213 kb)
About this article
Cite this article
Keller, B.M., Chen, J., Daye, D. et al. Preliminary evaluation of the publicly available Laboratory for Breast Radiodensity Assessment (LIBRA) software tool: comparison of fully automated area and volumetric density measures in a case–control study with digital mammography. Breast Cancer Res 17, 117 (2015). https://doi.org/10.1186/s13058-015-0626-8
- Breast Density
- Digital Mammography
- Percent Density
- Discriminatory Capacity
- Gail Model