Article Text

Short report
Sensitivity and specificity of loss of heterozygosity analysis for the classification of rare germline variants in BRCA1/2: results of the observational AGO-TR1 study (NCT02222883)
  1. Jan Hauke1,2,
  2. Philipp Harter3,
  3. Corinna Ernst1,
  4. Alexander Burges4,
  5. Sandra Schmidt1,
  6. Alexander Reuss5,
  7. Julika Borde1,
  8. Nikolaus De Gregorio6,
  9. Dimo Dietrich7,
  10. Ahmed El-Balat8,
  11. Mohamad Kayali1,
  12. Heidrun Gevensleben9,
  13. Felix Hilpert10,11,
  14. Janine Altmüller12,
  15. André Heimbach13,
  16. Werner Meier14,
  17. Birgid Schoemig-Markiefka15,
  18. Holger Thiele12,
  19. Rainer Kimmig16,
  20. Peter Nürnberg12,17,
  21. Karin Kast18,19,
  22. Lisa Richters1,
  23. Jalid Sehouli20,
  24. Rita K Schmutzler1,
  25. Eric Hahnen1
  1. 1 Center for Familial Breast and Ovarian Cancer, Center for Integrated Oncology (CIO), University Hospital Cologne, Cologne, Nordrhein-Westfalen, Germany
  2. 2 Medical Faculty, University Hospital Cologne, Cologne, Germany
  3. 3 Department of Gynecology and Gynecologic Oncology, Kliniken Essen-Mitte, Essen, Nordrhein-Westfalen, Germany
  4. 4 Department of Gynecology, University Hospital Munich-Großhadern, Munich, Bayern, Germany
  5. 5 Coordinating Center for Clinical Trials, Philipps-University of Marburg, Marburg, Hessen, Germany
  6. 6 Department of Gynecology and Obstetrics, University of Ulm and University Hospital Ulm, Ulm, Baden-Württemberg, Germany
  7. 7 Department of Otolaryngology, Head and Neck Surgery, University Hospital Bonn, Bonn, Nordrhein-Westfalen, Germany
  8. 8 Department of Gynecology, University of Frankfurt, Frankfurt am Main, Hessen, Germany
  9. 9 Institute of Pathology, University Hospital Bonn, Bonn, Nordrhein-Westfalen, Germany
  10. 10 Department of Gynecology, University of Kiel, Kiel, Schleswig-Holstein, Germany
  11. 11 Onkologisches Therapiezentrum, Krankenhaus Jerusalem Hamburg, Hamburg, Germany
  12. 12 Cologne Center for Genomics, University Hospital Cologne, Cologne, Nordrhein-Westfalen, Germany
  13. 13 Institute of Human Genetics, University of Bonn and University Hospital Bonn, Bonn, Nordrhein-Westfalen, Germany
  14. 14 Department of Gynecology and Obstetrics, University Hospital Düsseldorf, Düsseldorf, Nordrhein-Westfalen, Germany
  15. 15 Institute of Pathology, University Hospital Cologne, Cologne, Nordrhein-Westfalen, Germany
  16. 16 Department of Gynecology, University Hospital Essen, Essen, Nordrhein-Westfalen, Germany
  17. 17 Center for Molecular Medicine Cologne (CMMC), University of Cologne, Cologne, Nordrhein-Westfalen, Germany
  18. 18 Department of Gynecology and Obstetrics, University Hospital Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
  19. 19 Center for Familial Breast and Ovarian Cancer and Center for Integrated Oncology (CIO), University Hospital Cologne, Cologne, Germany
  20. 20 Department of Gynecology and Gynecological Oncology, Charité, Berlin, Berlin, Germany
  1. Correspondence to Dr Eric Hahnen, Center for Familial Breast and Ovarian Cancer, University Hospital Cologne, 50931 Cologne, Nordrhein-Westfalen, Germany; eric.hahnen{at}uk-koeln.de

Abstract

Variant-specific loss of heterozygosity (LOH) analyses may be useful to classify BRCA1/2 germline variants of unknown significance (VUS). The sensitivity and specificity of this approach, however, remains unknown. We performed comparative next-generation sequencing analyses of the BRCA1/2 genes using blood-derived and tumour-derived DNA of 488 patients with ovarian cancer enrolled in the observational AGO-TR1 trial (NCT02222883). Overall, 94 pathogenic, 90 benign and 24 VUS were identified in the germline. A significantly increased variant fraction (VF) of a germline variant in the tumour indicates loss of the wild-type allele; a decreased VF indicates loss of the variant allele. We demonstrate that significantly increased VFs predict pathogenicity with high sensitivity (0.84, 95% CI 0.77 to 0.91), poor specificity (0.63, 95% CI 0.53 to 0.73) and poor positive predictive value (PPV; 0.71, 95% CI 0.62 to 0.79). Significantly decreased VFs predict benignity with low sensitivity (0.26, 95% CI 0.17 to 0.35), high specificity (1.0, 95% CI 0.96 to 1.00) and PPV (1.0, 95% CI 0.85 to 1.00). Variant classification based on significantly increased VFs results in an unacceptable proportion of false-positive results. A significantly decreased VF in the tumour may be exploited as a reliable predictor for benignity, with no false-negative result observed. When applying the latter approach, VUS identified in four patients can now be considered benign. Trial registration number NCT02222883.

  • genetic predisposition to disease
  • genetic testing
  • genetic research
  • germ-line mutation
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

In cancer genetics, individual risk stratification and the choice of targeted therapies are increasingly dependent on the germline mutation status in disease-associated genes such as BRCA1 (MIM: 113705) and BRCA2 (MIM: 600185). Thus, the unambiguous classification of germline variants identified in a routine diagnostic setting is vitally important for the clinical management of the individuals seeking advice. Criteria for BRCA1/2 germline variant classification were continuously standardised, in particular through the work of the Evidence-based Network for the Interpretation of Germline Mutant Alleles (ENIGMA), the International Agency for Research on Cancer (IARC) and the American College of Medical Genetics and Genomics (ACMG).1–4 While common BRCA1/2 germline variants with a minor allele frequency (MAF) ≥1% in the general population are considered benign by default, the classification of rare BRCA1/2 germline variants with a MAF <1% remains challenging, especially for those that cannot be predicted protein-truncating based on their mutation type. For intronic and missense variants, the multifactorial likelihood analysis demonstrated utility for quantitative assessment of variant pathogenicity, a model based on variant location, in silico prediction of variant effect, cosegregation, family cancer history, co-occurrence with a pathogenic variant in the same gene, tumour pathology and case–control information.3 The multifactorial likelihood analysis, however, requires input data that may not be available for all rare BRCA1/2 germline variants.

In tumours with a hereditary disease cause, it is generally suggested that the heterozygous germline inactivation of a predisposition gene may be accompanied by a somatic inactivation of the wild-type allele by another deleterious variant, loss of the wild-type allele or promoter methylation.5 In 473 patients with ovarian cancer (OC (MIM: 167 000)) enrolled in the observational AGO-TR1 trial, we demonstrated that pathogenic germline variants in the BRCA1/2 genes very rarely associate with deleterious somatic variants or promoter methylation.6 In OC, more than 80% of the pathogenic BRCA1/2 germline variants showed significantly increased proportion of reads that support the variant allele (variant allele fractions (VFs)) in the tumour-derived versus blood-derived DNA, indicating loss of the wild-type alleles.6–8 Based on these findings, it was suggested that loss of heterozygosity (LOH) analyses might be useful to classify rare germline variants in the BRCA1/2 genes.9 10 For rare germline variants in (candidate) cancer predisposition genes showing significantly increased VFs in the tumour, a potential role in cancer susceptibility was frequently suggested, as for example in the analyses of 429 patients with OC included in The Cancer Genome Atlas (TCGA) project.7 However, sensitivity along with specificity of LOH analyses for germline variant classification was not assessed so far. Thus, our study aims to quantify the sensitivity and the specificity of LOH analyses and their potential benefit for the classification of rare BRCA1/2 germline variants in a well-characterised study sample of 488 patients with OC enrolled in the observational AGO-TR1 trial (NCT02222883).

Methods

Study sample

A total of 523 consecutive patients with invasive epithelial OC were enrolled. All patients were older than 18 years at study inclusion and provided written informed consent prior to enrolment. Venous blood samples were available from all 523 patients and formalin-fixed paraffin-embedded (FFPE) tumour samples were available from 496 patients. Genomic DNA was isolated from blood samples and from FFPE tumour samples as described previously.6 Briefly, for the isolation of DNA from FFPE tumour samples, H&E-stained 3 µm tissue sections were centrally investigated (Institute of Pathology, University Hospital Bonn, Bonn, Germany); that is, tumour areas containing >80% tumour nuclei were chosen for DNA isolation (see online supplemental materials and methods for details).

Supplemental material

Next-generation sequencing (NGS)

Targeted NGS of blood and tumour samples of 496 patients was performed using a customised gene panel covering the coding regions and exon-flanking sequences (±15 nt) of the BRCA1 (NM_007294.3) and BRCA2 (NM_000059.3) genes.6 The hybridisation capture-based NGS method (Agilent SureSelect XT protocol optimised for 200 ng of genomic DNA) was suitable for the analysis of DNA derived from either blood or FFPE tumour samples. Sequencing was performed on a HiSeq4000 device (Illumina, San Diego, California, USA). NGS analyses with a mean read coverage of at least 100× were considered successful. NGS data derived from both blood and corresponding FFPE tumour samples of 488 individuals achieved this threshold. The clinical characteristics of the 488 individuals were described in the online supplemental table 1. For the 488 individuals included, the mean read coverage was 455× (range 171×–882×) for NGS of blood-derived DNA and 570× (range 110×–1802×) for tumour-derived DNA. Bioinformatic analyses, including variant calling, were carried out using the VARBANK V.2.10–2.24 pipeline of the Cologne Center for Genomics and the DDM1 platform (Sophia Genetics, Saint-Sulpice, Switzerland).

Germline variant classification

We employed criteria based on the ENIGMA and ACMG Guidelines for variant classification.4 Rare variants were defined as variants with a MAF <1% in large outbred control reference groups. Common variants with a MAF above this threshold were generally considered benign and excluded from this investigation. All rare variants in splice regions and non-synonymous single-nucleotide/indel variants were included in this investigation. CNVs were not considered. To determine MAFs, we used Exome Aggregation Consortium (ExAC)11 data of individuals of European, non-Finnish ancestry, excluding samples from TCGA. All rare BRCA1/2 germline variants were classified using a five-tier variant classification system as proposed by the IARC Unclassified Genetic Variants Working Group,12 namely, pathogenic=class 5, likely pathogenic=class 4, variant of uncertain significance (VUS)=class 3, likely benign=class 2 and benign=class 1. For reasons of clarity, class 4/5 are referred to as pathogenic variants and class 1/2 variants as benign variants in the following.

LOH analysis

VFs were derived from VARBANK VCF files by division of the number of reads showing the variant allele and the observed read depth. Fold changes, that is, the ratio of tumour and blood VFs, were computed for each rare germline variant. Fisher’s exact test was applied to assess the significance level of deviating proportions of reads showing a variant allele between blood and tumour sample, with p values <0.05 after correction for multiple testing using the Benjamini-Hochberg approach13 considered significant. A significantly increased VF of a variant in the tumour suggests loss of the wild-type allele. A significantly decreased VF of a variant in the tumour suggests loss of the variant allele. Statistical analyses were performed using SPSS Statistics V.25 and the epiR-Package under R V.3.6.2.

Results

Germline analysis revealed 208 rare variants in 181 of the 488 patients (37.1%). One hundred and fifty-seven patients carried one (32.2%), 21 carried two (4.3%) and 3 patients carried three rare germline variants (0.6%) (online supplemental figure 1A). Of the 208 rare variants, 94 were pathogenic (class 4/5), 90 were benign (class 1/2) and 24 were of unknown significance (VUS, class 3). The combined BRCA1/2 genotypes of the 181 patients with rare variants are illustrated in online supplemental figure 1B). All rare variants were listed in the online supplemental table 2).

All rare germline variants were also detected in the corresponding tumour samples. Of the 94 pathogenic germline variants, 79 (84.0%) showed significantly increased VF in the tumour suggesting loss of the wild-type alleles, with fold changes ranging from 1.15 to 2.05 (figure 1, online supplemental table 2). The VF differences of the remaining 15 class 4/5 variants (16%) were statistically not significant with fold changes ranging from 0.85 to 1.13. Of note, none of the class 4/5 variants showed a significantly decreased VF in the tumour. Of the 90 class 1/2 variants, 33 (36.7%) showed significantly increased VFs in the tumour with fold changes ranging from 1.22 to 2.02, 34 showed non-significant differences (37.8%, fold changes ranging from 0.87 to 1.16) and for the remaining 23 variants, VFs were significantly decreased in tumour samples (25.6%, fold changes ranging from 0.06 to 0.84) (figure 1, online supplemental table 2).

Variant classification based on significantly increased VFs shows a high sensitivity of 0.84 (95% CI 0.77 to 0.91), but a poor specificity of 0.63 (95% CI 0.53 to 0.73) and a poor positive predictive value (PPV) of 0.71 (95% CI 0.62 to 0.79). For this approach, the positive likelihood ratio (LR+) for pathogenicity is 2.29 (95% CI 1.72 to 3.05). Briefly, variant classification based on significantly increased VFs is hampered by the random distribution of VFs observed for benign variants. At least in a routine diagnostic setting, classification of rare BRCA1/2 germline variants may not be based on significantly increased VFs due to an unacceptable proportion of false-positive results.

As an alternative approach, a significantly decreased VF of a variant in the tumour, suggesting loss of the variant allele, may be useful to classify a rare BRCA1/2 germline variant as benign. Significantly decreased VFs were specific for benign variants and were not observed for pathogenic germline variants (figure 1). Of the benign variants observed in 90 patients, 17 were recurrent and found at least twice in the sample set. For most of the recurrent benign variants, we found a high variability of fold changes, occasionally ranging from a significant decrease to a significant increase (figure 2). Classification of benign BRCA1/2 germline variants based on significantly decreased VFs results in a low sensitivity of 0.26 (95% CI 0.17 to 0.35) but a high specificity of 1.0 (95% CI 0.96 to 1.00) and a high PPV of 1.0 (95% CI 0.85 to 1.00). For this approach, the LR+ for benignity was 49.07 (95% CI 3.02 to 795.93) after Haldane-Anscombe correction (online supplemental table 3). A significantly decreased VF of a variant in the tumour may be exploited as a reliable predictor for benignity, with no false-negative result observed. This also holds true when analysis were performed for both genes separately (figure 1, online supplemental table 3). When applying this approach to the 24 VUS identified in our study sample, three distinct VUS found in four patients, that is, BRCA1 p.(Val525Ile), BRCA1 p.(Asp1152Asn) and BRCA2 p.(Lys2498del), may be considered benign (figure 2).

Figure 1

Fold change of VF between blood-derived and tumour-derived DNA observed for 208 class 4/5, class 3 and class 1/2 germline variants in the BRCA1/2 genes observed in the overall study sample. Significant differences in VFs between blood-derived and tumour-derived DNA were indicated by orange dots. Non-significant differences in VFs between blood-derived and tumour-derived DNA were indicated by blue dots. VFs, variant fraction.

Figure 2

Fold change of VF observed for 31 recurrent class 4/5, class 3 and class 1/2 germline variants in the BRCA1/2 genes observed in the overall study sample. Significant differences in VFs between blood-derived and tumour-derived DNA were indicated by orange dots. Non-significant differences in VFs between blood-derived and tumour-derived DNA were indicated by blue dots. VFs, variant fractions.

Discussion

It was controversially discussed whether the results of LOH analyses may be useful for the classification of rare BRCA1/2 germline variants.7–10 14–18 Information from LOH analyses has not been implemented in the current ENIGMA variant classification system3 19 based on the previously published data16 suggesting that LOH analyses are not sufficiently reliable. Using paired analyses of blood-derived and tumour-derived DNA, we demonstrated that rare germline variants in the BRCA1/2 genes might be classified benign based on significantly decreased VFs in the tumour. This approach reached a specificity of 1.0 (95% CI 0.96 to 1.00), a PPV of 1.0 (95% CI 0.85 to 1.00) and a LR+ of 49.07 (95% CI 3.02 to 795.93). Given the fact that changes in VFs of benign variants occur randomly (figure 2), this approach shows a limited sensitivity of only 0.26 (95% CI 0.17 to 0.36). As of March 2020, more than 6.100 distinct BRCA1/2 germline VUS were listed in the ClinVar database, indicating the need for additional sources for the classification of BRCA1/2 germline variants. We suggest that large-scale comparative germline/tumour NGS analyses with sufficient read depths may significantly reduce the number of VUS, especially for VUS for which data regarding cosegregation, family cancer history, co-occurrence with a pathogenic variant in the same gene and case–control information are not available.3

Limitations of the study

In the overall study sample of patients with OC enrolled in the observational AGO-TR1 study, pathogenic germline mutations in non-BRCA1/2 OC predisposition genes such as RAD51C/D and BRIP1 were observed. However, the prevalence of pathogenic germline mutations in these genes was too low to perform meaningful calculations. Larger studies are required to quantify the sensitivity and the specificity of LOH analyses for the classification of rare germline mutations in additional OC predisposition genes. Moreover, this investigation was focused on patients with OC and FFPE samples with a high tumour content. It remains elusive to which extent our approach may be transferred to breast tumour analyses that are usually associated with lower BRCA1/2 LOH rates20 and probably lower tumour contents in FFPE samples.

Ethics statements

Patient consent for publication

Acknowledgments

We would like to thank AstraZeneca Germany for the support of the trial.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • JH and PH contributed equally.

  • Contributors JH and PH contributed equally to this work; and study concept and design: JH, PH, RKS and EH; acquisition, analysis and interpretation of data: all authors; drafting the manuscript: JH, CE and EH; critical revision of the manuscript for important intellectual content: all authors; accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved: all authors; final approval of the submitted manuscript: all authors; obtained funding: PH; study supervision: PH, RKS and EH; administrative, technical or material support: all authors.

  • Funding The study was funded by AstraZeneca Germany and the AGO Research GmbH.

  • Competing interests PH: consulting or advisory role: AstraZeneca, Roche/Genentech, Tesaro, Clovis, Pharmamar Lilly and Sotio; research funding: AstraZeneca (Inst); travel, accommodations and expenses: Medac. AB: honoraria: AstraZeneca and Roche; consulting or advisory role: AstraZeneca and Roche. DD is a consultant for AJ Innuscreen GmbH (Berlin, Germany), a 100% daughter company of Analytik Jena AG (Jena, Germany) and receives royalties from product sales (innuCONVERT kits). KK: honoraria: Roche, Pfizer and AstraZeneca. JS: honoraria: AstraZeneca, PharmaMar, Roche and Tesaro; consulting or advisory role: AstraZeneca, Clovis Oncology, Novocure, Roche and Tesaro; research funding: Amgen (Inst), Bayer (Inst), Lilly (Inst) and Novartis (Inst). RKS: honoraria: AstraZeneca; consulting or advisory role: AstraZeneca; research funding: AstraZeneca (Inst); patents, royalties, other intellectual property: University of Cologne. EH: honoraria: AstraZeneca; consulting or advisory role: AstraZeneca; research funding: AstraZeneca (Inst).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.