Inter-rater reliability of programmed death ligand 1 (PD-L1) scoring using the VENTANA PD-L1 (SP263) assay in Non-Small-Cell-Lung Cancer (NSCLC)

Date 20 October 2018
Event ESMO 2018 Congress
Session Poster display session: Biomarkers, Gynaecological cancers, Haematological malignancies, Immunotherapy of cancer, New diagnostic tools, NSCLC - early stage, locally advanced & metastatic, SCLC, Thoracic malignancies, Translational research
Topics Tumour Immunology
Presenter Gareth Williams
Citation Annals of Oncology (2018) 29 (suppl_8): viii14-viii57. 10.1093/annonc/mdy269
Authors G.H. Williams1, A.G. Nicholson2, D.R.J. Snead3, E. Thunnissen4, S. Lantuejoul5, P. Cane6, K.M. Kerr7, M. Loddo1, M. Scott8, P.W. Scorer9, C. Barker9
  • 1Oncologica Uk Ltd., ,, CB10 1XL - Cambridge/GB
  • 2Dept. Of Histopathology, Royal Brompton and Harefield NHS Foundation Trust, and National Heart and Lung Institute, Imperial College, SW3 6LY - London/GB
  • 3Dept. Of Pathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry/GB
  • 4Dept. Of Pathology, VU University Medical Center, 1081 HV - Amsterdam/NL
  • 5Department Of Biopathology, Centre Léon Bérard UNICANCER and Grenoble Alpes University, 69008 - Lyon/FR
  • 6Department Of Histopathology, Guy's and St Thomas' NHS Foundation Trust, SE1 7EH - London/GB
  • 7Dept. Of Pathology, Aberdeen University Medical School and Aberdeen Royal Infirmary, AB25 2ZN - Aberdeen/GB
  • 8Precision Medicine Laboratories, Precision Medicine And Genomics, Imed Biotech Unit, AstraZeneca, CB4 0FZ - Cambridge/GB
  • 9Precision Medicine Laboratories, Precision Medicine And Genomics, Imed Biotech Unit, AstraZeneca, Milton Road - Cambridge/GB



The VENTANA PD-L1 (SP263) assay has been developed as a companion diagnostic for anti-PD-L1 immune checkpoint inhibitors. Here we investigate assay inter-rater reliability, applied to PD-L1 scoring of tumour cells (TCs) and immune cell (IC) infiltrates in NSCLC.


Six expert European pulmonary pathologists independently scored 200 NSCLC samples stained using the VENTANA PD-L1 (SP263) assay. Archival, commercially-sourced formalin-fixed paraffin-embedded resections were selected to represent the dynamic range of PD-L1 expression. Each pathologist scored the proportion of TCs expressing PD-L1 (TM score), tumour-associated IC population as a percentage of total tumour area (PIC value), and percentage of ICs expressing PD-L1 (IC score). Scores were analysed using intra-class correlation coefficient (ICC) and patient classification using Fleiss’ Kappa.


Interim results were available for 3 pathologists and 180 cases. TM scoring between pathologists showed strong pair-wise correlations between individuals (R2>0.90) with an ICC >0.95. Pair-wise and overall agreement was ≥85% for TC ≥ 1% and >93% for TC ≥ 20%, TC ≥ 25%, and TC ≥ 50%. Fleiss’ Kappa showed substantial agreement for TC ≥ 1% and excellent agreement for TC ≥ 20%, TC ≥ 25%, and TC ≥ 50%. There were systematic and substantial differences in PIC values and IC scores between pathologists with poor pair-wise correlations. ICC indicated poor reliability for both IC score (0.36) and PIC values (0.044). Fleiss’ Kappa showed poor agreement for IC ≥ 25% (0.183).


Assessment of TM score in NSCLC was highly reproducible using VENTANA PD-L1 (SP263) assay, building confidence in the accuracy of this assay in patient selection for anti-PD-L1 therapy. However, expert pathologists were unable to reproducibly assess IC score in NSCLC suggesting assessment methodology is unreliable for this tumour type and assay. This contrasts with urothelial cancer (UC) in which pathologist agreement for PIC values and IC scores was generated as part of UC VENTANA PD-L1 (SP263) IHC assay CE marking and FDA approval. This difference in pathology of the different tumour types requires further investigation.

Clinical trial identification

Legal entity responsible for the study




Editorial Acknowledgement

Editorial assistance, which was in accordance with Good Publication Practice (GPP3) guidelines, was provided by Kaveri Sidhu, PhD, of Cactus Communications (Mumbai, India).


A.G. Nicholson: Consultant: Abbvie and Oncologica; Educational grant: Pfizer. E. Thunnissen: Corporate sponsored research: Oncologica; Honorarium: Roche Ventana, Histogenex; Advisory boards: Roche. P. Cane: Speaker fees: Pfizer, Roche; Fees for interview: AstraZeneca. K.M. Kerr: Advisory boards: Roche, AstraZeneca, BMS, MSD, Pfizer, Merck Serono, Roche Diagnostics. M. Scott, P.W. Scorer, C. Barker: Employment: AstraZeneca; Stockholder: AstraZeneca. All other authors have declared no conflicts of interest.