Invited commentary—<scp>WHO</scp> Classification of Tumours: How should tumors be classified? Expert consensus, systematic reviews or both?

Abstract

The World Health Organization (WHO) Classification of Tumors series, published as the WHO Blue Books (Fig. 1) and the accompanying website, are essential resources for pathologists across the globe, providing the standards against which tumors are classified to aid cancer diagnosis, research, treatment and prognosis. Each book tackles the classifications of up to 300 tumor types, defining for each of these the etiology, pathogenesis, epidemiology, clinical features, macroscopic appearances, histology, cytology, molecular pathology, essential and desirable diagnostic features, staging, prognostic factors and predictive biomarkers. If each tumor were to require one formal review, this would mean finding or conducting up to 3,600 such reviews for each book which would not be practicable or time-efficient. The current approach therefore relies largely on subject experts drawing on published literature searches according to their individually perceived need to inform the content of these books. However, these decisions affect the classification, and hence the diagnosis and management of cancer patients worldwide. Consequently, to minimize the risk of including biased information, the evidence is weighed and decisions made by an editorial board. This editorial board is composed of standing members and content experts (mainly practicing pathologists) who meet, propose, revise and agree on definitions and core criteria for each tumor systematically for every new edition. Over-reliance on expert consensus at editorial board meetings for this purpose may lead to problems (Table 1). First, evidence needs to be reviewed to assess all relevant issues in a WHO Blue Book. But, even if all participating experts are required to perform literature reviews, their different expertise and inevitable time constraints produce variable results with potential for studies that are relevant to decisions to be missed. In the first book of the new 5th edition, up to 130 tumors or subjects were described as “unknown” and 200 labeled as clinically not relevant, this often being the only description of a whole section.1 Sections such as etiology or pathogenesis are frequently summarized as “unknown,” without providing more details, leaving unclear whether an exhaustive search of the literature has been performed. This does not necessarily indicate that systematic reviews should be routinely performed when such questions arise and indeed, it would not be possible for standing members and content experts to do so given the number that would be required. Often the statements requiring evidence are more related to background information than issues relevant to classification, and introducing systematic approaches to the literature searches would not improve the evidence base of the review results. In addition, this would allow authors to focus on the pressing or contentious issues of tumor classification: topics that need to be assessed by systematic reviews, due to their potential controversy. Second, there is a potential risk that unintended bias from content experts could influence decisions in the absence of a structured and controlled process of evidence synthesis. This could lead to certain studies being unduly highlighted or overlooked depending on who is reviewing the literature and what their own clinical or research knowledge may be.2 Third, if the convened expert panel is not sufficiently representative,3 skewed decisions may be made, which may not be fully informed by the best and most relevant evidence.4 Fourth, due to interpersonal and cultural differences among experts during meetings, it is possible for individuals to dominate discussion.3, 5, 6 Finally, previously included but incorrectly referenced evidence may be carried forward during the updating process. Comprehensive searching which is part of systematic reviewing may improve identification of important literature. A structured, systematic process allows summarizing and evaluating complex information such as big data or basic research information provided for molecular pathology. Risk of missing research which does not fit into standard study design framework used for systematic reviews. Publication bias may not be addressed if only searching published evidence. Systematic reviews require clearly stated inclusion criteria, so cherry-picking of particular studies to prove a particular point is easier to spot. In addition, the setting of acceptable evidence levels and assessment of risk of bias of studies avoids the use of inappropriate evidence. Systematic reviews consider each included study equally, unless there is a specific reason why less emphasis should be placed on it such as small sample or poor study quality. Risk of bias assessment of individual studies, but also the body of evidence can be undertaken to aid an appropriate interpretation of the retrieved evidence. Credibility may also be affected by other factors not addressed by a systematic review process. Experts in the field, important to the credibility of the books, may be put-off by the systematic review process. It is possible that these problems could be mitigated by the addition of evidence-based practices to the editorial process. Systematic reviews are widely regarded as the cornerstone of evidence-based medicine, encouraging comprehensive literature searching, transparency in methods and rigorous study appraisal.7 Performing systematic reviews for some tumor types could certainly improve the reliability of decisions taken by the editorial board, but they may not always be the best solution. Systematic reviews require training in methods, as well as expertise.8-10 They can be laborious to complete, time-consuming and difficult to interpret, particularly when there is a lot of evidence, or when the evidence is low-grade. Systematic review methods have been described as being formulaic.11, 12 Best practice guidelines such as Cochrane13 and PRISMA14 are closely aligned with meta-analytic reviews for medical interventions, the methods of which are not necessarily appropriate to pathology. Systematic reviews can be long and unwieldy documents, difficult to interpret and hollow in their conclusions.15, 16 The hierarchy of evidence-based medicine with systematic reviews at the apex has been resisted by some academic groups and clinicians for oversimplifying complex issues relating to clinical care.17 Some argue that clinical judgment based on experience is more exact and applies better to real-life clinical situations, because of its emphasis on individual cases rather than evidence derived from randomized controlled trials (RCTs) that are produced without social and political confounding effects and of other variables.18 While the scientific rigor of systematic reviews and indeed RCTs are preserved through adhering to reporting guidelines, they have been shown to be less readable than article types which allow some spin or journalistic creativity, such as editorials and narrative reviews.19 They are also subject to influence if not conducted objectively and not properly assessed prior to publication.20 Managing the influence and expertise of team members in systematic reviews, like nonsystematic reviews, remains critical to producing reliable and externally valid conclusions.10 Although essential for the synthesis of available scientific evidence in controversial questions, it is clear that systematic review methods would need to be adapted to the specific needs of the WHO Classification of Tumours and its editorial process. Timely procurement of a valid evaluation of evidence is one of the major problems for process-driven systems such as the WHO Classification of Tumours, and this is something that traditional, comprehensive systematic reviews struggle to provide. More succinct review methods including, mapping, rapid or scoping reviews could improve the quality of scientific evidence used to make statements in the WHO Blue Books, without the need for full systematic reviews.21-23 While alternative methods that abbreviate systematic reviews may be appealing, they do increase the risk of bias and errors in the review process and may not always provide the expected results.21, 22, 24 Careful assessment of the need for evidence synthesis may show that a structured expert description of the subject is enough. We believe that full systematic reviews of the available evidence should be limited to the assessment of research questions that directly affect the classification of a tumor, or have major consequences in cancer diagnosis. Nowhere is the need to consider consensus-based versus evidence-based approaches more apparent than in the field of molecular pathology, where research groups may suggest different molecular tumor classifications for the same tumor type. In these instances, evidence synthesis and evaluations to underpin incorporation of molecular advances into the classification will be greatly assisted by the use of the Standards for Reporting Diagnostic Accuracy Studies (STARD),25 Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD)26 and other standardized reporting guidance (www.equator.net). Detail on the rationale and risk underlying each “non-negotiable” are outlined in Table 2. The issue of using validated methods for WHO Classification of Tumours is becoming increasingly important because, due to rapid advances in molecular pathology, more information is becoming evident from closer analysis of tumors than was previously available from histopathological analysis alone. Systematic review methods may need to be adapted to assess this information, as some steps of a validated systematic review process may not meet current need, or simply not add sufficient value to the editorial process. Methods should be clearly stated and previously defined. Inclusion and exclusion criteria stated and applied. A review protocol should be written and made publicly available as an explicit statement of intended methods where deviations to these methods can be noted (with justifications). This ensures accountability by authors and facilitates replication of the review. Conflict of interests of the review team, as well as funding information, needs to be disclosed. Not every decision made in the WHO Classification of Tumours is contentious; many areas may be regarded as close to fact due to strong logic or pathophysiological basis: they can be considered as equivalent of parachutes—known to be efficacious without the need to conduct a RCT.28 However, when issues are debatable or likely to vary depending on context or interpretation then a systematic review may be deemed necessary. An example of this occurs with Kaposi's sarcoma where there is some debate over whether the characteristic tumors can reliably be regarded as neoplasms or as a “reactive” proliferations of cells in response to infections with human herpesvirus-8 (HHV-8).29 Cancerous tumors are commonly regarded to be clonal neoplasms which proliferate uncontrollably, even after the stimulus which evoked the change has been removed,30 Kaposi sarcoma is contentious because there are cases where it does not persist after successful antiretroviral treatment.31 However, reclassification of Kaposi sarcoma could have ramifications for patient diagnosis and care, as well as service delivery and funding for research. In response to this dilemma, a systematic review protocol was designed and registered prospectively by the WHO tumor classification group on the PROSPERO database (CRD42018087595). The review aims to inform and support the decision of the expert panel regarding Kaposi Sarcoma classification using available evidence without restriction by study type. There are challenges for the classification of tumors in evidence-based pathology. Differing evidence levels and considerations are applied within the field of pathology and consensus is needed to promote a comparable assessment of studies. Review methods should allow reliable assessments of evidence in an appropriate time frame and without being systematic review methodologists. Experts who serve as authors and editors require basic training and methodological support in systematic review and literature searching methods. Furthermore, subjects in need of assessment should be registered and prioritized based on the WHO Classification of Tumours requirements and scientific considerations. The WHO Classification of Tumours Group at the International Agency for Research on Cancer (IARC) have set themselves the challenge to revise their procedures to incorporate systematic review methods into the current expert-led approach through the appointment of a systematic reviewer for the Blue Books and by planning an international Joint Action Group. The methods described here aim to start this deliberation and we invite discussion and feedback as to the potential challenges and solutions to the intended “non-negotiables” proposed to ensure the methods for reviewing literature which feed into tumor classification are robust. In conclusion, we believe that an evidence-based approach to informing key decisions that feed into tumor classification would allow editors to mitigate any potential risks of bias and also benefit authors by providing structured, transparent and reliable methods for the synthesis of available evidence for each tumor type. Our hope over time is that this approach will increase the rigor of the decisions feeding into WHO Classification of Tumour, by addressing critical questions and identifying research gaps, as well as reaching recommendations for research to inform future editions. Such an approach will help maintain the reliability of tumor classification, and help to provide solutions to challenges like the exponential rise in number of scientific publications and the need to manage new types of information such as evidence from genetics or big data. Yours sincerely Lesley Uttley Blanca Iciar Indave Chris Hyde Valerie White Dilani Lokuhetty Ian Cree Dr Lesley Uttley declares that she undertook two paid visiting scientist trips to the International Agency for Research on Cancer to plan and develop this work in July/August 2018. The other authors declare that they have no conflict of interest. The content of this article represents the personal views of the authors and does not represent the views of the authors' employers and associated institutions. Where authors are identified as personnel of the International Agency for Research on Cancer/World Health Organization, the authors alone are responsible for the views expressed in this article and they do not necessarily represent the decisions, policy or views of the International Agency for Research on Cancer/World Health Organization.

Topics & Concepts