Background: As Artificial Intelligence (AI) systems, particularly Deep Neural Networks (DNNs), achieve superhuman performance in medical diagnostics and financial risk assessment, their inherent opacity—the "Black Box" problem—remains a critical barrier to adoption. Stakeholders in high-stakes domains require not just accurate predictions, but intelligible justifications that align with human cognitive reasoning.
Methods: This study provides a comparative evaluation of prominent Explainable AI (XAI) frameworks, specifically focusing on the dichotomy between feature-attribution methods (LIME, SHAP) and contrastive explanation approaches. We analyze these methodologies against a framework of "explanation effectiveness," assessing criteria such as local fidelity, consistency, and cognitive alignment with human decision-makers.
Results: Our analysis suggests that while feature-additive models like SHAP provide mathematical consistency in attributing contribution scores to input variables, they often fail to provide the causal intuition required in clinical settings. Conversely, contrastive explanations, which highlight "pertinent negatives" (what is missing but should be present for a different outcome), demonstrate higher efficacy in facilitating user trust and actionable insight, despite higher computational costs.
Conclusion: The transition from Black Box to "Glass Box" models is not merely a technical challenge but a socio-technical one. We conclude that for XAI to succeed in high-stakes environments, future architectures must prioritize contrastive reasoning that mirrors the differential diagnosis process used by human experts, moving beyond simple feature highlighting toward semantic intelligibility.