7.4 Pros and Cons
Pros
- Model agnostic approach
- Can potentially provide more accurate explanations than additive effects only
- Plots can be easy to interpret in many cases
Cons
- Calculation complexity - need to calculate contributions for p(p+1)/2 variables and pairwise interactions
- Credibility issues - for small datasets, net contributions are subject to larger randomness in ranking
- Procedure is not based on formal statistical test of significance and relies on heuristics.
- false positives
- false negatives - more likely with small samples
- false positives
- With many variables and interactions, plots can be complex with small contributions to instance prediction