One local interpretation method based on Shapley values is SHAP (SHapley Additive ExPlanation). The calculation of Shapley values is for instance possible using kernelSHAP or global SHAP.