Learn How and When to Trust?