Interactable Button Stays Dim

I have a fire button that is disabled when you're out of ammo, and becomes enabled when you find more ammo. Sometimes however, the button retains its dimmed disabled look after its interactable has been set to true. The button works, but still looks dim. If I check, the button's interactable has been set to true. Still it looks dim

I have a feeling this may have something to do with my setting the time scale to zero, as this button problem only happens after the game is paused, during...

Interactable Button Stays Dim