For sure.
And I'll be honest and say that I haven't really paid attention to the Titans, so I'm not totally up to speed on what's going on there.
However, just generally speaking, sometimes it's not too early to do something like this just based on how a team looks. If the energy is bad and the players clearly aren't buying in, the coaching decisions are head-scratching, and the losses are piling up? I don't think you need to give that particular coach more time to "figure it out".
That's just a bad situation that isn't going to get any better, so you might as well cut your losses early into it.
Whether or not this applies specifically to Callahan, that I don't know, but again, I was just speaking generally about making a coaching change soon into their tenure.