It's also really hard for outside observers to definitively tell if there's an issue. A model's end users, the people it makes predictions about, society at large cannot validate a model without knowing the data and decisions that went into it. We see this in audits of Google's search algorithm, for example. Researchers can measure outcomes and guess at what the model is doing, but we can't know for sure.