If you’re struggling to solve human problems with data, the mindset of your data team may be the problem.
If your team is highly technical, "soft skill" stuff probably feels like BS. Users are mostly in the way of getting the data provide its inherent value.
If your team is highly technical, it may seem irrational when stakeholders or users make decisions that are not based on what the data supports.
If your team is highly technical, they probably see solutions as something should be qualitatively measured by "what's the right tool/approach/engineering/model/viz for this data? Is it precise? Is there plenty of evidence to dig through to prove the quality of the solution?"
If your team is highly technical, they probably find design activities to be a waste of time—a tax on getting the solution done or the engineering complete.
The thing is, if you're hiring highly technical people to create innovative ML and analytical data products, you should probably note that over time, if you only accrue talent based on their technical skills, you are reinforcing a culture that only does things "this way."
That status quo can be positive...or not so positive depending on how you measure it.
The thing is, most of the work data leaders are doing is supposed to be in service to others.
So, it is the "they" who are the ones measuring the quality of your work. Not you and your team.
Most users cannot measure the quality of the inputs/outputs, nor do they care to.
They just want their problem solved, their work reduced, the friction removed. Something easier, more actionable, more dependable. Something that even makes them feel better about their decisions. We call this "user experience" sometimes.
The thing is, these UX problems aren't data science and analytics problems on the surface.
They are human problems.
So, you need human-oriented tools—not just data and technology tools to solve them.
Design is not really about tools or what you do with your hands. It's about changing how your team thinks and works with customers, stakeholders, users, domain experts, SMEs, and the like.
Until the thinking changes, the status quo probably won't.
Fortunately, because you have all these highly technical smart people, you have people on your team who can learn new skills. But first, we have to decide that there's a problem with the status quo of our approach.
We have to decide that if we're making data products, they aren't for us.
Somebody else is keeping score, and settings the rules for how points are earned.
It's really hard to shoot a birdie or eagle on the 9th tee if all you have are two giant nets, a black and white ball with pentagonal shapes on it, and no pin.