Weapons of math destruction

This is actually the title of a book I read listened to. (Full title is "Weapons Of Math Destruction: How Big Data Increases Inequality And Threatens Democracy." ) It talks about all the data algorithms that are becoming more commonplace throughout our lives and how there's a lot of potential dangers to them, and lots of damage some of them have already been shown to do.

Think of Cambridge Analytica as a good example of this, how social media platforms can influence our voting patterns. There are others, such as algorithms that are used in determining how long your sentence is if you get convicted of a crime, how much the police patrol your particular neighborhood, whether you get hired by a company, and others.

The book says that these wouldn't be bad except that the systems are not transparent, aren't checking themselves for errors and false positives, and are widespread. Basically, if you don't know why your police's crime-predicting computer is sending more police to poorer neighborhoods over and over, that they're basing their heavy presence on an original piece of input data from human bias toward poor neighborhoods, that the increased attention inevitably means other crimes get noticed, then you'll have people in poor areas more likely to get arrested for crimes than people committing the same crimes in richer areas, and you'll think it's true that poor people are more likely to commit crimes, because an "unbiased" algorithm says so.

Has anyone experienced anything like this in their personal/professional/educational life? Is it something to be worried about?