There was a direct access to a NumPy configuration which was
removed in 1.22. This PR removes the special handling and rely
on accessing the configuration in a controlled way to avoid later
issues.