I have the same problem. but mine is most obviously just from cheap leather. I'm not sure if that's your issue or not.
I have good bridles that take conditioner and feel soft as silk, and cheap ones that don't absorb anything. Same with my saddles. I have 2 that I use regularly and one is cheap and hard, and one is not. The trouble with cheap leather is that if you oil it and condition it too much, it gets weak. I guess that goes for any leather, but I think you tend to use too much on cheap leather trying to get it soft. It's just not going to happen!