I love my X6M but I tend to like cars that aren't too popular. I think your used prices research reflects that.
If cargo space and rear headroom isn't a concern, the main reason left to decide between X5M and X6M is which styling and looks appeal to you.
I made my decision, only you can make yours.
Either way, can't go wrong!