Can I challenge someone below me?

No. Upward only, on every ladder. Let challenges run downward and a strong player farms the bottom of the standings for safe wins. Play a friendly against whoever you like; it will not move the standings.