Used left or right, I get to travel, over cobblestone or gravel. Used up, I vie for sweet success, used down, I cause men great duress. What am I?

A thumb.

Source: Riotous Riddles