My second is performed by my first, and, it’s thought, a thief, by the marks of my whole might be caught. What am I?

A footstep.

Source: Riotous Riddles