That's not something that would work in our group.
We use the movement dice to track what units have moved.
At the top of the round, all of the movement dice from each side get gathered up into piles so there's 2 spots to look at to see what's left to move.
When I do use the movement dice to keep track of where I started, I place them on the opponent's side for after movement, then move them to my side before rolling Initiative. Simply put, if they can see the die, then the unit was moved. If they can't see it easily, it hasn't.
I was using it for a couple months, but it has been easier to keep track of where I started the model lately, so I haven't felt the need.