When electrons drift in a metal from lower to higher potential, does it mean that all the free electrons of the metal are moving in the same direction?

No. When electric field is applied, the net drift of the electrons is from lower to higher potential. But, locally electrons collide with ions and may change its direction during the course of their motion.