A lot of cues besides vision can be used for maintaining a consistent direction while moving, but all of those (even including vision e.g. in the woods) benefit from training or practice.
For instance, if you're lost in a blizzard, and you think the wind is "swirling" around you "in all directions," most likely the wind direction is fairly steady and you're going in circles. If you're searching for the edge of a reasonably bounded space (such as a field bounded by roads or fences), keeping a constant angle to the wind is a better strategy. Going directly upwind might be the best choice, if you can do it, because most likely you got off track in the first place by turning away from the wind.
Respectfully,
Myriad