In Doctor Who, why don't the Doctor and gang bump into other traveling Timelords?

If all Timelords can travel back and forth through time, despite being wiped out of civilization, shouldn't the doctor and gang have bumped into one or two at this point? Pre Time War Timelords traveling pre Time War.

And IF they have been wiped out of time and space, why then are they remembered?