Could Muggles enter

Courtesy this answer, the following seems to be a weird information on Wikipedia:

The Leaky Cauldron

The pub serves as a way of entering into Diagon Alley from the Muggle world for Muggle-borns and their parents (both of whom, until the first letter from Hogwarts, have no magical knowledge or means of entering). The rear of The Leaky Cauldron opens onto a chilly little courtyard, in which a particular brick must be tapped three times to open a path to Diagon Alley.

But from what I can see, Muggleborns and their parents wouldn't be able to enter from Leaky Cauldron, because - based on what I can tell - that requires one to use a wand:

He {{Hagrid}} tapped the wall three times with the point of his umbrella.

The brick he had touched quivered – it wriggled – in the middle, a small hole appeared – it grew wider and wider – a second later they were facing an archway large enough even for Hagrid, an archway on to a cobbled street which twisted and turned out of sight.

Is there some canon information confirming the Wikipedia assertion (currently un-cited) that Muggle parents and not-yet-wand-owning Muggleborns could enter Diagon Alley from the courtyard behind Leaky Cauldron?