What is harry really afraid of?

In Prisoner of Azkaban, Lupin says "That suggests that what you fear most of all is - fear. Very wise...." when he finds out that Harry's boggart would be dementors. [Chapter : Flight of the Fat Lady. Page : 117] But dementors are supposed to suck out happiness, so doesn't that mean Harry simply feared sadness/depression?