Why do both Olivia and Peter remember so little from their childhood?

I just watched S3E15, "Subject 13", in which it is revealed that Peter and Olivia

Why does neither remember anything of that? They must have been at least 6 years old at the time, more likely 8.

People have memories from much earlier in life. Is it explained why neither remembers any of this?