Ummm...I must be missing your point. We do remember, and we do experience. These are things we do, not things we "have". We can (and do) study the physiological mechanisms of these particular behaviors. For instance, we can look at the role of the hippocampus and cortex areas in remembering particular events or things; we can see that we "re-experience" experiences, re-generate an imperfect copy of the original experience. The notion of "a memory" that is stored somewhere is flawed.If one does not have memories, or a way to catalog experiances, how exactly does one experiance anything? Do rocks experiance anything?
Your question implies a relationship between memories and experience that is exactly backwards, and flawed in the same manner as Iacchus's logic. Without our experiences, we would not infer the concept of "a memory" as a mental entity. We cannot say that "without memories we could not experience".
Just because our language speaks in that manner does not mean that it works that way.