Not completely. The appearances, disappearances, and a few other incidents are, so far as we can tell, the result of experimentation by one "Pale Pony" who was apparently only a myth when Princesses Celestia and Luna were young.

That said, all five princesses know they're happening.

[Something about that seems wrong.]