My lineolated parakeet just laid an egg! Now what?

Completely unexpected — my supposedly male Amazon parrot just laid an egg! I'm freaking out a bit. What do I do with it? Do I leave it or remove it? Will this keep happening?

What kind of cage setup do you have? Sometimes the environment is a factor.