My Indian Ringneck just laid an egg! Now what?

Completely unexpected — my supposedly male Indian Ringneck just laid an egg! I'm freaking out a bit. What do I do with it? Do I leave it or remove it? Will this keep happening?

Update: took everyone's advice and things are improving. Pickle is slowly coming around. This forum is the best.