Tips for extending the window sill
First, thank you for adding the pictures. It helps a lot.

My best suggestion would be to remove the existing ~1.5" sill. (Properly speaking, it's a stool, with an apron below.) Put a new 4" or so one on. You'd probably have to remove the apron temporarily, as the thickness of the new stool might or might not be exactly the same as the old. Use long horizontal screws (1 per foot), well countersunk, that go at least 2" into the window frame. The worst case is that they glued the stool to the window jamb and you'll have a bit of splintery mess to clean up. It'll disappear with a bit of filler.

Otherwise, you have room to add a whole new ~6" or so on top of everything existing. Screw down at the window side into the window jamb. Caulk the joint between the new stool and the window trim so that condensation doesn't collect below. The downside to this plan is that the aesthetics of a stacked stool strike me as a bit odd, and you'd have to be a little bit fancy with cutting the new stool to fit. (There's lots of information about making templates to match irregular shapes out there.)

As I mentioned in the comments, use real wood for this, primed on all sides. Never MDF.



edit:
As requested from the OP in the comments, a critique of the second plan.

Structurally, it's better to have long screws horizontally into the wall and the add-on stool. That overcomes my initial concern that you were just going to break the original stool. Countersink and counterbore the new pieces so they don't bind when being screwed. 

The crack can be filled with a two part wood filler (like Bondo), which will function fairly well. Paradoxically, you'd want a thin gap between the old and the new stools, as the filler will be able to flow below the roundover and thus lock itself in. You can force this crack by putting a metal washer on each horizontal screw. The trick with Bondo is to catch it as it hardens and cut it flush. (The best time is when it's like a firm jello. Poke the leftover filler to decide when you've hit that point.) Use a long sharp, slightly flexible blade (like an Olfa knife) to slice. If you cut too deep, you can add another layer. If you waited too long, you can sand, but that's work.

Prime and paint. You're done.

FWIW, removing the old stool wouldn't involve breaking the vertical casing. As I said, the biggest risk is that it was glued, which would mean a bit of chisel work to make a clean edge. It's absolutely true that a new stool would require a bit of fancy cutting, so I understand if you're reluctant.