I seem to have both a Lil Joe and an EZG42. It also seems I'm dang close to your size.
The Lil Joe was pretty much my first boat, but now I call it my 'big water' boat and possibly 'long trip' boat, but I haven't been fortunate enough to have that experience yet.
It's stable, crashes big waves with ease, easy to roll and surfs and spins nice. It's probably a decent, beginner creeker too, I just haven't tried that yet. It hasn't been on a river for 3 or 4 years though, (boating for 5). There's just so much more to do in the 42 and the 42's an excellent river runner to boot.
My final analysis, for me anyway, is that I wouldn't give up either boat. Yes, Joe gets lonely, but when we do get together, I'm sure it will be sweet!
My 2 cents.