Count, you should definitely give in to that urge.
The Angst kayak message board is a great place to start. Its patrons are happy to help people getting into the sport. It's also THE primary venue for buying/selling used squirts.
http://angstkayak.com/messageboard/index.html
While you're there, check out the designs on the Angst site. They're designed in TN and mostly built by Murky Water in Canada.
The two major builders in North America are PS Composites in PA and Murky Water. Check 'em out here:
http://customkayak.com/
http://murkywaterkayak.com/
Most squirtboaters have custom-built jobs that are pretty pricey, but new folks can often find used boats that fit pretty well for quite a bit cheaper. Good luck!
-Sam