Pumphouse would be good, but just to let you know, the Upper C goes on for pretty much all class II (except for maybe the rodeo drop in Burns, a class III) all the way to Dotsero. There is BLM camping all over too. If you'd like, PM me, and I'll send you the BLM Upper Colorado guide that has a river map with camp sites, etc.
Fishing might be pretty good there now too. Bring your rod if you have one.