Seems you could make that work. You'd probably add 100+lbs of wood/metal adding bunks, plus a 100# raft and 50# of frame. Maybe 100# of total frame if it's a fishing rig.
Your Rav4 wouldn't win any land speed records, but could pull it.
Honestly you'll be fighting the wind at highway speeds more than fighting weight.