DaveC is right on!
I was a triathlete long before I started paddling and now feel much stronger at the end of the swim even with training less on the swim. I think the swimming also helps my paddling as the shoulder muscles are used in a wider range of motion. Longer (200-400 meter) sets with pulling gear on should help get the bigger muscles into play that will build on your swimming and paddling muscles.
Also, as DaveC mentioned technique is complementary in both with the stroke catch, etc. Water is 1000 times thicker than water so technique is huge!
Here is a link to some technique videos if it helps (or search youtube)
http://www.totalimmersion.net/
(use the "choose your bandwidth at the top)