You should just get the 4 in my opinion. It would be very helpful, and anyways, you wouldn't have to use all 4 paddles.
I have a Scuf with 2 paddles, and it is great and comfortable. I'm not too sure how good it would feel to hold the controller with all 4 paddles in the back.
So I say just go with 4 if you want.