You are correct. Defeats the purpose, yes.
If your NAT is unrestricted, use the -ephemeral-ports-range xxxxx:xxxxxx flag (ephemeral udp ports - either the whole range or pick a range of 10,000). If it’s not you can run your machine in a DMZ and do likewise. I’ll assume that your not doing this on your daily driver unless your using a VM or the like.