Valid H4 visa but can I travel? Short visa validity

Hi,

I have valid H4 visa valid till 31 Dec 2020.

My spouse’s H1B petition is also valid till 31st Dec 2020.

I am planning to travel to US on 22nd Nov, Can i travel ? Will there be any issue in port of entry ?

You can travel. There should not be any issues.
If they ask the plans after December, you may need to show the intent to file for extension by your spouse’s company. If there is a receipt notice, you can carry that to be sure.