H4 stamping possible if h1 has the previous stamping

My husband’s initial visa is till September 2 2018. He filed for an extension and got it until December 2018. We came on a vacation to India and he will go back in August while I will be staying here. Is it ok if I travel to US after September 2nd where he is not having the new stamping??