With my old passport I entered USA , then I renewed my passport at the embassy.
Now while applying for my H1B visa, the latest I 94 has the old passport number . Will it be a problem or It should not be an issue ?
There is no problem with it, I-94 will get updated when you re-enter USA with your new passport.
Always carry both passport with you.