H1B - Need to respond to the RFE

My H1B got a RFE and I am unable to provide the end client letter so planning to withdraw the application instead of getting it rejected since the attorney is saying that the chance of getting is 50-50

Can I withdraw the application without the help of attorney who has applied since I do not want to pay the attorney fees anymore.

Pl help