Most FHA Lenders right now are requiring a 640 credit score though there are some that will go lower.
You did not mention the price of the house you are looking to purchase. This will be a issue if you are only using your husbands score. If you are only using his score then you can only use his income which will affect the price of the house.
If you can improve you scores you will have a better chance getting approved. Also, remember that you need 3.5% as a downpayment for the home.
You might take a look at here on talking to someone who can help you fix your credit. They have done some good work for people in the past.
ttp://www.mycreditsbad.com/fixing-your-credit/legally-remove-bad-credit.html.
As always do you homework and ask questions.
As for you lender -- if you are not getting the service you need then find another one. Be sure you are armed with a copy of your credit report so they don;t keep pulling it.
We recomend the credit reports on our FHA Credit Guidelines page
http://www.fhainfo.com/creditguidelines.htm as they are most similar to the reports lenders use.