Why were the Israelites afraid to Challenge Goliath prior to David taking him on, was God not backing them?

David came to visit his brothers and got a " workout" yet None of the other men stepped up for weeks as Goliath taunted- not even King Saul. What was their problem?