Note that Gideon sends the men "secretly." While this might mean that they were going cautiously, it may also be indicative that he was acting without the approval of Limhi, as suggested above. As the search party trails Noah, they meet up with many men returning toward the city. As noted in this verse, the king and the priests were the only ones who remained behind.