Genesis 43:16-21

"And when Joseph saw Benjamin with them, he said to the steward of his house, Bring the men into the house, and slay, and make ready; for the men shall dine with me at noon. And the man did as Joseph bade; and the man brought the men to Joseph's house. And the men were afraid, because they were brought to Joseph's house; and they said, Because of the money that was returned in our sacks the first time are we brought in; that he may seek occasion against us, and fall upon us, and take us for bondmen, and our asses. And they came near to the steward of Joseph's house, and they spake unto him at the door of the house, and said, Oh, my lord, we came indeed down at the first time to buy food: and it came to pass, that when we came to the lodging-place, that we opened our sacks, and behold, every man's money was in the mouth of his sack, our money in full weight: and we have brought it again in our hand."

The fear of the brothers is understandable enough. Joseph, the Chief Deputy of the all-powerful Pharaoh was supreme in Egypt, no doubt living in a place befitting his rank and authority. That these travelers from the land of Canaan were invited into such a place was no doubt an occasion for the most dreadful apprehension and fear. Supposing that the money in their sacks after the first journey might be an occasion for their seizure, they sought to put that matter at rest in advance by returning the money to the steward. His answers must have confounded and confused them even more.