What might those workers be called? All that comes to mind is "serfs" but I didn't want them to be the wretched poor things usually thought of as serfs. They are from neighboring families (who, granted, are not as well-off as the house and land holders, but who aren't starving, either) whose 2nd, 3rd, or later sons need work, so they come to this family and help them run the estate.
Are there any other terms (doesn't matter which country they come from, really, as this is a fantasy story) that would fit the work that these men and boys are doing?
EDIT: thanks for the help everyone!