Looking for the ideal usability tester…

Let’s assume we’re about to embark on a user experience study and want to solicit the opinions of a handful of users, be it for a moderated or unmoderated study. How should we decide what users to pick and listen to? Would any person off the street work, or are there key criteria we should pay attention to?