Something that has to be remembered - by a lot of people - in this hobby and industry is that it is both. It's a hobby, which is heavily supported by a payware industry that is peoples' livelihood.
We want perfection and we want it now, but we want it cheap. I've been involved in many beta tests, payware, donationware and freeware, over the last twenty-five-odd years in the FS world and one of the really big challenges is how you run a beta. A lot of people will apply for betas purely to try and get a free aircraft; they will provide no feedback at any point, or maybe post once or twice to "justify" their being on the beta team. Others will test constantly, they'll be there every day with acres of feedback, but it's usually in their specific area of interest, so you'll get someone posting reams and reams of graphs and screenshots and text on the physics, or the model, or the sound, but nothing else. Finally you have the largest group, people who will test what and when they can. They're not experts, they have lives and jobs and houses to deal with away from the sim. They miss stuff, they aren't experts on anything, so they don't know to look for specific things... They're the most maligned but most common group of beta testers.
I've been in all three groups, on various projects at various times (most of the time in the third, majority, group on AH projects, sorry Baz!) but when I found myself posting less and less on beta forums, I quit them, primarily out of embarrassment. I know I'm not alone, for various reasons. Beta teams in the simulation industry tend to be made up primarily of hobbyists, have a high turnover rate and are primarily made up of people who have to do other things most of the time. Sometimes they'll get told to hold off on one project and move to another one, where people move between the three "groups" depending on their areas of knowledge and experience. You do get 'professional' beta teams, but most of the time, it's us. It's customers, people who are interested and prepared to help try and get a model out the door and working properly. They can't always provide the time for the quantity and quality of testing that they would like to.
Personally, I'd love to get back in there, to go back to creating my own test plans, test things, give feedback, make a product as good as it can be. My mental and physical health says no. I'd be in that first group I described, where I'm embarrassed to be, so I don't go there.
I'll shut up again now. I haven't even looked at Boxted, yet, either.
Ian P.