GMIndie and GMVision Game Maker Survey: Poorly Implemented
August 30, 2010
GMIndie and GMVision have launched ‘Game Maker Survey 2010’ a collection of 60 questions designed to ask about your usage of Game Maker and collect opinions on various aspects of Game Maker.
I waited a couple of days after I first saw (and started but did not finish) the survey to see if others shared my opinions on the survey. I did not want to be accused of undermining a project produced by a site some may view as a competitor to Game Maker Blog by voicing my thoughts on the survey before criticism had arisen elsewhere.
I thought the survey was extremely poorly designed. Some questions don’t let me give the answer I would like to whilst at least one other, question 57 (see below), has two answers which mean exactly the same thing.
And apparently you either “know GML” or “don’t know GML” with no middle ground.
If you start the questionaire you are required to answer all 60 questions even though, as stated by robert680, some of the questions assumed you use Game Maker 8 despite an earlier question asking which version of the software you currently use.
There have been many other criticisms of individual questions and the general style of the survey, some comments taken from the Game Maker Community are listed below.
“Ok the survey had two kinds of questions:
What’s your favourite color? (Who needs this information?)
Aren’t all the useless features that are in Game Maker all useless? And aren’t stupid Yoyogames doing everything wrong? (Answer options: “a) Yes, b) Yes, but not often”.)”
“The quiz has some design flaws and its usefulness is suspect. For example you must choose a single GM version. I use GM8 and GM4Mac. You are forced to answer every question, though some don’t apply. Having a N/A, for some questions is important. Some questions are subjective and won’t have concise meaning to every one. For example, “How often do you save your project?”, the choices are meaningless.”
“Have answered it, though I should imagine about half my answers are inaccurate because there wasn’t an option for my own response.”
This survey, which GMIndie list 6 people as contributing to, needed more thought put into it before it was released. Like I’ve mentioned before when offering so many different ‘products’ the quality will suffer. I am unsure of the level of involvement from GMVision (who haven’t released anything since May,) it appears their contributions may be limited to promoting the survey and providing two of the questions.