Its hard to tell whether an assessment survey has any value at all. In fact, I’m inclined to believe that most are misleading and potentially harmful.
Every survey starts with an author writing out questions, hoping that they will measure certain things. Almost always, the process ends there. Who is to know if the question actually measures what the author intended? What delineates a high score? A low score?
Our new assessment tool, currently in its last stage of development, is no typical survey. I secretly think of it as a super hero among surveys. Its not like Superman, because it wasn’t born great. Its more like the Six Million Dollar Man because it was made great through a long and expensive process called ‘survey validity and reliability assessment.’
Validity and reliability assessments answer the questions that determine if a survey has value:
- Does this measure something real?
- What are the relationships between the concepts measured?
- Are there correlations between the concepts measure and performance factors?
- What’s a high score on this survey? Low score?
You may be thinking, ‘the post title is misleading, this isn’t an update. Get to the update.’
Here it is. We’ve almost completed the entire validity and reliability assessment of our scale (lots of heavy statistical equations and computer modeling involved) and I already have the definitive answers to the bullet questions above, for you:
- Yes! our survey does measure statistically significant and meaningful concepts.
- There are many interrelations within the scale, but I can’t share the specifics right now.
- Yes! Each concept in the survey has been determined by the data to be statistically correlated to one or more performance items. I can’t share the numbers, but I can tell you that we’re excited by the strength of the correlations we’re seeing.
- We’ve figured this one out too. All data from our study is compiled in a database, against which we are benchmarking all new data. As such, the score for newly assessed companies will be translated into a percentile ranked against all existing companies in the database. In this way one can determine exactly where they stand.
In the near future we’ll be wrapping up the analysis and gearing up to present the results of the study to company participants. In fact, next Wednesday we’re giving a sneak peak of results to a company because the brass for the parent organization is in town and is interested to see the results.
I will let you know how it goes.