Construct Measures
SERVICES
From start to finish and everything in between.
We provide a comprehensive suite of assessment and evaluation development services to meet the needs of your project.
EXPLORE & DESIGN
To better understand your needs and that of the project, we begin with a comprehensive Environmental Scan to assess and understand the current landscape in which the assessment or evaluation will function.
This involves researching existing tools and processes, identifying gaps, industry standards and regulations, as well as gathering insights from key stakeholders.
By conducting a thorough Environmental Scan, we ensure the project is well positioned for success.
A Practice Analysis is a critical step in defining the knowledge, skills and abilities that best represent the profession and that which needs to be measured.
This involves identifying and detailing tasks and responsibilities with key subject matter experts, collecting and analysing data and developing and organising competencies and domains in a logical framework.
By recruiting and engaging the right subject matter experts we ensure the development of a comprehensive and representative competency model.
As it is not possible to test everything, Blueprinting is the systematic process used to identify that which is most essential to include in the assessment or evaluation as well as how best to measure it.
We specialize in the development of blueprints designed to reflect the specifications for both knowledge and performance-based assessment formats, namely multiple-choice questionnaires, Objective Structured Clinical Examinations (OSCEs), structured interviews etc.
DEVELOP
The assessment or evaluation is brought to life at the development phase which starts with crafting high-quality content that aligns with the needs of the blueprint.
By merging subject matter content expertise with our measurement expertise during the Item Writing process followed by an Editorial and Sensitivity Review we ensure the creation of sound measurement tools that contribute to the reliability, validity and fairness of your assessment or evaluation pathway.
At the heart of any assessment and evaluation process is the need for reliable and accurate scoring mechanisms.
This involves developing and implementing Scoring Tools for data collection as well as creating Guidelines, Training and Evaluation processes to enhance objective rater judgements for performance-based formats.
We work with you to develop and implement solutions and processes that are both practical and sustainable in meeting the long-term project objectives.
Pilot Testing is a crucial and necessary investment to ensure the success and validity of the assessment or evaluation tool.
This includes identifying and recruiting a sample of participants that best represent the target population as well as the data collection and analysis strategy that will inform Reporting and highlighting areas in need of Revisions before full deployment.
Standard Setting is a rigorous process that helps identify the objective line that differentiates between performance levels and outcomes.
Through the adoption and implementation of evidence-based methods that align with the intended purpose of the assessment or evaluation tool, we will help facilitate discussions surrounding defensible cut score decisions.
DELIVER & EVALUATE
The delivery and evaluation phase requires consistent delivery and quality assurance procedures. This includes Form Selection for equivalent but different versions of the tool, as well as validating and analyzing data to calculate Scores to produce Reports.
Our score reports aim to provide clear, understandable and useful information for stakeholders at all levels and provides overall and diagnostic feedback to suite the needs of the client and intended purpose of the process and tool.
The measurement process does not end after the generation of scores and reports, instead Psychometric Analysis conducted on all facets of the assessment (items, raters, test sites etc.) provides invaluable insight on the performance of the tool.
These statistics are used as evidence for reliability, validity and fairness, as well as to build a repository of items and their properties to guide future decisions and remediation, a process known as Item Banking.