View source for Section 8.4.3 Questionnaire construction

__NOTITLE__
__NOTOC__<div class="light-blue-corner">{{Template:Page Header}}</div>

The validity of data from SET is further threatened by the lack of psychometrically practices often employed in constructing scales or designing questionnaires. 


Rather than utilising or adapting scales that have empirically tested and verified reliability and validity items are arbitrarily combined despite no evidence that they form a coherent scale or consideration of how they  correlate with any measures of learning outcome (Coffey, & Gibbs, 2001).


When students are asked to respond to questions or statements using semantic differential or Likert type scales there is frequently no criteria or labels for the ratings and little reflection from wither staff or students as to what they actually means in real terms (Edström, 2008).  As a result, Edström speculates that in such cases a high rating is more indicative of the lecturer’s attitude than any element of their teaching and a ‘feel-good factor’ is rewarded. 


Often in SET surveys efforts are made to include both positively and negatively worded items, to prevent a ceiling effect, where respondents fall into a pattern of ticking all responses at either the left or the right hand side of the scale. Switching from positively to negatively worded items is designed maintain the student’s interest and keep them focused on the questions. According to Roszkowski and Soven (2010) however, engaging in this practice may be adversely affecting the validity of the measure rather than enhancing it. 


Rather than thinking about the survey item most respondents provide a quick, unconsidered answer to complete the survey, rather than to provide a true indicator of their attitudes or beliefs (Krosnick 1991). Consequently students are more likely to respond to the reversed item incorrectly (indicating a positive when they mean a negative) profoundly affecting the results and the validity of the evaluation. 



{| 
|class="light-blue-cell"|'''Activity 8.4.3'''
{{#userform:revisions}} 
{{#form:method=post|}} 
{{#input:type=hidden|name=userforms}} 
{{#input:type=hidden|name=pagename|value={{FULLPAGENAMEE}}}} 

'''Look at a standardised questionnaire for module evaluation such as the Module Experience Questionnaire (MEQ) (Lucas, Gibbs, Hughes, Jones and Wisker, (1997)'''

'''''Which areas does the survey include?'''''
{{#input:type=textarea|name=Activity_8.4.3|{{#userform:name=Activity_8.4.3}}}}  

'''''Do any of the questions seem relevant for your requirements?'''''
<br/>
{{#input:type=textarea|name=Activity_8.4.3|{{#userform:name=Activity_8.4.3}}}}

<h3>Submit your answers</h3><div class="form-box">{{#input:type=submit|class=save-button|value=Save Your Answers}}</div>

{{#formend:}}

|}



<div class="emphasis-1"><h2>Resources</h2> 
Gibbs, G. & Coffey, M. (2004). The Impact Of Training Of University Teachers on their Teaching Skills, their Approach to Teaching and the Approach to Learning of their Students.  Active Learning in Higher Education, 5(1), 87-100.
</div>


<span class="back-step-link">[[Section_8.4.2_Single-item_indicators|Back to 8.4.2]]</span>
<span class="next-step-link">[[Section_8.5_Confounding_Variables|Continue to Section 8.5]]</span>
<span class="back-step-link">[[Section_8:_Reliability_&_Validity|Back To Section 8]]</span>
<br class="clear"/>

[[Category: Evaluation]]