Difference between revisions of "Section 4.6.3 Paper vs. Digital Surveys"
 
Line 17: Line 17:
  
  
−
<!--  SocialRewarding Extension Automatic Code Insertion (22:07, 12 September 2011) -->
+
{|
−
<SocialRewardingRecommend></SocialRewardingRecommend>
+
|class="light-blue-cell"|'''Activity 4.6.3'''
−
<SocialRewardingMostViewedArticles show='true'></SocialRewardingMostViewedArticles>
+
 
−
<!-- End Of Automatic Insertion -->
+
Although specified for online surveys these measurement issues could apply equally to paper or digital questionnaires. 
 +
 
 +
Consider how each issue could relate to both paper and online surveys, how each could be addressed, and which would be easiest to overcome
 +
 
 +
|}
 +
{{#form:method=post|}}
 +
{{#input:type=hidden|name=userforms}}
 +
{{#input:type=hidden|name=pagename|value={{FULLPAGENAMEE}}}}
 +
{{#userform:revisions}}
 +
 
 +
 
 +
<div class="exercise exercise-table">
 +
 
 +
{|
 +
!
 +
!How it applies (Paper)
 +
!How it can be overcome (Paper)
 +
!How it applies (Online)
 +
!How it can be overcome (Online)
 +
|-  
 +
|Coverage errors
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-  
 +
|Sampling errors
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-
 +
|Non-response errors
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-
 +
|Measurement errors
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-
 +
|Environment  control
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-
 +
|Completion time
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-
 +
|Computer availability 
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|-
 +
|Privacy
 +
|{{#input:type=textarea|name= How_it_applies_(Paper)|{{#userform:name= How_it_applies_(Paper)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Paper)|{{#userform:name= How_it_can_be_overcome_(Paper)}}}} 
 +
|{{#input:type=textarea|name= How_it_applies_(Online)|{{#userform:name= How_it_applies_(Online)}}}}
 +
|{{#input:type=textarea|name= How_it_can_be_overcome_(Online)|{{#userform:name= How_it_can_be_overcome_(Online)}}}} 
 +
|}
 +
</div>
 +
 
 +
{{#input:type=submit|value=Save Your Answers|class=save-button}} 
 +
{{#formend:}}
 +
 
 +
 
 +
<div class="emphasis-1"><h2>Resources</h2>
 +
Fike, D. S., Doyle, D., Connelly, R. J. (2010). Online vs. Paper Evaluations of Faculty: When Less is Just as Good. The Journal of Effective Teaching, 10(2), 42-54.
 +
(Also from http://uncw.edu/cte/et/articles/Vol10_2/Fike.pdf)
 +
 
 +
Donovan, J., Mader, C.,  & Shinsky, J. (2007) Online vs. Traditional Course Evaluation Formats: Student Perceptions. Journal of Interactive Online Learning, 6(3), 158-180
 +
(Also from http://www.ncolr.org/jiol/issues/pdf/6.3.2.pdf)
 +
 
 +
Anderson, J., Brown, G., & Spaeth, S. (2006). Online Student Evaluations and Response Rates Reconsidered. Innovate 2 (6)
 +
(Also from http://innovateonline.info/pdf/vol2_issue6/Online_Student_Evaluations_and_Response_Rates_Reconsidered.pdf)
 +
 
 +
Lalla, M. & Ferrari, D. (2011). Web-based versus paper-based data collection for the evaluation of teaching activity: empirical evidence from a case study. Assessment & Evaluation in Higher Education, 36(3), 347–365
 +
 
 +
</div>
 +
 
 +
<span class="back-step-link">[[Section_4.6.2_Generic_Questionnaires|Back to 4.6.2]]</span>
 +
 
 +
<span class="next-step-link">[[Section_4.6.4_Advantages_and_Disadvantages_of_Online_Surveys|Continue to Section 4.6.4]]</span>
 +
 
 +
<span class="back-step-link">[[Section_4:_How_To_Do_SET|Back To Section 4]]</span>
 +
<br class="clear"/>
 +
[[Category: Evaluation]]

Latest revision as of 22:09, 12 September 2011

Section 4.6.3 Paper vs. Digital Surveys

Section 4.6.3 Paper vs. Digital Surveys

There has been a substantial growth in electronic-based SET in Higher Education in recent years (Barkhi, & Williams, 2010). While there are obvious resource-related advantages associated with this move from paper to digital many lecturers prefer to retain the more traditional –pencil and paper’ approach to evaluation.


Fike, Doyle, & Connelly (2010) provide a very accessible introduction to this issue, particularly in relation to the largest concern usually expressed about online surveys – the potential impact of lower student participation rates. The pros and cons are also discussed by Anderson, Brown & Spaeth, (2006), and Donovan, Mader, & Shinsky, (2007) provide an insight into the student perspective on paper versus digital surveys.


Some research does suggest that the method used is influential. Chang (2005) reported that ratings on SET tools were influenced by the survey method (i.e., online or paper), a finding corroborated by Morrison (2011), who similarly reported that differences in response rates and ratings.


Lalla and Ferrari (2011) list the following eight measurement issues known to negatively impact online surveys:


4.6.3 paper vs digital.jpg


Activity 4.6.3

Although specified for online surveys these measurement issues could apply equally to paper or digital questionnaires.

Consider how each issue could relate to both paper and online surveys, how each could be addressed, and which would be easiest to overcome


How it applies (Paper) How it can be overcome (Paper) How it applies (Online) How it can be overcome (Online)
Coverage errors
Sampling errors
Non-response errors
Measurement errors
Environment control
Completion time
Computer availability
Privacy


Resources

Fike, D. S., Doyle, D., Connelly, R. J. (2010). Online vs. Paper Evaluations of Faculty: When Less is Just as Good. The Journal of Effective Teaching, 10(2), 42-54. (Also from http://uncw.edu/cte/et/articles/Vol10_2/Fike.pdf)

Donovan, J., Mader, C., & Shinsky, J. (2007) Online vs. Traditional Course Evaluation Formats: Student Perceptions. Journal of Interactive Online Learning, 6(3), 158-180 (Also from http://www.ncolr.org/jiol/issues/pdf/6.3.2.pdf)

Anderson, J., Brown, G., & Spaeth, S. (2006). Online Student Evaluations and Response Rates Reconsidered. Innovate 2 (6) (Also from http://innovateonline.info/pdf/vol2_issue6/Online_Student_Evaluations_and_Response_Rates_Reconsidered.pdf)

Lalla, M. & Ferrari, D. (2011). Web-based versus paper-based data collection for the evaluation of teaching activity: empirical evidence from a case study. Assessment & Evaluation in Higher Education, 36(3), 347–365

Back to 4.6.2

Continue to Section 4.6.4

Back To Section 4

Retrieved from "http://www.ucdoer.ie/index.php?title=Section_4.6.3_Paper_vs._Digital_Surveys&oldid=1702"
Page tools