Tuesday 27 November 2007

DTW Rigour and reviewing

How are you going to demonstrate rigour in your research?
In the doctoral training workshop, our small group suggested (after a discussion about the meaning and spelling of 'rigorous'):
  • an obedience to rules
  • following instructions rigoursly
  • consistency
  • validity
  • reliability
The class suggestions were:
Before data collection: Address own bias, Be consistent with the research question, Be objective, Justify the methodology, Have awareness of the literature in the field

After data collection Triangulate, Be repeatable, Repeat experiments to make sure Use methods consistently, Compare with other’s work, Analyse from a different perspective, Know limitations, Find other explanations

Always Following the training rules, Be convincing, Demonstrate external validation

The answer taken from Research Skills for Policy and Development [1]:

  1. To show that you have enough evidence to justify your conclusions
  2. That evidence has been obtained properly and that contrary evidence has been sought, but either not found or found to be relatively unconvincing.

See slides that they'll post on the web site later.

Ways of doing research

Maybe have a section in the PhD dissertation about the way of researching, e.g.:

  • observing,
  • two-way interactions e.g. semi-structured interviews
  • participation.

See rules for rigourous research in Glassich, Huber & Maeroff, 1997 [2]

Some questions that a reviewer might be required to ask of a paper:

  1. whether there's evidence to support the claims
  2. whether the claims are relevant and topical
  3. accuracy of the numbers or quotations
  4. ethics of publication
  5. credible references
  6. relevance of the topic (journal/field/fashion)
  7. originality might be desirable but not required
  8. limitations
  9. clarity of ideas
  10. findings justified
  11. structure
  12. abstract



[1] Research Skills for Policy and Development: How to Find Out Fast (Published in association with The Open University) by Alan Thomas and Giles Mohan (Paperback - 16 May 2007) at http://amazon.co.uk/s/ref=nb_ss_w_h_?url=search-alias%3Daps&field-keywords=Research+Skills+for+Policy+and+Development
[2] Scholarship Assessed: Evaluation of the Professoriate (Special Report) by Charles E. Glassick, Mary Taylor Huber, and Gene I. Maeroff (Paperback - 15 Aug 1997)

No comments: