[Melanie Nind]
12.12.06
Data collection through observation
Reasons for chosing observation
Group response:
- capture responses
- everydayness
- body language
- evidence/it can be seen
- processes
- support other methods
- support reflection
- snapshot of reality
- to judge
- own interpretations
- depth (go beyond things that people want to tell you)
Handout list:
- The phenomenon can be seen
- The participants cannot tell you
- The natural context is important
- The researcher’s view is valid
Parallel questions that emerged:
- How does it feel being observed?
- Can you see emotion?
- Can you see attitude?
The big choices…
A. Participation observation/narrative observation
- Complete vs marginal
- Participant as observer vs observer as participant
B. Sistematic/structured observation
- Real time vs video recording
- Sequential vs non-sequential
- Time sample vs event sample
Notes:
- A = Qualitative, interpretive; B = Quantitative, controlled; Chosing A or B depends on the purpose of the research.
- Which protocol is being used determines some “choices”
- Doing narrative observation in a second language and in a context that isn’t well known is a great challenge!
Rigour 1
Content validity:
- Do you measure what you set out to measure?
- Do you have explicit operational definitions?
- Can you site evidence for the interpretation that …
Rigour 2
Reliability
- Have you addressed accuracy and stability?
- Have you checked inter-observer agreement?
- Have you checked intra-observer agreement?
- Have you taken into account chance?
Rigour 3
Instrumentation
- Have you just seen what you wanted to see?
- How do you know?
Rigour 4
Generalisability
- How representative is your sample?
- How do you know?
Rigour 5
Competence
- Is there a clear protocol?
- Have the observers been trained?
- Have differences been addressed?
- Are the observers a valuable part of the instrument?
Some guidance
(See handout)