Analyse methodologies and evidence

Analysing the methodology of a source will help you determine the quality of the evidence the methodology can produce. It will also allow you to better understand the methodologies and spot problems and potential biases. Analysing methodologies is particularly relevant if you are required to provide a detailed critique of published articles.

Analysing methodologies involves closely examining the design of the research, , the methods used to collect data and the approach taken to data interpretation. Below are questions to help you get started:

  • How has the research been designed?
  • How might this methodology favour certain types of data, social groups or conclusions?
  • Are the data gathering and interpretation processes described?
  • What data collection instruments have been used?
  • Is bias evident in survey questions or methods by which the evidence has been collected?
  • Has participant selection been described?
  • How representative of a population are the participants?
  • What is considered an outlier or erroneous data and why?
  • Was there any attempt to replicate the results or compare them with similar studies?
  • Are ethical considerations clearly explained?
  • How have the authors’ assumptions influenced the methodology?

When you analyse evidence, you question the credibility and reliability of the findings or results and the information used to support the reasons which make up arguments. You evaluate the logical relationship between the evidence and the claims to make sure the claims are based on evidence.

Below are some questions to help analyse your evidence:

  • How is this evidence shaped by the context in which it was created?
  • Is the evidence from most the credible and reliable sources available?
  • How does the evidence support the claims and reasons being made?
  • Was only partial evidence presented or focused on?
  • What information may have been omitted from this evidence, and why?
  • How suitable are the tools, methods or concepts used to interpret this evidence?

Taking it further