Tag Archives: educational research

It has been a long time since I last posted – too long!


IMG_5504I  have been busy because I have decided to write a book on education.  My subject is research-based education and does it exist?  Here in Ontario we are big on research based or brain based education.  I am always a bit dubious about this as there are at least three things that need considering in implementing education based on research.

The first is the reliability of the research For readers like me who don’t always remember the difference between those two important pillars of good science, reliability and validity, I will explain.

Reliability refers to whether an experiment can be done more than once and by other researchers and still get the same result.  If your dog eats a tablespoon of peanut butter and then lies down and rolls over twice, can you get the same effect the next day when you feed him peanut butter?  If you can, can your friend in the next city get her dog of a different age to lie down and roll over twice after he has eaten a tablespoon of peanut butter?  Will it work with different breeds or only black dogs weighing more than 60 lb.?   The more often replications of the experiment end up with the same result, the more likely it is to be reliable.

The second pillar of research is validity.  This is not as simple a concept to explain.  Validity requires that the thesis and experiment make sense i.e. they are designed using both logic and fact.  The conclusions must be interpreted logically, too.  As the saying goes: “data is not the plural of anecdote.”

One mistake we often make is confusing correlation and causation: a classic example is the woman who believed that it was the sign “deer crossing” that caused deer to cross at that particular spot on the road.  She thought this was very dangerous as she had hit a deer three times just after passing the spot.  Her solution was to move the crossing.

The mistake this woman made was to mistake the correlation of a deer crossing sign and the deer crossing the road with the sign causing the deer to cross the road.   Some careful thinking about the nature of deer and their abilities would have brought the realisation that deer can’t read or follow traffic rules.  The deer’s preference for crossing the road at that point was the reason the sign was posted, not the other way around.

We can laugh at this person’s logic, but how often do we see similar thinking in

World Health Organization building from the So...

World Health Organization building from the South-East, Geneva (Photo credit: Wikipedia)

our lives.  Think of your friend who won’t get her child vaccinated because she believes that vaccinations kill children.  The World Health Organization (WHO)

clearly outlines the faulty logic as it applies to the DPT i.e. Diphtheria, pertussis (whooping-cough) and polio:

Diphtheria-Tetanus-Pertussis (DTP) Vaccine And Sudden Infant Death Syndrome (SIDS)

One myth that won’t seem to go away is that DTP vaccine causes sudden infant death syndrome (SIDS). This belief came about because a moderate proportion of children who die of SIDS have recently been vaccinated with DTP; on the surface, this seems to point toward a causal connection. This logic is faulty however; you might as well say that eating bread causes car crashes, since most drivers who crash their cars could probably be shown to have eaten bread within the past 24 hours.

If you consider that most SIDS deaths occur during the age range when three shots of DTP are given, you would expect DTP shots to precede a fair number of SIDS deaths simply by chance. In fact, when a number of well-controlled studies were conducted during the 1980s, the investigators found, nearly unanimously, that the number of SIDS deaths temporally associated with DTP vaccination was within the range expected to occur by chance. In other words, the SIDS deaths would have occurred even if no vaccinations had been given.

In fact, in several of the studies, children who had recently received a DTP shot were less likely to get SIDS. The Institute of Medicine reported that “all controlled studies that have compared immunized versus non-immunized children have found either no association . . . or a decreased risk . . . of SIDS among immunized children” and concluded that “the evidence does not indicate a causal relation between [DTP] vaccine and SIDS.”

Looking at risk alone is not enough however – you must always look at both risks and benefits. Even one serious adverse effect in a million doses of vaccine cannot be justified if there is no benefit from the vaccination. If there were no vaccines, there would be many more cases of disease, and along with them, more serious side effects and more deaths. For example, according to an analysis of the benefit and risk of DTP immunization, if there was no immunization program in the United States, pertussis cases could increase 71-fold and deaths due to pertussis could increase four-fold. Comparing the risk from disease with the risk from the vaccines can give us an idea of the benefits we get from vaccinating our children.

A plot of SIDS rate from 1988 to 2006

A plot of SIDS rate from 1988 to 2006 (Photo credit: Wikipedia)

For more information on vaccines and childhood illnesses go to Global Vaccine Safety:

Six common misconceptions about immunization.  This is a much more serious case of correlation = causation than the Deer Lady’s confusion.

The sample used should be a reasonable size and reflect the population in question.  How many samples, people, classrooms or animals are needed can’t be defined theoretically, but scientists and most sensible people should know when the sample is not enough.   For example if one wants to know the death rate from measles, the best sample would be all the reported cases of measles in an area or all the confirmed cases of measles.  The latter would be better, unless one can safely assume that doctors are generally accurate in diagnosing measles and therefore their reports won’t skew the data.

One of the cruellest results of poor research is the myth that the MMR (mumps, measles and rubella) vaccine causes autism .  The research was published in 1988 and retracted by the eminent medical journal, Lancet in 2012.  Not only was the research retracted but the author was also reprimanded by Britain’s General Medical Council and stripped of the right to practice medicine in Britain.

The doctor used only 12 children for his research, taking the blood samples from children at his son’s birthday party.  There were other flaws in his work; for more information see the sites below.

After his results were published in 1988, some British parents refused to get their children immunized with the MMR vaccine and the incidence of all three diseases increased.  Measles is highly contagious and can lead to more serious illnesses or death.  For example: one in twenty will develop pneumonia (a common cause of death from measles) and one in a thousand will develop encephalitis, putting them at risk for convulsions, deafness, mental retardation or death.  By 2008 there were enough measles cases in Britain to declare it an epidemic.  See web sites in the bibliography below for a discussion of MMR vaccination from at least two opposing perspectives.

Even when research is well done, there are two more pits for the unwary: drawing conclusions and applying the results correctly. If your dog rolls over repeatedly after eating peanut butter, is it to please you in order to get more peanut butter or does peanut butter put his belly in such agony that he needs to roll over more than once to relieve it?  One might argue that the dog’s motivation doesn’t matter; the important thing is that the dog rolls over.  It does, however, make a difference to dogs and to dog lovers.  They care whether pain or delight is causing the new tricks.  This is another case where the researcher will have to explore the connection between the incidents in order to do good science.

Research intent on testing the results of other studies is not glamorous and doesn’t get the headlines (or the grants, sometimes) but it is as important as the initial work.  In fact, without it, we would have more drugs with disastrous side effects, more collapsing structures and poorer educational systems.

The third thing that needs considering, besides reliability and validity and the conclusions draw by the researcher, is the interpretation of research by the layman – or woman.  It is easy to misunderstand research if we don’t read the work or summaries without a critical eye.  I find myself increasingly wondering who did the original research, how valid and reliable it was, if the researcher had a bias towards the results and what other research has been done. Education needs good research to inform good teaching practices and teachers need to know how to read the research, question it and implement what has been learned.

I have not covered everything you need to know about scientific methods and the methods of science.  My intention here is to draw attention to the layman’s need to understand scientific thinking and reflect critically on research before applying it in the field.  For a more thorough analysis, go to:  The Scientific Method vs. Real Science at http://www.av8n.com/physics/scientific-methods.htm.  It does require some thoughtful reading but it is worth the effort.

So, I am writing a book about the relationship between education and what we really know about the brain and relevant psychology.  I am still in the research stage.  Instead of doing my own original research, I am reviewing other peoples’ studies to understand the results and their relevance to education.

My blog will probably have a different flavour, as it is likely to reflect my thoughts and discoveries as I learn.  I hope you enjoy accompanying me on this journey.

Bibliography

Donna, The Deer Lady

http://www.webpronews.com/donna-the-deer-lady-learns-what-deer-crossing-signs-are-for-2012-10

The MMR Vaccine Discussion.

Autism-vaccine study retracted Tuesday, February 2, 2010 | 10:08 PM ET CBC News  http://www.cbc.ca/news/health/story/2010/02/02/autism-mmr-lancet-wakefield.html

http://www.cdc.gov/vaccinesafety/concerns/autism/index.html

http://www.infection-research.de/infectious_diseases/measles/

http://www.vaccinationnews.com/why-do-pediatricians-deny-obvious

http://www.vaccinationnews.com/measles-united-kingdom-wakefield-factor

http://www.who.int/vaccine_safety/initiative/detection/immunization_misconceptions/en/

 

Scientific Method:

http://www.av8n.com/physics/scientific-methods.htm.

French as a Second Language is not Taught in a Vacuum; How Do We Teach All the Children?


I have spent a number of posts writing about the attempt of the New Brunswick Ministry of Education’s attempt to revise its FSL program because it mirrors situations in provinces and communities across Canada.   The situation there seemed to be typical not only of difficulties in FSL education across Canada but also typical of the way efforts to improve education are stymied by political haste and unwillingness to thoroughly understand the issue, typical of the insufficient or inadequate resources used to research every aspect of the problem and typical of the inflexibility in proposing solutions apparently set in stone.  Surely solutions require brainstorming for a time before an effective answer can be found.

            Let’s look at the problem New Brunswick really had:

  • Very few of the students were leaving high school with any kind of fluency in their second language, French.
  • The FSL teachers could not be guaranteed to be Francophone or of native-like quality in their French
  • If the FSL teacher’s French was excellent, his training in teaching L2 couldn’t be guaranteed to be sufficient.
  • Both the Early and Late French Immersion programs were losing large proportions of their students before the end of high school, thus making it unlikely that the bilingual goal of the programs would be achieved.
  • Some parents were placing their children in Immersion in order to ensure that their children were in a stream with few learning-disabled, immigrant or disruptive students. 
  • In spite of the politically correct statements about French Immersion being available to all children, the truth is that there was little support for children who flounder in the program for whatever reason.  If there are not enough bilingual teachers with appropriate training to teach French, it stands to reason that there would not be enough bilingual special education teachers.
  • Only 80% of children of the appropriate age live within 16 kilometres of a school offering EFI.  This means that one fifth of New Brunswick children entering first grade did not have the option of entering EFI.  I suspect most of those are in rural populations.

Unfortunately, almost everyone who took issue with the Croll/Lee report focussed on Early French Immersion; they saw it as an attack on Early Immersion. Although they fiercely criticised the report and many of those criticisms were warranted, they missed the kernel of the problem and not only proposed no solution but did not acknowledge that there was a problem.  Most critics were too busy marshalling their arguments for the reinstatement of the EFI to concern themselves with the whole picture.

So here is the problem: New Brunswick wants its Anglophone graduates to speak sufficient French to get by in a Francophone area.  At this moment very few are anywhere close to modest fluency, much less bilingualism at graduation.  N. B. can’t throw money at this problem to fix it. 

French Immersion is a pretty good system for teaching French when the students stay in it right through to Grade 12 and when the appropriate supports are provided.  Most students who start in FI, especially EFI, don’t stay the course. Of the kids eligible to start in EFI, 20% would have to travel over 16 k, making EFI an unlikely option.

There is strong evidence that the ministry has not been successful in training or finding enough near-native French speaking well-trained French teachers.  This is one of the reasons that support for children floundering in FI is not available.  It is also a factor frequently ignored by researchers, educators, parents and politicians.  Would it be better to have fewer and better French teachers?

The other problem with FI seems to be social; it may be due to inadequate support from the ministry or class perceptions of the parents.  Whatever the cause, students in difficulty in FI don’t stay in FI.  With that awareness, some parents won’t even put their kids in FI, some will be gently dissuaded by well-meaning teachers and other parents will have their children transferred to the Core French program when she starts to have difficulties.

Daily lessons don’t seem to be effective in teaching FSL; we don’t know why but it doesn’t work.  Students are usually bored and uninterested at best.  A program called Intensive French, requiring a one off year of differentiated programming shows promise on a number of levels.

THE BOTTOM LINE:  What solution will do the best job of teaching all of the children to speak sufficient French to order a meal, make an appointment with a doctor or ask for help in normal day to day life?  Of course, some of the children can go much farther than that so we want a program that will provide for them, too, if we can afford it; we have to remember, though, that some things don’t just cost money, they also cost opportunities for others.  This should be the bottom line for every ministry of education in the country and every Anglophone board of education in the country.

THE SOLUTION will require the wisdom of Solomon and parents who are willing to put other people’s children’s needs first.  It will require politicians who call it like it is and researchers who look beyond one narrow area of research.  It will require unions who will acknowledge that although their mandate is to protect jobs, they are teachers first and want what provides a good education for students.  We have the capacity to provide for the educational needs of our children but not the wants of all the stakeholders.  It is time for the adults to act like adults.