Errors and Omissions in Experimental Trials - 2c
CHAPTER 20
Further criticisms and comments.
In the second edition of the
monograph Fluoridation. Errors and Omissions in Experimental Trials it
was stated that copies of the first edition were sent by the Federal
President of the
Australian Dental Association to all the men in charge
of the trials which had been considered.
As has been mentioned, criticisms by
the authors of the Evanston and the Brantford (Canadian Department of
National Health and Welfare) studies, were published as "book
reviews" in the February, 1960, issue of the Australian Dental
Journal.
After the second edition was "in
press", the June 1960 issue of Nutrition Reviews was received,
containing (Vol. 18, pp. 161-165) a paper by Dr J.M. Dunning entitled
"Biased criticism of fluoridation. This paper quoted some passages
from "... letters to Dr Kenneth Adamson, President of the Australian
Dental Association" from the senior author of the Grand Rapids
trial, Dr F.A. Arnold Jr., and from the senior author of the Newburgh
trial, Dr D.B. Ast, and some criticisms by Dr J.R. Blayney of the
Evanston trial, which had not been published in the above-mentioned
"book reviews" in the Australian Dental Journal.
The following pages contain all the
passages from those letters which were published by Dr Dunning. In view
of the title he gave to his paper, it is considered likely that he cited
from those letters the quotations which he considered to be the most
important criticisms advanced by the authors of those fluoridation
trials.
These comments were prepared in 1960
and had a very limited circulation in roneoed form. They have not been
otherwise published until now because of the refusal of many editors to
accept comments which question fluoridation.
Dr F.A. ARNOLD JR
Dr Dunning said that: "Dr F.A.
Arnold, Jr., Director of the National Institute of Dental Research and
principal investigator at Grand Rapids, writes in part as follows (Arnold
to Adamson. October 16. 1959)".
The quotation from Dr Arnold's letter
which will be considered first is the following accusation (as reported
by Dr Dunning):
(84) "Although he [the author of
the monograph] did not publish his material until 1959, he (apparently
intentionally) overlooked the report of the tenth year of the study which
appeared in 1956. As was originally planned, it was this year that we
obtained "complete" age groups of adequate size."
Comment.
It is difficult to believe that Dr Arnold could have made this
extraordinary accusation for, if the monograph is consulted, it can be
seen that "...the report of the tenth year of the study which
appeared in 1956" the paper by Arnold et al. (1956) - was (a) listed under Dr Arnold's own name in
the references, (b) shown, again under his name, in the Index, which
indicates that this paper was mentioned on four pages, and (c) was given
as the source of the data from which Figures 1 and 2 were compiled (pages
147 and 148). These two figures depict the caries rates reported for each
age group in each year in the city of Muskegon up to the time when, as a
result of its water supply having been fluoridated, it ceased to be the
"fluoride-free" control city for Grand Rapids. (See explanatory
notes to Figures 1 and 2, pp. 147 and 148).
If Dr Arnold is correctly quoted by
Dr Dunning, it would appear that, before criticizing it, he read the monograph
only superficially, even that part of it which relates to his own study.
Furthermore, it is clear that, before making the accusation that
"apparently intentionally" this 1956 report from the Grand
Rapids study had been "overlooked", he failed to check both the
list of references and the Index.
If this is not the case, one is
forced to conclude that Dr Arnold made this accusation deliberately,
knowing that it was untrue, with the intention of misleading the
President of the Australian Dental Association.
That author was also reported to have
written (85-91):
(85) "He [Sutton] overlooks the
fact that one examiner has been with the study throughout."
Comment.
This fact was not "overlooked". This can be seen by referring
to the monograph, the top of page 144 where Arnold et al. were quoted as saying that: "There have been
changes in the dental examiners with the exception of one officer who has
participated in each series of examinations. Each new examiner has been
calibrated against this one officer to standardize diagnostic
criteria" (Arnold et al.,
1953).
(86) "If we used his findings,
we would come up with the same general result."
Comment.
As it is unlikely that the findings of this examiner were not used in
this study, it is concluded that Dr Arnold is referring to the situation
which would have arisen if the data from this study had been confined to
those obtained by that one examiner. However, no comment can be made in
this matter as in the published data the findings of the examiners were
combined.
(87) "Also, we could call
attention to the fact that two more of the four examiners used throughout
the first ten years of the study started examining during the third year
of the study and have participated each year since. "
Comment.
Dr Arnold refers to "the four examiners used throughout the first
ten years of the study". However, in a note published on the first
page of his report of the tenth year of the study (Arnold et al., 1956), he stated that:
"The following dental officers of the Public Health Service conduct
the annual dental examinations", and named five examiners: Doctors
Likins, Russell, Scott, Singleton and Stephan. In addition, he mentioned
the names of four other dentists who "also participated as
examiners" in the study: Drs Loe, McCauley, Ruzicka and Short. In
his 1953 report also (Arnold et al.,
1953) he had acknowledged the participation of the same nine examiners
not four as Dr Arnold stated in his misleading letter to the President of
the Australian Dental Association.
(88) "He criticizes our
selecting samples by school grade. If he would realize it, and probably
he does, this strengthens the study."
Comment.
It is evident that Dr Arnold has changed his views on this matter. When,
in 1953, he described the method used (Arnold et al., 1953), he acknowledged that "choosing examinees
by grade in this manner will, in some instances, not give
well-distributed specific age groupings." But now he says that
"... selecting samples by school grade ... strengthens the
study."
(89) "In the first place this
gives us a random sample."
Comment.
In order to be satisfied that the children examined constitute a random
sample of those in the city, it is necessary to know if the children were
a random sample of those in their school and, also, that the schools in
which the examinations were made were a random sample of those in each
city. The method of sampling, as described by Arnold et al. (1953), was stated on page 153. The meagre description
that "on the basis of available information" (which was not disclosed)
" 25 representative schools were selected" - no description of
the method of selection being given - does not permit the reader even to
attempt to determine whether or not the schools selected constituted a
random sample of those in the city. In the next report (Arnold et al., 1956) it was not stated
how many schools were selected, merely that "The annual samples of
the school population of Grand Rapids and Muskegon are taken from schools
selected as representative of each city as a whole." (See comment 91
below for an independent report on the sampling methods used in this
study.)
(90) "Also, it permitted us to
examine all the children of a grade without the examiners knowing whether
the child belonged to the "continuous resident" group or
not."
Comment.
This fact was mentioned by Arnold et
al. in 1953. However, it is of little consequence, for no comparisons
were published between the caries rates in the "continuous
resident" group and the other children in Grand Rapids. This
statement by Arnold indicates that he realized the need for
"blind" examinations. However, he made no attempt to
incorporate this vital point in experimental design when he arranged for
the examination of the Grand Rapids children and their comparison with
those of the control city of Muskegon. The desirable aim of eliminating
unintentional bias on the part of the examiners would have been achieved
if the children in the test and the control cities had been examined on
the same occasions "without the examiners knowing whether the child
belonged to the "continuous resident" group in Grand Rapids or
the "continuous resident" group in the control city of
Muskegon. Unfortunately this was not done.
(91) "The planning of the study
and the analysis of the data were done by a group of people all of whom
are more knowledgeable in this field of research than is Dr Sutton."
Comment.
No comment will be made on this remark (except to say that Dr Arnold has
never met me) but it is pertinent to quote another opinion. T.M.
DeStefano (Bull. Hudson County Dent. Soc, 23: 20-31, Feb. 1954) quotes
from the critique of the report of the "seventh Year of Grand
Rapids-Muskegon Study" (Arnold et
al., 1953) that "... had been sought and paid for by a group of
general practitioners from a reliable statistical firm" (the
Standard Audit and Measurement Services, Inc., 89 Broad St., New York 4,
N.Y ). DeStefano quotes this critique as stating:
"The authors appear to have
demonstrated an unfortunate disdain for some of the pre-requisites of
valid research." Also that "In the first place, the sampling
design of the experiment is embarrassingly conspicuous by its absence.
Such a brief description as: "On
the basis of available information the 31 school districts in Grand
Rapids were classified on a socio-economic basis. From the 79 schools in
those districts, 25 representative schools were selected and the
examiners assigned ... etc." leads one to suspect that the drawing
of the sample was dangerously amateurish. This suspicion makes one feel
that either the results of fluoridation are so dramatic as to force
themselves through the veil of poorly selected samples or "at the
other extreme" that the reported results are merely the fiction of a
biased sample. From work other than that reported by the authors, one
tends to discard the latter possibility but the lack of sophistication
shown in selecting the sample leads to complete bewilderment as to the
precise effects or the extent of the effect of fluoridation."
This critique by the Standard Audit
and Measurement Services continues:
"With a pre-listed population
(such as a school enrolment) there would appear to be no excuse for not
using modern sampling tools and procedures. Employment of these devices
would enable not only a more certain statement of the effects of fluoridation
but (perhaps more importantly) a precise estimate of the error inherent
in such statements."
DR D.B. AST
Dr Dunning then said that "Dr
David B. Ast, Director, Bureau of Dental Health of the New York State
Department of Health, makes the following comments (Ast to Adamson, March
3, 1960)".
Dr Ast is reported to have written
(92-7):
(92) "Sutton criticizes the
comparability of data among the four studies because in Newburgh and
Kingston we used the rate based on DMF per 100 erupted permanent teeth instead
of DMF per child."
Comment.
Contrary to this statement by Dr Ast, "the comparability of data
among the four studies" was not criticized. However, it was pointed
out that it is very difficult to compare the results shown in the five
reports from Dr Ast's Newburgh trial because of the different methods of
presentation of data that were adopted by Dr Ast and his co-workers. Nor
was criticism levelled at the use of "the rate based on DMF per 100
erupted permanent teeth"
(93) "We explained why we used
the permanent tooth population as the universe considered."
Comment.
The paper giving this explanation (Ast et al., 1956) was referred to on twelve pages of the
monograph.
(94) "However, in order to make
our data comparable to other study data, in the reports for 1953-54 and
1954-55, the Newburgh-Kingston data were given both ways - DMF per 100
teeth, and DMF per child."
Comment.
If the aim of Dr Ast and his co-workers was to make the data from their
study "comparable to other study data", it is unfortunate that
they did not examine the methods used in publishing the data obtained in
other studies and publish some tables in which the Newburgh-Kingston data
were presented in the form used in these other studies. Owing to this
omission, they prevented comparisons being made with the results
published in the other studies considered in the monograph by: (a) not
disclosing any caries rates for deciduous teeth except in their 1951
report, (b) confining the rate "DMF teeth per 100 children" in
1953-54 to those aged six, seven, eight, nine and ten years (Ast et
a1.,1956); (c) combining the 1954-55 caries data into four groups
children aged six to nine years, ten to twelve years, thirteen to
fourteen years, and sixteen years of age (Ast a a1.,1956). In the other
main studies, although the DMF rates were shown per child or per 100
children, either clinical examinations only were used, or the data were
reported for individual yearly ages or for age ranges which were
different from those used by Ast et
al. Thus, comparison of these rates with those published from the
Newburgh study cannot be made.
(95) "What is significant and
had escaped Sutton is the fact that the percentage differences in
Newburgh and Kingston were almost the same for both methods used."
Comment.
Dr Ast, no doubt, did not mean to suggest that the results were almost
the same in the test and the control cities, but intended to refer to the
percentage differences (in caries rates) between Newburgh and Kingston.
It is surprising that Dr Dunning
should have published this remark of Dr Ast, for a paper which he wrote
almost ten years earlier (Dunning, 1950) showed that he realized the
inadequacy of results stated merely as percentage reductions. In the
summary of that paper he pointed out that "Interpretative and other
examining errors in DMF studies may be large, easily exceeding 100 per
cent differences between samples." He said also that:
"Illustrations of actual data
indicate that the standard deviations of observations about the means
(averages) in DMF studies are large even where examining errors are
reduced to a minimum." Dr Dunning then said that: "These two
sources of variability imply that human DMF studies should be subjected
to close scrutiny as to the validity of the data and statistical significance
tests applied and reported wherever possible. Mere statements that
"caries was reduced by x per cent" are not sufficient."
It can be seen that it is precisely
this method of presenting data, that Dr Dunning criticized in 1950, which
was used by Ast et al. to
report the results from the Newburgh trial: "Mere statements that
"caries was reduced by x per cent" (differences between the
test and the control cities) without "statistical significance tests
applied and reported."
(96) "Another criticism made is
that baseline data were collected in Kingston a year after the Newburgh
survey. I can't believe Sutton really believes this to be valid
criticism. He must be, or should be aware of the fact that caries is not
an acute disease of short duration, but a slowly developing one
..."[end of published quotation].
Comment.
Dr Ast is wrong in his assumption - it certainly is considered to be
valid criticism to point out that the initial examination was not made in
the control city until after the fluoridation of the test one. By writing
about the obvious fact "that caries is not an acute disease of short
duration, but a slowly developing one" Dr Ast avoids the significant
point: that he and his co-workers assumed that the caries rates in the
children in the control city would be similar to those in the test one,
and that they omitted, prior to starting the experiment, to test this
vital matter.
(97) "The baseline data in
Newburgh and Kingston based on the examination of all the school children
age six to 12 in both cities were almost identical. All of the
examinations were made by the one examiner. Could Sutton really believe
that the DMF rate of 20.8 for Kingston, and the 21.0 for Newburgh could
have been significantly different if both examinations were made exactly
at the same time?..." [end of published quotation]. "... this
type of criticism questions not the research but the professional acumen
of the critic."
Comment.
Dr Ast and his co-workers were fortunate that they were able to present
figures for caries rates which were comparable, although the fact should
not be forgotten that they improved the comparability between the initial
caries rates in the test and the control cities by combining the data
from children of different ages.
The workers who conducted the Evanston
study made the same assumption and failed to examine the children in the
control city until after the fluoridation of the test one (Blayney and
Tucker, 1948; p. 153). They were not as fortunate as were Ast et al., for they found "...a
lower caries rate for school children of the control area" (Hill et al., 1951). In the younger
children, there were gross differences between the initial caries attack
rates in Evanston and its control city. The same omission was made in the
trial in Hastings, New Zealand. As a result, the control was abandoned,
for its caries rates were lower than in Hastings (Ludwig, 1958).
DR J. R. BLAYNEY
Dr Dunning then said that "J.R.
Blayney, Director of the Evanston Dental Caries Study, comments thus
(Blayney to Adamson, November 23,1959)". Dr Blayney is reported to
have written (98-100):
(98) "Dr Sutton ....states,
"the arbitrary selection of the data which is then termed
"representative", instead of making the ultimate findings to be
considered valid and reliable, would render a report based on this
selective data unfit for serious consideration."
Comment.
This "quotation" is inaccurate. Dr Blayney has omitted the
words "a section of and refers to "selective data" instead
of to "selected data" . The original paragraph was:
"However, the process which they described - the arbitrary selection
of a section of the data, which is then termed "representative"
- instead of making "the ultimate findings to be considered valid
and reliable", would render a report based on this selected data unfit
for serious consideration."
(99) "We feel that this type of
criticism is unworthy of the scientific nature and dignity of the
University of Melbourne and would tend to imply that the rather
reasonable separation of white and Negro, public and parochial children,
for the purpose of comparing like with like, is an "arbitrary
selection" making the "data unfit for serious
consideration" and that the entire report hinges only on this
pre-selected data. "
Comment.
This comment by Dr Blayney to the President of the Australian Dental
Association is misleading. The statement by Hill et al. (1950), which was quoted on pages 151 and 152 and to
which the comment made by the author of the monograph refers, made no
mention of the "separation of white and Negro, public and parochial
school children", but instead, stated the intention of including
"... only those groups of children which are representative of the
population, with respect to dental caries experience",
Hill and Blayney originally did not
intend to separate the children into racial and school groups. It was not
until their 1951 report that mention was made that they contemplated such
an action, that is, not until a year after they published the statement
mentioned above. They decided to separate the
Evanston data into racial and school groups when they found that the
initial examinations "... indicated a lower caries rate for school
children of the control area" (Hill et al., 1951). They have not explained why it was necessary
to exclude from the main body of white children those who happened to
attend the parochial school, rather than the public one.
As they consider that Negroes have
less dental caries than white children it is, of course, reasonable to
consider the data of white children separately from those of Negro
children. However, Hill et al.,
first included the data of Negro and parochial school children (with
those of the white children attending public schools), then excluded
these (Negro and parochial school) data for several years, and then, despite
their statement that such a process was necessary, reversed their policy
and included these data with those of the white children attending public
schools. By this reversal of policy they were able to present initial
caries rates for the test city which were more comparable to those in the
control city than would have been the case if they had not disregarded
their previously-stated policy of comparing
"like with like". This cannot be considered to be a reasonable
course of action.
(100) "We have gathered no
secret or concealed data" ...[end of published quotation].
Comment. This assertion by Dr Blayney should be considered in the
light of the numerous instances, in his study, in which relevant data
were not published, in some cases even for as long as twelve years after
they were obtained.
The failure of Dr Blayney and his
co-workers to publish these relevant data has, without question,
concealed them from readers of their reports.
Dr Dunning quoted two further
paragraphs from Dr Blayney's letter. These were printed in the "Book
Review" published in the Australian Dental Journal in the February,
1960, issue.
DR J.M. DUNNING
The criticisms made by Dr Dunning
himself will not be considered, for his attitude to the monograph and the
lack of care in the preparation of his critique are evident from even one
example:
He stated that "In discussing
requirements for a control, Sutton adopts the position that the control
city should be "comparable in all respects" to that where
fluoride is being added." That phrase was not used by the author of
the monograph, but was quoted by him from two sources (pp. 141, 178,
179,190). His, considerably different, views on this matter were stated
on pages 190 and 193.
Therefore, by attributing to the
author an opinion which he did not express, and that he actually
criticized (p. 190), and by omitting the different opinion that the
author did express, Dr Dunning misleads his readers.
Furthermore, the fact that Dr Dunning
has elected to publish these extracts from letters written by authors of
fluoridation trials, indicates either that he has chosen to ignore or has
failed to detect errors in them which should be obvious to a careful
investigator.
In 1984, twenty-four years later, Dr
Dunning was still criticizing papers which questioned fluoridation. He
continued his former technique of misleading his readers by inventing
false statements, attributing them to the author of the article he was
criticizing, then disputing his own false statements. He stated that
Colquhoun (1984):
"... mentions an increase in
periodontal disease as if it might have been caused by
fluoridation."
In fact, Colquhoun (1984) stated
that: "... water fluoridation does not affect" periodontal
disease.
Dr Dunning also wrote that:
"Colquhoun continues to quote
Sutton on the subject of defects in early studies of fluoridation,
stating that he (Colquhoun) has seen no convincing refutation of this. I
offer him my article, "Biased Criticism of Fluoridation" in
which I quote the views of several of the leading fluoride researchers of
the day. The studies Sutton criticizes most harshly have survived as
pioneer efforts and been confirmed not only for their conclusions but for
their methodology."
This was the paper in Nutrition
Reviews, mentioned above, which has remained unchallenged in print until
now, years after it was written, because of the difficulty in having
accepted for publication any material which questions fluoridation.
It is interesting that Dr Dunning
(1984), after so many years, can call the authors of the original
studies:
"... the leading fluoride
researchers of the day".
and say that their methodology had
been accepted, when he himself (Dunning, 1950) condemned the method they
used of expressing caries changes as percentages without the use of
statistical tests.
That Dr Dunning now accepts their
methods, such as that used in the Evanston study which led to the authors
admitting that they had made gross errors in stating the number of
children seen during one examination, one of which was a discrepancy of
more than 1000 children shows that he should be included with those
described by Professor John Polya (1964) as:
"... unreliable witnesses before
a jury either of scientists or of lay common sense."
It is clear that Dr Dunning's
criticisms can be disregarded. He is one of those critics whose intense
pro-fluoridation opinions have made them muddled thinkers, and he is one
who intentionally manufactures incorrect statements about those he
criticizes to try to attack work which he cannot find grounds to fault by
legitimate means.
ADDITIONAL OBSERVATIONS ON THE EVANSTON, GRAND RAPIDS AND
NEWBURGH TRIALS
1. Gross numerical errors in statements of the number of
children examined.
The Evanston Trial
These comments on the Evanston trial
were published in 1980 in the present author's book Fluoridation
Scientific Criticisms and Fluoride Dangers. It was stated:
"Additional Errors in the
Evanston Trial Data.
In January, 1967, which was the
twentieth anniversary of the commencement of the Evanston Trial, an
entire special issue of the Journal of the American Dental Association
was devoted to a report on that study (Blayney and Hill, 1967). In this,
the original tables, complete with their gross numerical errors, were
reproduced, despite the fact that these [errors] had been pointed out
eight years earlier (Sutton, 1959) and some of them had been acknowledged
by the authors (Sutton, 1960). In addition, several faulty tables were
published for the first time.
The tables [in this issue of the J.
Amer. Dent. Ass.] then showed three different statements regarding the
number of children aged 6-8 years who were examined in Evanston during
the 1946 examination:
(i) 1991 children - see Tables 10,
11,30,40 and 47.
(ii) 1985 children - see Tables 7,8,16,18,21 and 32.
(iii) 1754 children - see Tables 24 and 25.
There were also no fewer than six
different statements in that article of the number of children aged 12-14
years examined in Evanston in 1946:
(i)
1703 children - see Tables 15 and 32.
(ii) 1702 children - see Table 47.
(iii) 1701 children - see Tables 11,30,41,44 and 45.
(iv) 1697 children - see Tables 7,9,12,13,17,19,22 and 31.
(v)
1556 children - see Table 26.
(vi) 1146 children - see Table 46.
Between the sum of the two highest
statements of the number of children examined in Evanston in 1946, and
the sum of the two lowest statements of children examined in the same
year in the same study in the same city, there is a difference of 794
children (1991 + 1703 - 1754 - 1146 = 794).
The number of children stated to have
been examined in Evanston is even more divergent in the original papers
than in this special article. Blayney and Tucker (1948) and Hill et al. (1950) both gave a figure
of 4375 children, compared with the number of 3310 in Hill et al. (1957b), a difference of
1065 children.
It was these differences which the
medical journalist Anne-Lise Gotzsche, in a letter to the Lancet in 1975,
said that she had showed to workers in other fields, and that they had
"simply laughed" at the statistics (see Fig. 5, p. 167).
In that book (Sutton, 1980) -
prepared as a submission to the Committee of Inquiry into the
Fluoridation of Victorian Water Supplies (1980) - it was stated (p. 203):
"These errors were mentioned [by
the present author] 12 years ago to the Tasmanian Royal Commission on Fluoridation.
Since that time I have not heard of any mention of them or of a criticism
having been made of the numerical data published in that report."
It appears that, in the manner common
in fluoridation trials, those erroneous tables have been accepted at
their face value, without investigation.
More than thirty years ago it was
pointed out (Sutton and Amies, 1958b) that:
'This uncritical attitude to these
studies is rife." "Also it has been assumed that associations
and individuals that ... accepted the responsibility of publicly
advocating fluoridation, have undertaken independent examinations of the
data, and not merely repeated the opinions of others."
This situation was referred to by
Professor John Polya (1964) in his book Are We Safe? He wrote:
"It is immaterial that other
evidence in favour of fluoridation is not always false; the point is that
persons, bodies and arguments that knowingly or in simplicity acquiesce
in one blatant falsehood are unreliable witnesses before a jury either of
scientists or of lay common sense."
He continued:
"The scandal created by the
exposure of this absurdity resulted in the admission that the first
figure (4,375) was correct. In defence of the other claims it was
explained that "out of range" children were eventually excluded
from the survey, but then further critical check revealed more numerical
inaccuracies, not to speak of the magnitude of a correction exceeding
1,000. In better examples of scientific work the author sticks to his
experimental group; discarding on the scale quoted strongly suggests that
the experiment had to be altered to fit pre-conceived results. This is
one of the common consequences of working without control of observer
bias."
It is pertinent to point out that, in
the Foreword to that article in the special edition of the Journal of the
American Dental Association, in January 1967, Dr F.A. Arnold, Jr., the
Assistant Surgeon General, Chief Dental Officer, U.S. Public Health
Service (and formerly the chief experimenter in the study in Grand Rapids)
stated:
"Here, in a single report, are
data on the effect of water fluoridation on dental caries so completely
documented that the article is virtually a text book for use in further
research. It is an important scientific contribution towards the betterment
of the dental health of our nation. It is a classic in this field."
It is indeed a classic - a
first-class example of the errors, omissions and misstatements which
abound in the reports of these fluoridation trials.
2. False information in the Abstracts of papers
The abstracts of reports on
fluoridation trials are unusually important, for it is likely that lay
people, and politicians in particular, will confine their reading of the
report to the Abstract, assuming that it accurately reflects the findings,
and will base their opinions and actions on its statements.
The Grand Rapids Trial. The final report of the Grand Rapids
study was published in 1962. Reading the Abstract which preceded the body
of the article it would seem that, at last, the authors (Arnold et al., 1962) had come to realize
the necessity for comparing the results from the test city with those
from the control one for they stated that the results had been
"...compared with the caries attack rates in the control group of
children in Muskegon, Mich." This claim was not made in the body of
the article, which included the statement that: "... fluorides were
introduced to this [Muskegon] water supply in July, 1951" Therefore
at that time Muskegon ceased to be a control city, some eleven years
before this final report (Arnold et
al., 1962) from Grand Rapids.
How then, in 1962, could the final
result from the test city be compared with data from a non-existent
control one?
The claim of Arnold et al. (1962) that they compared
the Grand Rapids caries rates with those in the "control group of
children in Muskegon, Mich." is shown to be false by their statement
that: "...in subsequent [after 1954] analyses of Grand Rapids data,
comparison has been made with the original Grand Rapids findings and with
those for Aurora."
This is confirmed by the statement in
the Abstract that:
"Caries attack rates were
lowered by 57 per cent in children 12 to 14 years old in 1959." This
figure of 57 per cent is obtained by averaging the figures of 57.0, 63.2
and 50.8 per cent for the ages of 12, 13 and 14 years shown in their
Table 2 to be the "per cent reduction in DMF teeth (19441959)"
in Grand Rapids (not between Grand Rapids and its control city of
Muskegon).
The Newburgh Study. Similar mis-information regarding comparisons being made
between test and control cities was published in the same year (1962) by
Dr David Ast, the senior author of the Newburgh study. In the Abstract of
that paper (Ast and Fitzgerald, 1962) he wrote:
"Among children 12 to 14 years
old in the four study areas, reductions in the DMF rates as compared to
the rates in control cities ranged from 48 to 71 per cent."
Table 2 is the only one in that paper
showing DMF rates for children aged 12-14 years (in one case 13-14
years). In the first two studies listed, Grand Rapids and Evanston, no
reference is made to a control, the "reduction" in Evanston,
shown as 48.4 per cent, is obviously the 48 per cent mentioned in the
Abstract. This "difference" is between the rates in Evanston in
1946 and 1959, not between Evanston and a control, as stated in the
Abstract. The Grand Rapids rates are also shown between that city in
1944-45 and 1959, no control data being used. Indeed Ast and Fitzgerald
stated in the main text:
"In the Grand Rapids and
Evanston studies the control cities were lost before the study was
completed, so that the current data have been compared with the base line
data."
Not with control cities, as they
stated in their Abstract.
There should not have been any
confusion regarding the use of the term "control", for the
co-author of that paper, Bernadette Fitzgerald, was described as the
"senior biostatistician, division of special health services, New
York State Department of Health." Therefore the authors' incorrect
statement that they compared the caries rates "in the four study
areas" with rates in control cities is unlikely to have been made
inadvertently.
3. Continuing publication of false statements.
It has just been shown that Dr Ast
(the senior author of the Newburgh study) and Dr Arnold (the senior
author of the Grand Rapids study) continued to disseminate false
statements regarding their studies many years after those ten-year
studies were concluded, Also, the arrogance of Drs Blayney and Hill (the
authors of the Evanston study) in publishing an article in 1967, which
repeated, in a special issue of the Journal of the American Dental
Association, figures which they had acknowledged seven years earlier were
faulty (Sutton, 1960), indicates the reckless disdain of all those
authors for the truth, and for the members of the scientific community
(which normally trusts statements made in established journals by senior
scientists, for it is not used to being misled by such readily-verified
deceptions).
Their false statements do not
engender confidence in the reliability of the data published and the
statements made by those senior scientists in their original reports of
what are still regarded by fluoridation advocates as three of the four
main fluoridation studies on which the case for fluoridation mainly
relies - those in Newburgh, Grand Rapids and Evanston in U.S.A.
Commenting on the Grand Rapids study,
Ziegelbecker (1983) pointed out that the experimenters had examined
"all" children from 79 schools in Grand Rapids at the
commencement of the trial, but that:
"After 5 years in 1949 they
selected children at only 25 schools in Grand Rapids for their
investigation and observed children at the same time at all schools in
Muskegon (the control city)."
For instance, the number of children
aged 12 to 16 years who were examined in Grand Rapids at the commencement
of the trial was 7,661, but only 1,031 were examined in 1959 (Arnold et al., 1962).
In 1988, Colquhoun stated:
"In the control city of Muskegon
all children were examined throughout the period. From the year-by-year
figures for six-year-olds which were published three years later in 1953,
it is revealed that an impossible 70.75% reduction was recorded in the
first year of the trial (Arnold et
aL,1953) and that there was then an increase and no overall reduction
in the following years. Examination of similar data for other age groups
shows that the sample of 25 schools could not have been representative of
the population being studied."
He pointed out that:
"The reported DMF of several of
the age groups in this sample, approximately one year after the initial
examinations, was lower than that of the same children when they were a
year younger."
He concluded:
"Fluoridated water cannot turn
decayed, missing or filled teeth into sound ones. It follows that the
caries experience of the children had not been reduced as claimed. The
large recorded reductions, which were mostly in the first year only, were
a result of selection of data."
4. Fictional results?
In 1954 De Stefano reported the
findings of professional statisticians regarding the Grand Rapids study.
They raised the question whether "... the reported results are
merely the fiction of a biased sample."
Ziegelbecker (1983) also, studied
this situation. He stated:
"We must conclude from this result
that the sample in Grand Rapids was not representative for all children
and with respect to the basic examination. In the following years from
1946 to 1949 (and later to 1954) the 25 schools in the sample were the
same each year and we see that the caries experience in the sample was
not reduced by fluoride in 1946-1949.
If we accept that the sample was
representative for the children, aged 6, in the 25 schools in those years
then we must conclude that fluoride in the drinking water had not reduced
the dental caries experience of children, aged 6, in Grand Rapids in the
years before the US Public Health Service released the policy statement
[endorsing fluoridation] to the American Dental Association."
He concluded:
"We must conclude from these
results that a fluoride content of 1 ppm in the public water supply does
not reduce dental caries experience."
Colquhoun stated in 1988:
"In their final study in Grand
Rapids, published in 1962 after 15 years of fluoridation, American health
officials [including the director of the U.S. National Institute of
Dental Research, Dr F.A. Arnold, Jr.] wrote: "... no such dramatic
and persistent inhibition of caries in large population groups had ever
been demonstrated by any other means than fluoridation of a domestic
water supply."
Colquhoun commented:
'That statement, which could be
described as the dogma of fluoridation, is now considered by an
increasing number of critics to be unscientific and untrue."
In view of the disclosure of the
types of error which have just been mentioned, such a grandiose claim,
although it was widely accepted at the time, can no longer be considered
to be true.
More than thirty years ago Sutton and
Amies (1958a) commented on this sudden initial decrease in caries
reported from Grand Rapids (and from other studies considered). It was
stated that the results reported were not those which would be expected
if the hypothesis was correct that fluoride "strengthens"
developing teeth and makes them more resistant to attack by caries.
Despite the fact that the results published from fluoridation studies do
not support this hypothesis, it is still mentioned. For instance, the ten
members of the task group which in 1984 wrote the latest WHO book on this
subject: Environmental Health Criteria 36. Fluorine and Fluorides,
referred to the importance of "lifelong consumption" of
fluoridated water.
|
No comments:
Post a Comment