Talk:Evidence-based medicine/Draft: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Robert Badgett
m (Text replacement - "CZ:Article Mechanics" to "CZ:Article mechanics")
 
(34 intermediate revisions by 8 users not shown)
Line 1: Line 1:
{{subpages}}
{{subpages}}
== Too many sections? ==
I'm sure this article is excellent, but, without reading it, I wonder if we could sensibly and usefully reduce the number of headings?  This tends to interrupt the flow of the article.  Actually, so many headings actually makes it hard for a "flow," or a narrative, to develop in the first place.  Please see [[CZ:Article mechanics|Article Mechanics]] on this; the longer version goes into this in some detail. --[[User:Larry Sanger|Larry Sanger]] 22:03, 21 February 2008 (CST)


Hey, this page needs to be archived!  It's getting very long! --[[User:Larry Sanger|Larry Sanger]] 22:03, 21 February 2008 (CST)
::Okay, I archived for a fresh new outlook. --[[User:D. Matt Innis|D. Matt Innis]] 11:58, 12 March 2008 (CDT)
:I cut out some stuff. Also, does anybody mind if I cut out the section "Why do we need EBM"? I do not see that it adds much to the text in the introduction. Also, it contains no references. - [[User:Robert Badgett|Robert Badgett]] 22:14, 21 February 2008 (CST)


I will be gad to help author here, and would like to go over a plan for the article. I think that, as this article covers a a special sort of medical field that we should discuss "audience". Please, fellow editors, argue with any of these points if they differ from your understanding. Evidence based medicine is certainly all about clinical care of patients- but, unlike an article on dermatology, say, it really is about a way of thinking about medicine, an approach. Reading what is written so far- it is really meaty and presents that approach, but, in my mind suffers from 2 faults, one is that there is too much technical language without explanation, and (2) the history of medicine (in a way) has to be presented so that the naive reader understands that actually, "regualar medicine" is ''not'' evidenced based. I tyhink also, that including some real examples of changes in clinical practice that are based on evidence based medicine, may be helpful. I am going to add some of this and am open to discussion, especially from Supten. [[User:Nancy Sculerati|Nancy Sculerati]] 09:35, 15 May 2007 (CDT)
Agree it can be cut.[[User:Gareth Leng|Gareth Leng]] 11:46, 12 March 2008 (CDT)
 
Can we cut out the sentences like "For more information, see: Clinical practice guideline" and instead a) link the phrase at first appearance and b) add to the related articles subpage?[[User:Gareth Leng|Gareth Leng]] 11:48, 12 March 2008 (CDT)
== References-with notes ==
 
O'Malley P. Order no harm: evidence-based methods to reduce prescribing errors for the clinical nurse specialist. [Review] [17 refs] [Journal Article. Review] Clinical Nurse Specialist. 21(2):68-70, 2007 Mar-Apr. UI: 17308440 Classed under evidenced based medicine by Ovid (Medline) , his article reviews actual sources of medication errors.
 
Doumit G. Gattellari M. Grimshaw J. O'Brien MA. Local opinion leaders: effects on professional practice and health care outcomes.[update of Cochrane Database Syst Rev. 2000;(2):CD000125; PMID: 10796491]. [Review] [54 refs] [Journal Article. Review] Cochrane Database of Systematic Reviews. (1):CD000125, 2007. UI: 17253445
 
Lorenz LB. Wild RA. Polycystic ovarian syndrome: an evidence-based approach to evaluation and management of diabetes and cardiovascular risks for today's clinician. [Review] [60 refs] [Journal Article. Review] Clinical Obstetrics & Gynecology. 50(1):226-43, 2007 Mar.
UI: 17304038
 
Jordan A. McDonagh JE. Transition: getting it right for young people. [Review] [29 refs] [Journal Article. Review] Clinical Medicine. 6(5):497-500, 2006 Sep-Oct.
UI: 17080900
 
Thanigaraj S. Wollmuth JR. Zajarias A. Chemmalakuzhy J. Lasala JM. From randomized trials to routine clinical practice: an evidence-based approach for the use of drug-eluting stents. [Review] [48 refs] [Journal Article. Review] Coronary Artery Disease. 17(8):673-9, 2006 Dec.
UI: 17119375
 
Stanley K. Design of randomized controlled trials. [Review] [9 refs] [Journal Article. Review] Circulation. 115(9):1164-9, 2007 Mar 6.
UI: 17339574
 
== Sectioning ==
Are there perhaps more sections than are useful here?  [[CZ:Article Mechanics]] recommends against many relatively short sections in favor of relatively few, longer sections.  But I don't think we have any very hard-and-fast rules about this.
 
Glad to see you here, Dr. Badgett! --[[User:Larry Sanger|Larry Sanger]] 22:01, 23 October 2007 (CDT)
 
:Thanks - [[User:Robert Badgett|Robert Badgett]] 22:37, 31 October 2007 (CDT)
 
== 'Main' template not working ==
I added a new call to the main template, and now all three calls are not displaying correctly. - [[User:Robert Badgett|Robert Badgett]] 22:37, 31 October 2007 (CDT)
 
== Misuses of EBM ==
The article ignores the misuses of EBM in the real world.
Very few of the methods actually used in medicine have ever been validated by independent prospective randomized double-blind studies, or are likely to be.
The main use of EBM is by HMOs and other prepaid managed care organizations, as an excuse to refuse to pay for expensive studies or treatments, while happily paying for inexpensive, untested, unproven treatments, such as herbal and other "alternative" medicines.
I do not think this misuse of EBM should be ignored in this otherwise wholly laudatory article.
[[User:Harvey Frey|Harvey Frey]] 17:20, 12 November 2007 (CST)
: Hi!
: The use of the "there is no evidence that" is becoming a little too frequent in clinical medicine. I suggest these two articles for inclusion; unfortunately I cannot access them (full text) right now.
: J Med Ethics 2004;30:141-145 Evidence based medicine and justice: a framework for looking at the impact of EBM upon vulnerable or disadvantaged groups. W A Rogers
:  S I Saarni and H A Gylling Evidence based medicine guidelines: a solution to rationing or politics disguised as science?
: J. Med. Ethics, Apr 2004; 30: 171 - 175.
: May I summarize the two abstracts in the Criticisms section?
: [[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 23:34, 12 November 2007 (CST)
 
== Problem with the references ==
Somewhere around the 50th reference, there is a bug. Can someone fix this?
[[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 23:47, 12 November 2007 (CST)
: Great! [[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 13:50, 13 November 2007 (CST)
 
==Criticisms that may be incorporated into the Section==
 
I think more needs to be added about the sources of much so-called EBM, from sources interested in minimizing expenses of government health plans, like the Cochrane group, or through medical auditors interested primarily in maximizing profits of private HMOs, like Milliman & Robertson.
There also needs to be a fair admission of how little of accepted
medical practice has actually been validated by 'gold-standard' studies.
When should a procedure be denied based on lack of EBM support?
And, to what extent are surrogate measures acceptable when, say,
survival data is unavailable? For instance in Radiation Oncology (my own specialty) if you know that higher radiation doses kill more cancer cells, and high doses are usually limited by doses to surrounding tissues, and if you can show that some new technique gives less dose to surrounding tissues this allowing higher doses to cancers, is it irrational to take that as evidence that the new technique
is superior? Must an HMO insist on a prospective randomized double-blind
study using 20 year survival as an endpoint before allowing use of the new technique?
The other issue is the extent to which 'cost' should be involved in EBM
studies, and if it IS allowed, what should be the conversion factor between dollars and years of life, or dollars and years of pain-free life. Should we EVER do a coronary bypass operation, given that the same number of dollars could save thousands of lives if spent on malaria prevention instead? But, WOULD the dollars saved be spent on malaria prevention, or would it go to executive perks and stockholder dividends? One doctor in California recently received almost a billion dollars selling his share of an HMO. Those were dollars not spent on medical care, often justified by calling some procedure "not medically necessary", or "investigational"!
And, what weight should be given to the EBM "guidelines"? Should they be
used to overrule the decision of the primary doctor on the case? If so, who takes responsibility for adverse results? The clerk who countermanded a doctor's order based on an M&R cookbook? [[User:Harvey Frey|Harvey Frey]]
 
:I think these are all legitimate issues. What we have so far is a pretty mainstream article, your stuff would help. Much of this could be added to the 'criticisms' section, which is currently sparse. Some of what you suggest might be better on the clinical guidelines page. [[User:Robert Badgett|Robert Badgett]]
 
::Here's another example: http://www.careguidelines.com/ An entirely PROPRIETARY set of "EBM Guidelines" from Milliman, originally a hospital accounting firm, based on no known public peer review, widely sold to managed care organizations in the US, for the express purpose of controlling cost. And, of course they come with disclaimers, to avoid liability if anyone is injured by one of their clients using them. I do remember a case in California a few years ago when they figured prominently when a hospital prematurely discharged a woman post-delivery, based on these guidelines. Unfortunately, it wasn't an reported appellate case, so I'm having trouble finding it now. [[User:Harvey Frey|Harvey Frey]]
 
:::Interesting. I cannot find their guidelines to assess their methods, but from your description, it sounds like they hijacked the label evidence-based. [[User:Robert Badgett|Robert Badgett]]
 
: If I understood you well, the example you provide from oncology:
:''For instance in Radiation Oncology (my own specialty) if you know that higher radiation doses kill more cancer cells, and high doses are usually limited by doses to surrounding tissues, and if you can show that some new technique gives less dose to surrounding tissues this allowing higher doses to cancers, is it irrational to take that as evidence that the new technique is superior?''
: is an illustration of the difficulty of using causal inferences and, for that matter, common sense, in the framework of EBM. I unearthed something like a little gem, which could be useful in defining EBM from the practicioner's and patient's point of view (I'm not saying that this article is "one of its kind" though): Critique of (im)pure reason: evidence-based medicine and common sense <ref name="pmid15189382">{{cite journal |author=Michelson J |title=Critique of (im)pure reason: evidence-based medicine and common sense |journal=Journal of evaluation in clinical practice |volume=10 |issue=2 |pages=157–61 |year=2004 |pmid=15189382 |doi=10.1111/j.1365-2753.2003.00478.x}}</ref>
:''While the goal of evidence-based medicine (EBM) is certainly laudable, it is completely based on the proposition that 'truth' can be gleaned exclusively from statistical studies. In many instances, the complexity of human physiology and pathophysiology makes this a reasonable, if not necessary, assumption. However, there are two additional large classes of medical 'events' that are not well served by this paradigm: those that are based on physically required causality, and those that are so obvious (to the casual observer) that no self-respecting study will ever be undertaken (let alone published). Frequently, cause-and-effect relationships are so evident that they fall into both categories, and are best dealt with by the judicious use of common sense. Unfortunately, the use of common sense is not encouraged in the EBM literature, as it is felt to be diametrically opposed to the very notion of EBM. As is more fully discussed in the manuscript, this active disregard for common sense leaves us at a great disadvantage in the practical practice of medicine.''
: I believe that this criticism is important because it brings in bright light the relationship between EBM and fundamental research: the latter deals with complex-cause-and-effect relationships, the former with specific effects, out of the black box of human physiology. [[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 12:05, 14 November 2007 (CST)
 
==Some problems==
"Evidence-based medicine seeks to promote practices that has been shown, through the scientific method to have validity by empiric proof."
This needs re-thinking; I think that what is meant here is "promoting practices the effectiveness of which has been supported by stringent statistical analysis of the results of carefully controlled clinical studies."
 
Evidence-based medicine is not science-based medicine. Science-based medicine works from a fundamental understanding of basic mechanisms to generate a rationally designed intervention strategy. Not all medical interventions are actually based in science in this sense (and some would say that relatively few are). More commonly, they are based empirically on experience of what actually works, and the scientific rationale or explanation comes later (if at all).
 
Most importantly here though, the scientific method would test the ''explanations'' for the effectiveness of particular treatments by hypothesis-based experimental testing. Whether this has been done or not would not really influence the decision to use a particular intervemntion or not.[[User:Gareth Leng|Gareth Leng]] 03:55, 14 November 2007 (CST)
 
 
I haven't checked the references, only put them into what I think is style consistent within the article and consistent with Biology work group style; I've shorten author lists to et al. when there are more than 2 authors and omitted issue numbers as redundant, generally to try to keep the list concise for printing. My general feeling is that it seems over-referenced - I'd be wary of this as a large current reference list becomes outdated fast, a smaller list of elite core references has a longer shelf life. The size is also a burden for verification.
However it's a very nicely written very helpful article. I'd just return to the use of the word "proof" which I'd strongly urge that you avoid. Scientists would rarely consider anything to be proved; the evidence might be strong enough to accept a conclusion (provisionally), but if a conclusion rests on statistics then there is always a margin for error.[[User:Gareth Leng|Gareth Leng]] 06:51, 14 November 2007 (CST)
 
== required fixes, self approval? ==
Several things need fixing prior to approval. The article needs to be consistant, ie "evidence-based" vs "evidence based" oocurs in the article, as well as minor typos.  At least two sections are completely empty somewhere near the bottom, including the "Apply" and "Assess" sections.  They need to be removed or expanded.  Finally, the nominating editor appears to have created and written on this page. I suggest removal of nomination, a careful read and editing, and then re-nomination [[User:David E. Volk|David E. Volk]] 09:18, 14 November 2007 (CST)
 
== Studies of effectiveness section ==
The last sentence in this paragraph is not a sentence.  I can't figure out what was meant. I inserted EBM in a few sentences where it seemed to be missing.  [[User:David E. Volk|David E. Volk]] 10:15, 14 November 2007 (CST)
 
==Is this ready for approval?==
Several section were blank.  i added text from related articles to give an overview but we can't have an approved aricles with blank sections.  Also it seems incomplete in places.  Particularly, There are four cases of one sub section in a hierarchy.  This seems to imply there is another sub section that could be added.  If not then the subsection seems unnecessary.  For example;
:7 Incorporating evidence into clinical care
::7.1 Medical informatics
::7.2  ?
:8.3 Clinical reasoning
::8.3.1 Improving clinical care
::8.3.2  ?
:9.4 Apply
::9.4.1 Clinical reasoning
::9.4.2  ?
:10.3 Epistemology
::10.3.1 Complexity theory
::10.3.2  ?
 
In all these cases it seems like there should either be another subsection or that the x.x.1 sub heading is not required. I dpn't know enough about the topic to know what the ? might be. [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 22:44, 14 November 2007 (CST)
 
 
==What does this mean?==
I was trying to edit the second paragraph in the first section but came to the conclusion that i did not really know what it means.
::"''Evidence-based medicine seeks to promote practices that have been shown, through the [[scientific method]] to have validity by empiric proof. As such, it currently encompasses only a few of the actual practices in clinical medicine and surgery.  More often, recommendations are made on the basis of best evidence that are reasonable, but not proven. Evidence-based medicine is also a philosophy, however, that seeks to validate practices by finding proof.''"
 
The first sentence I would change to:
::"''Evidence-based medicine seeks to promote practices that have been shown to have validity using the [[scientific method]].''"
 
The second sentence reads I'm unsure what the point is. Is the implication that the actual practices in clinical medicine and surgery do not follow the scientific method? Is so, does this even need to be said, this is redundant with the first paragraph.
 
The third sentence seems redundant with the first sentence.  It says the same as "promote practices that have been shown to have validity using the [[scientific method]]"
 
The last paragraph relating to phiolosophy loses me. Phiolosophy and EBM seem to be the opposite of each other but this sentence seems to be saying they are both? i find this very confusing. I hope these comments are useful. [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 23:16, 14 November 2007 (CST)
:It looks like there's some redundancy in it, from an outsider point of view.  Even when it says that "Evidence-based medicine is also a philosophy, however, that seeks to validate practices by finding proof", it seems to read that A is something that relies on B, but A also seeks to prove B but I would not use the word "philosophy" but rather restate it as "Part of the ultimate goal of evidence-based medicine is to validate practices by establishing proof of the results." --[[User:Robert W King|Robert W King]] 23:41, 14 November 2007 (CST)
 
Isn't that exactly the same as the first sentence in the paragraph? Here I slightly reworded it and you'll see what I mean.
::"''Part of the ultimate goal of evidence-based medicine is to validate practices by using the scientic method.''"
 
It seems to me that the whole paragraph distills down to the first sentence:
 
::"''Evidence-based medicine seeks to promote practices that have been shown to have validity using the [[scientific method]].''"
 
[[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 23:50, 14 November 2007 (CST)
:::If the rest of the paragraph is superfulous because of redundancy, I'd probably just remove the errant content! --[[User:Robert W King|Robert W King]] 00:24, 15 November 2007 (CST)
::::That's what i have done.  Let's see what the health editors think.  [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 00:35, 15 November 2007 (CST)
 
==Industry and publication bias==
Reading this again, it struck me that an important part of meta-analysis and appraisal is neglected. Most studies where they are misleading are I think misleading because of flaws in design or conduct or analysis. I don't know that I've ever seen a study where legitimate criticisms can't be raised, that might affect the interpretation. A good meta-analysis grades the quality of the trials, weighting the outcomes by quality, and I think attempts to come to a global recommendation on the basis that while individual trials might be imperfect for different reasons, when collectively they come to a common conclusion that conclusion is probably reliable.
 
The issue of publication bias works two ways. First, negative or inconclusive results are less likely to be reported. Second, positive results may be more likely to be reported ''when they are confirmatory of already published findings'' even when the quality of the trial is poor.
 
Overall, industry-sponsored trials are given a rough ride here. It should be remembered I think that, without industry sponsorship, there would be far fewer trials in the first place. The quality of studies very much depends on the integrity and competence of the academic or clinical scientists conducting them. We as academics can't blame industry for our own shortcomings. I do think that the major pharmaceutical companies try to find academic partners whose integrity and competence are unimpeachable; it's very much in their interests to do so, whatever the outcome of the trials. 
 
[[User:Gareth Leng|Gareth Leng]] 03:59, 16 November 2007 (CST)
 
There are many "jargon terms" introduced here e.g.
Relative risk ratio
Relative risk reduction
Absolute measures
Absolute risk reduction
Number needed to treat
Number needed to screen
Number needed to harm
 
I wonder if it would be sensible to add a glossary as a subpage that gave definitions of these? Or is there some other solution? Perhaps there's a case for making a stub for each of these, with a brief definition and an external link.[[User:Gareth Leng|Gareth Leng]] 07:17, 16 November 2007 (CST)
 
:I like the glossary idea on subpages.  It goes along with the definitions template that Larry created as well. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 07:56, 16 November 2007 (CST)
 
== Delayed approval ==
 
Although this article is outside of my sphere of competence, I recomment delaying the approval for at least 7 days, so that changes can be made. There are too many comments here from senior scientists, which may not be taken into account if the approval occurs
as scheduled. Please indicate your support or opposition for my proposal of a short delay. --[[User:Martin Baldwin-Edwards|Martin Baldwin-Edwards]] 08:40, 16 November 2007 (CST)
 
I think 7 days may not be enough unless we are able to fill in the blank spaces toward the bottom and clean up the criticism section.  I have added the [[Healing Arts|Healing Arts Workgroup]] as this article affects them as well. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 07:46, 16 November 2007 (CST)
 
I agree that some delay is sensible. I added a stub for [[Odds ratio]] as an example for my comment above, sadly I noticed too late that this is a term omitted (dooh)[[User:Gareth Leng|Gareth Leng]] 08:49, 16 November 2007 (CST)
 
:Notice what I did with odds ratio.  You put the name in the r template like this <nowiki>{{r|odds ratio}}</nowiki> and then click on the little 'e' and put in the defintiion.  The it shows up anywhere we put that on any page about odds ratio. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 08:31, 16 November 2007 (CST) Thanks[[User:Gareth Leng|Gareth Leng]] 09:35, 16 November 2007 (CST)
 
==Cut this?==
I cut this short section. It is in the criticism section, and I couldn't identify in what respect there is any criticism. I guess I think that this may be interesting but is probably only tangential to the article?
====Complexity theory====
Complexity theory is proposed as further explaining the nature of medical knowledge.<ref name="isbn1-85775-724-6">{{cite book |author=Sweeney, Kieran  |title=Complexity in Primary Care: Understanding Its Value |publisher=Radcliffe Medical Press |location=Abingdon |year=2006 |pages= |isbn=1-85775-724-6 |oclc= |doi=}}[http://www.acpjc.org/Content/147/3/issue/ACPJC-2007-147-3-A11.htm Review]</ref><ref name="isbn1-85775-855-2">{{cite book |author=Holt, Tim A | title=Complexity for Clinicians |publisher=Radcliffe Medical Press |location=Abingdon |year=2004 |pages= |isbn=1-85775-855-2 |oclc= |doi=}} [http://www.mja.com.au/public/bookroom/2007/zwar/zwar.html Review], [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1463117 ACP Journal Club Review]</ref>
 
[[User:Gareth Leng|Gareth Leng]] 09:35, 16 November 2007 (CST)


:Restored, renamed, and expanded this section with context. See what you think. - [[User:Robert Badgett|Robert Badgett]] 08:57, 16 November 2007 (CST)
===Responses to too many sections===
I agree succinct is nice; however, I find that WikiPedia can be hard to follow when a topic is scattered over several pages. I am not as bothered by the length. In part because I do not see further sections that can easily be lopped off and put in their own pages. Maybe the metric section could be moved to a statistics article. We have already separate pages for [[Teaching evidence-based medicine]] and [[Evidence-based individual decision making]]. Should these have been subpages?? I suggest leaving clinical practice guidelines represented in the TOC so the concept is not lost.
# As nobody complained about my suggestion Feb 21 to delete the "Why do we need EBM", I have done so.
# In the sections "Methods proposed for assessing validity" and "Criticisms of EBM" I made the subsections not appear in the TOC.
# I moved publication bias content to article of that name.
# I removed the section heading "Methods proposed for assessing validity" but left the content. This content should be merged with the later occurring section titled "Levels of evidence".
- Bob - [[User:Robert Badgett|Robert Badgett]] 15:48, 12 March 2008 (CDT)


::Complexity theory needs to be defined or explained. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 09:06, 16 November 2007 (CST)
I think there is more that can be done. Question: ok if I move most of informatics content to the existing article of that name?


:::Liked what you did Robert; also agree with Matt - maybe though it's just again that Complexity theory needs a stub rather than a definition here.[[User:Gareth Leng|Gareth Leng]] 11:54, 16 November 2007 (CST)


::::That might work, depending on how you do it, but I like having at least some clarity here and then they can click on the link for more, especially on those more scientific terms that their meanings cannot be easily inferred by the average reader. --D. Matt Innis 11:44, 16 November 2007 (CST)
==Approval?==
I've gone through this with a copyedit run and made some minor adjustments to lose some subsections and compress some bits of text on the page.


==??==
In my view, this is a very scholarly, comprehensive and useful guide to EBM, and a good gateway to many related articles.
"were more likely to adopt COX-2 drugs before the drugs were recalled by the FDA"


well yes, they would be wouldn't they? But were they recalled by the FDA?[[User:Gareth Leng|Gareth Leng]] 08:54, 16 November 2007 (CST)
I think the last section should go because it seems not really in tune with the article scope as its developed - but should be moved somewhere; the point is a good one, but is overweighted by the (very nice but tangential) image.


==Quality of references==
Please see if my edits are good with you Bob, and delete the last section if you agree, and I'm ready to propose approval. I think I've only copy edited here.[[User:Gareth Leng|Gareth Leng]] 17:53, 15 January 2009 (UTC)
I have started to do some checking of the references. I looked at this
: Regarding the complexity science question. What about just reducing the image (as I have done) or removing the image (which might be better and is ok with me)? If the image stays, its caption could be more succinct than I have done. By the way, the Hume statue is a great addition that you or someone did a while back. Otherwise all looks ok. - [[User:Robert Badgett|Robert Badgett]] 18:10, 15 January 2009 (UTC)
"A randomized controlled trial supports the efficiency of this approach.[7]"
which is a reference used 3 times. This is a study of 32 medical students assigned to one of 2 search protocols. Frankly it has statistical weaknesses; most obviously the analysis is based on the numbers of answers to questions not on the individual performances; as the individuals are independent but their answers are obviously not, this seems inappropriate. I don't mean to rubbish this small trial, only to say that I think, especially in this article, we should set the bar for citing studies as evidence at an appropriately high level - i.e. at a level appropriate for the topic. Using small or poorly controlled studies as evidence to support conclusions about EBM is surely not what we want to do?  I really would recommend trimming the references in the article down to a sustainable core of unimpeachably strong studies.[[User:Gareth Leng|Gareth Leng]]


Agreed.  Considering we have the expertise here, we don't need to reference things that are reasonably understandable unless there is a conflict or questionable synthesis of the information. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 09:47, 16 November 2007 (CST)
==Snag?==
:Disagree. I think trimming this is one of the same mistakes that we accuse EBM of doing. We accuse EBM of only acting on RCT data and not allowing lesser data with expert judgment (note the new section someone added about parachutes). I missed that the trial did not adjust for intrauser correlation. I suggest noting that the trial had issues, but not delete the trial. If you delete this trial, then you are left without guidance on how to teach searching, so we are in the situation that we are not sure whether to use parachutes because there are no RCTs of parachutes. The results of this trial are very plausible based on other studies of how much time various search strategies require, so if you take a Bayesian approach to significance testing, this trial is ok, even with its statistical problems.
I edited the metadata template to flag To Approve but it hasn't registered - help anyone?[[User:Gareth Leng|Gareth Leng]] 10:49, 16 January 2009 (UTC)
:I do not see a reason to be parsimonious with references. Documenting sources for arguments, and not throwing out unsupported opinions, is a major function of CZ. - [[User:Robert Badgett|Robert Badgett]] 11:41, 18 November 2007 (CST)


==alt med==
:Got it, you must have deleted a "|" when you put your name in.  [[User:D. Matt Innis|D. Matt Innis]] 14:31, 16 January 2009 (UTC)
I added a blurb about alt med being evaluted using EBM as well.  Feel free to clarify or clean it up.  I think it is important that this method might be the way to evaluate the claims made by techniques that are subject to bias. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 09:40, 16 November 2007 (CST)


== COx-2 drugs = COX-2 inhibitors? ==
::Anyone know if there is a way to add metadata in a more user friendly manner? I think that would help a lot, especially with newbies who get intimidated by the metadata template issues. Possibly Howard could dust off the programming side of his brain. Or we could recruit someone who needs a project for their computer programming course? Or science fair. As for the article, it looks good. [[User:Chris Day|Chris Day]] 15:00, 16 January 2009 (UTC)
Robert, can you rephrase  COX-2 "drugs" to be more descriptive?
:done - [[User:Robert Badgett|Robert Badgett]] 10:57, 18 November 2007 (CST)


== Server timing ==
:::Interesting that you mention that, Chris. I have a couple of unfunded potential projects, one in intelligent systems for both optimization and administration of drug prescribing, and another for process control of hydroponic cultivation of culinary herbs (I might have a question or two for you on botanical sensors). My last substantial programming was ten years or so ago, much of it real-time router code, and mostly in C. Somewhat later, I did some prototypes in Perl.


In case anyone is wondering, the timing of the server is way off and clocks are not valid, so the order of edits in the history do not necessarily follow when they were actually made, i.e. Gareth's last edit was actually made before mine, but shows an hour later. --[[User:D. Matt Innis|Matt Innis]] [[User talk:D. Matt Innis|(Talk)]] 09:42, 16 November 2007 (CST)
:::It is clear that I am going to have to learn some more current languages, much more Web integrated, as well as things that I can use with open source process control. Just at the moment, I've ben trying to decide on the priority of language skill to acquire. So, if you could tell me (email or here) what is used in MediaWiki and any tools, that would be a significant help to my planning. Not promising to deliver code yet, and I usually do design before coding; I am affected but not fully convinced by the [[Agile Programming]] manifesto. Nevertheless, I need to do some study anyway. My desktop environment is Windows, but I can certainly put server-appropriate Linux on a server here. [[User:Howard C. Berkowitz|Howard C. Berkowitz]] 15:41, 16 January 2009 (UTC)


== file drawer ==
== APPROVED [http://en.citizendium.org/wiki?title=Evidence-based_medicine&oldid=100440219 Version 1.0] ==


This sentence:
Congratulations on approval of [http://en.citizendium.org/wiki?title=Evidence-based_medicine&oldid=100440219 this version]. [[User:D. Matt Innis|D. Matt Innis]] 02:15, 27 January 2009 (UTC)
*In performing a meta-analyses, a file drawer[15] or a funnel plot analysis[16][17] may help detect underlying publication bias among the studies in the meta-analysis [http://en.citizendium.org/wiki/Evidence-based_medicine#Publication_bias].  
sure could use a quick explanation of file drawer and funnel plot.
--D. Matt Innis 10:25, 16 November 2007 (CST)


==Really ready for approval?==
<div class="usermessage plainlinks">Discussion for [http://en.citizendium.org/wiki?title=Evidence-based_medicine&oldid=100440219 Version 1.0] stopped here. Please continue further discussion under this break. </div>
I just [http://en.citizendium.org/wiki?title=Evidence-based_medicine&diff=100217773&oldid=100217671 corrected] a grammar error in the intro. It looked like something had been deleted and left a dangling ''and''.  Also the very last paragraph in the intro is th following.
----
::"''Evidence-Based Health Care'' or ''evidence-based practice'' extends the concept of EBM to all health professions, including purchasing and management [http://www.cebm.net/glossary.asp]."
Here the references cited does not seem to give any information with regard to purchasing and management and ''evidence-based practice''. If it does it is not obvious to me as a layperson. Also, this reference does not use the <nowiki><ref></ref></nowiki> format. I know these are minor issues but if these are in the intro what is the rest of the article like? [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 17:38, 17 November 2007 (CST)
:Those references are much better. Is there any chance to have less than seven, it seems like overkill, or is each article very different?  Can it be narrowed down to the best two or three?  [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 11:32, 18 November 2007 (CST)


== Addition of a radical critique ==
== Toward Approval of version 1.1 ==
I was encouraged to try and find a place for another critique of EBM, which relates to the (highly condemnable!) use of common sense under the EBM paradigm (http://en.citizendium.org/wiki/Evidence-based_medicine#EBM_not_recognizing_the_limits_of_clinical_epidemiology) Thanks, Matt, I needed some courage. I dared to be bold and to formulate a general synthesis. It looks like the final criticism (about the fallibility of knowledge), but I think it provides historical and political perspective. I think that the very last part is important, even though it is dangerously funnny. Some work should be done to contrast those two similar critiques.  [[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 02:09, 18 November 2007 (CST)


==Criticisms of EBM - are these actually criticisms of nefarious expropriators of EBM?==
I notice that the version number ToApprove points to the current Approved version.  I assume it should point to this [http://en.citizendium.org/wiki?title=Evidence-based_medicine/Draft&oldid=100499186 version] that includes [http://en.citizendium.org/wiki?title=Evidence-based_medicine%2FDraft&diff=100499186&oldid=100440214 these edits] that are Robert's.  That means that this would be a three editor approval and everything looks okay for that tomorrow.  If there is any objection or if I have made the wrong assumption, please let me know here before tomorrow.  Thanks, [[User:D. Matt Innis|D. Matt Innis]] 02:43, 1 July 2009 (UTC)
Two of the sections in criticisms, "Unethical use of placebos" and "Ulterior motives" , might be more appropriate to view as criticisms of those who try to use the EBM paradigm for their advantage. Does anyone see a better way to organize to reflect this.


Also, as the EBM article fills out, we need to think about some the details shifting to other articles, specifically the [[randomized controlled trial]] and [[clinical practice guideline]] article. - [[User:Robert Badgett|Robert Badgett]] 10:19, 18 November 2007 (CST)
== APPROVED [http://en.citizendium.org/wiki?title=Evidence-based_medicine/Draft&oldid=100499186 Version 1.1] ==


Hi, I think I see a better way to organize this in an elegant way. In my readings on the EBM debate, I have encountered a criticism that is often missed (because it is philosophical/socioeconomic), but which is by definition essential : the authors said: are we debating EBM as it is, or EBM at it should be/is at its best/is according to textbooks? Those critics said that most of the debate about EBM was misled because it diverted attention from its actual uses, from what it is empirically (according to the ''evidence''!), and, in doing so, was letting wrongdoers continue their ''use'' of evidence for their own sake. I guess the most important was : before we discuss, let's agree on the definition we'll use (and i'dd add: that's relevant to the whole article we're working on). 
<div class="usermessage plainlinks">Discussion for [http://en.citizendium.org/wiki?title=Evidence-based_medicine/Draft&oldid=100499186 Version 1.1] stopped here. Please continue further discussion under this break. </div>
There's irony in this situation. If we use evidence-based analysis of evidence-based medicine, we'll indeed be led to recognize that EBM (by whatever ''socio''pathologic mechanism, "let's not lose ourselves in theories", as we'd say in EBM language):
----
* helps the pharmaceutical monopolies by giving prestige to the notion of placebo where it should be called medical negligence (see unethical use of placebos) and
* an anticompetitive practice (all medications are superior to placebo, telling them apart is almost impossible, so all leading companies are happy with that because they get their share of the market);
* is a tool to deny treatment ("there's no evidence that...") (Cf Ulterior motives);
* feeds the research industry indefinitely but leaves clinicians and patients powerless ("more research is necessary..." (there's an interesting study on that : ''
: ''RESULTS: We analysed 1016 completed systematic reviews. Of these, 44% concluded that the interventions studied were likely to be beneficial, of which '''1% recommended no further research''' and 43% recommended additional research. Also, 7% of the reviews concluded that the interventions were likely to be harmful, of which 2% did not recommend further studies and 5% recommended additional studies. In total, '''49% of the reviews reported that the evidence did not support either benefit or harm''', of which 1% did not recommend further studies and 48% recommended additional studies. '''Overall, 96% of the reviews recommended further research'''. Conclusions: Cochrane systematic reviews were about evenly split between those in which the authors concluded that at least one of the interventions was beneficial and those in which the evidence neither supported nor refuted the intervention tested. '''The Cochrane Collaboration needs to include clinical trial protocol summaries with a study design optimized to answer the relevant research questions'''.'';''
* creates the notion of a truth that can be bought (who will pay for a RCT to know whether we should treat vitamin D deficiency in dark-skinned people in Northern latitudes? Treatment would seem to be common sense, but a recent study recommends further research on vitamin D deficient minorities...; who will pay for a RCT to compare treatment with a drug with an expired patent or no patent at all with a new, proprietary drug? (that's the main point made by Marcia Angell, former NEJM editor and vocal critic of the current state of affairs);
* based on the fiasco of hormone replacement therapy in menopause, and the terror it caused, it turns most researchers away from new, relevant pathophysiologic models of disease (because "theories are dangerous, look at the HRT trial!").
... and I guess the list could go on a little more.
So, to formulate the problem as I see it (see next section:)
([[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 16:04, 18 November 2007 (CST))
==Evidence-based assessment of evidence-based medicine==
An evidence-based assessment of the impact of evidence-based medicine is still lacking. The intense debate over the impact of EBM in clinical practice, health care systems, attitudes towards scientific literacy, research agenda, choice of medical treatments and health determinants that will be assessed, is not led using the "current best evidence", but often focuses on theoretical questions raised by clinical epidemiology and evidence-based medicine paradigms.  
Critiques of evidence medicine can thus be divided in two main categories : theory-based critiques and evidence-based critiques and assessments of evidence-based medicine.
===Evidence-based critiques===
====Unethical use of placebos====
''Cf article: in summary:'' Since the introduction of EBM, and its adoption by Health agencies such as the US FDA, the use of placebo has become more prevalent, in violation of the Helsinki Declaration.
====Rationing and negligence====
(cf ulterior motives)
====Changes in research agendas====
''Draft:'' since the adoption of EBM methods by health care systems and research consortia, the funds devoted to fundamental research have declined while the funds allocated to the evaluation of non-innovative drugs (me-too drugs) have raised sharply. (cf Marcia Angell's critique). I think that there's solid evidence that should be gathered and integrated here.
====Lack of randomized controlled trials for clinical decisions====
''(cf article).'' ''In addition:'' But is this lack an unfortunate consequence of extraneous factors or is it constitutive of evidence-based medicine as it is now, as defined by the best available evidence? A Cochrane meta-analysis of Cochrane meta-analyses suggests that EBM metanalyses are usually not designed to guide clinical decisions (cf quote above ("The Cochrane Collaboration needs to include clinical trial protocol summaries with a study design optimized to answer the relevant research questions."); the ref is: J Eval Clin Pract. 2007 Aug;13(4):689-92. Mapping the Cochrane evidence for decision making in health care. El Dib RP, et al. The Brazilian Cochrane Centre - Universidade Federal de São Paulo, São Paulo, Brazil.)
====Summary of the evidence about evidence-based medicine====
''Draft:'' Although it is too early to infer causation, there appears to be a trend in ... towards ... associated with the introduction of EBM methods and practices. More research is necessary to shown whether EBM caused such changes or was an innocent bystander.
''Any thoughts?''
===Theory-based critiques===
====EBM not recognizing the limits of clinical epidemiology====
(cf article)
====Fallibility of knowledge====
(cf article)


[[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 16:04, 18 November 2007 (CST)
== Reference needs fixing ==


==Need consistency==
In http://en.citizendium.org/wiki/Evidence-based_medicine/Draft#Acquisition_of_evidence, a reference needs fixing. Not evident how to do it.  [[User:Anthony.Sebastian|Anthony.Sebastian]] 03:21, 1 October 2009 (UTC)
I have noticed that in the text there are examples of "evidence-based medicine", "Evidence-Based Medicine" and EBM. Does the article intend to use the acronym throughout?  That seems to be case from the intro. Should all cases of "evidence-based medicine" and "Evidence-Based Medicine" be changed to EBM? [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 11:44, 18 November 2007 (CST)
:Thanks for finding that, it was pretty ugly but is now fixed. [[User:Robert Badgett|Robert Badgett]] 03:34, 1 October 2009 (UTC)


==[[Evidence-based_medicine#Apply|Apply]] section==
== approval ==
In this section is the following sentence:
:"''Both patients and healthcare professionals have difficulties with health numeracy and probabilistic reasoning.[29]''"
How do these problems in numeracy result in a misapplication of EBM? This needs to be more explicit in the article. There is a reference for this, so what's the conclusion of the reference with respect to the misapplication of EBM? [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 14:20, 18 November 2007 (CST)


Also in this section is the following sentence:
Now that there are three editors on board for reapproval (thanks guys), there is much less reason to wait another month before approval.  If you'd like to move the target date sooner, you should feel free. --Joe ([[User:Approvals Manager|Approvals Manager]]) 12:47, 1 October 2009 (UTC)
:"''Specialists may be less discriminating in their choice of journal reading. [39]''"
Does not seem to tie in with the rest of the section.  I was going to rewrite it but I'm not sure of what point is being made here.  How does this fact relate to the over or under use of any evidence based method? I would expect from the context (specialist tend to over use EBM) that it is trying to suggest that results and usage of treatments from EBM are not generally reported in specialist journals? But this cannot be right given the sentence above. Wouldn't a specialist be more aware of EBM if they are less discriminating in the journals they read?  [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 12:11, 18 November 2007 (CST)


==Last discussion item==
As a rule, in discussions pages, it is good to add comments at the very end... I did not respect this rule, and now, my comment is difficult to trace back. Please go to http://en.citizendium.org/wiki/Talk:Evidence-based_medicine#Criticisms_of_EBM_-_are_these_actually_criticisms_of_nefarious_expropriators_of_EBM.3F
to read the comment from the start. Thanks! [[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 16:19, 18 November 2007 (CST)


==Aquire section==
==APPROVED Version 2.0==  
As a layman reading this article I have no idea what to make of the [[Evidence-based_medicine#Acquire|Acquire]] section. Why do doctors aquire as many wrong as correct answers?  What kind of data are we talking about, studies that are already published or new studies, or both? This section needs to be a lot more clear. [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 22:49, 18 November 2007 (CST)


==Clinical_reasoning/teaching section==
<div class="usermessage plainlinks">Discussion for [http://en.citizendium.org/wiki?title=Evidence-based_medicine/Draft&oldid=100578938 Version 2.0] stopped here. Please continue further discussion under this break. </div>
As above, i just find this [[Evidence-based_medicine#Clinical_reasoning|Clinical reasoning section]] very hard to interpret. For example, the second sentence states:
::"''In addition, medical experts rely more on pattern recognition which is faster and less prone to error[84];''"
But less prone to error than what? Surely not better than Bayesian analysis which is implied in this context. Then there is a list of teaching strategies than does not really put any perspective on the diferent approaches and there is a table that is not even mentioned in the text. What does the table mean, what is 66% vs cell B? May be I could figure this out if i worked at it and read all the references, but this article should stand on its own. [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 23:17, 18 November 2007 (CST)


==Problems==
===New version 2 has an error in a section heading===
I have started to check the quality of the refereneces. I looked at this."A search strategy similar to the 5S strategy should be taught for use when the searcher has limited time available during clinical care. This is based on one positive study of its use[14] and two negative studies[76][77] of teaching the use using secondary and primary publications.".
The error:
The first reference is used 3 times in the article. It is a small study of 32 medical students assigned to one of two search strategies. The study has obvoius flaws, most clearly the statistical analysis is not based on individual performance but on the numbers of answers. As the participants may be regarded as independent but clearly their answers are not, this is inappropriate.
My point is not to rubbish this small study, but that in an article on EBM above all, the quality of evidence cited should surely be consistently high. In fact I am worried that references here are being used as though they are citations to fact, not to evidence which itself needs appraisal. As editors it's our job to appraise and sift and present a balanced account, not leave it to the reader.


I think the article does have major problems at present. In my opinion at least an article must be understandable alone; some sections are not comprehensible, but are essentially a guide towards relevant literature for those who will recognise the key words. The test is simple; if we ignore all references, does the text actually make sense? In some cases I think it just doesn't.
<nowiki>===Acquisition of evidence=== </nowiki>


My suggestions are
...harms the contents menu. Should I start approval for another version? The draft does not have that error and has a number of new changes as well. The frequent approvals are very awkward.  [[User:Robert Badgett|Robert Badgett]] 19:18, 2 November 2009 (UTC)
1) Shift the section on metrics to a subpage; it's just a list.  
2) Create a separate article on Teaching EBM. This section perhaps has most problems and needs most work, and is essentially tangential.
3) Shift some of the references away from being cited in the text (as though they were reliable authorities) to a bibliography subpage, grouped by topic, as a guide to further reading, with some explanation.
4) Thus try to reduce the main article to a clear overview with minimal referencing only to major significant literature overviews.


At present, I can't support approval, but this is a very important topic and this is a very good start, but I think we have some way to go yet.[[User:Gareth Leng|Gareth Leng]] 03:55, 19 November 2007 (CST)
:Well, I can correct that, since you're an editor telling me to do a minor typo fix. What should it be? <nowiki>==Acquisition of evidence==</nowiki>? [[User:Hayford Peirce|Hayford Peirce]] 19:52, 2 November 2009 (UTC)


OK, I've created two new article, one on Teaching EBM and one on EBID, as these it seemed to me presented separate problems of explanation and introduction which have to be addressed. I think that this de-bulks the present main article allowing us to focus on this core content??[[User:Gareth Leng|Gareth Leng]] 05:51, 19 November 2007 (CST)
::The number of '='s is ok, but I believe there is a space accidentally placed before the first '='. - [[User:Robert Badgett|Robert Badgett]] 20:03, 2 November 2009 (UTC)
:I think the two new subpages help. Similarly, I wonder if much of the content in the following two sections could be shifted to other CZ articles  - some that already exists:
* Experimental trials: producing the evidence - > [[randomized controlled trial]]
* Conflicts of interest -> [[Medical ethics]]


Would be nice to keep the metrics. Eventually this should be short descriptions that lead to main article; however, that requires time.
:::Yes. I just fixed it. [[User:Hayford Peirce|Hayford Peirce]] 20:33, 2 November 2009 (UTC)
::::Thanks - [[User:Robert Badgett|Robert Badgett]] 20:34, 2 November 2009 (UTC)


This approval process has been interesting. However, it is extremely time consuming which I think needs addressing.
==See also section==
- [[User:Robert Badgett|Robert Badgett]] 07:34, 19 November 2007 (CST)
Ok to delete the EHR, EMR, and Clinical Data warehouse links? - [[User:Robert Badgett|Robert Badgett]] 20:29, 9 February 2010 (UTC)
- [[User:Robert Badgett|Robert Badgett]] 07:34, 19 November 2007 (CST)
 
::The time consumption for this article's approval is not usual. It may reflect an abundance of expertise in the area on CZ. Given that there are many revisions proposed and we have gone beyond the article approval date, would one of the nominating editors consider removing the template for the moment? It should be reinstated when you (three) feel confident of approval in the light of comments and changes proposed here. --[[User:Martin Baldwin-Edwards|Martin Baldwin-Edwards]] 07:40, 19 November 2007 (CST)
:::Yes, please remove the nomination. I am listed as supporting the nomination - am I allowed to remove the template? - [[User:Robert Badgett|Robert Badgett]] 07:45, 19 November 2007 (CST)
:::::As I understand CZ rules, when 3 editors nominate an article for approval, only one of those can remove the nomination. I have removed the template on your behalf, Robert. --[[User:Martin Baldwin-Edwards|Martin Baldwin-Edwards]] 08:19, 19 November 2007 (CST)
 
I think in this case (as perhaps often) nomination for Approval leads to a flurry of interest and (I hope) constructive input, and issues can come to light that are complex. In this case, the article is such an important one, and so large in scope, that perhaps it's not surprising that it won't be easy.
My last change (shifting the Classification section) was my first response to comparing this article with the Wikipedia article. That section was a straight duplication.[[User:Gareth Leng|Gareth Leng]] 07:52, 19 November 2007 (CST)
 
I cut the statement that specialists are less discriminating in their reading than general physicians. It seemed surprising; the study referenced actually reports "Although they accessed many of the same journals as did the primary care physicians, the specialists accessed journals almost twice as often and accessed a greater number of more specialized journals, consistent with their clinical populations. " [[User:Gareth Leng|Gareth Leng]] 08:07, 19 November 2007 (CST)
:This makes sense, i flagged that one above too, I thought it did not ring true. [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 08:09, 19 November 2007 (CST)
 
Moved Conflicts of interest -> Medical ethics in line with Robert's suggestion above. [[User:Gareth Leng|Gareth Leng]] 10:41, 19 November 2007 (CST)
 
==Classification section==
Why was the classification section deleted? I think Eddy made an important construct here - about how EBM focuses excessively on the doctor patient dyad when focusing on the system will have more impact. Can we restore this? - [[User:Robert Badgett|Robert Badgett]] 16:06, 19 November 2007 (CST)
 
Hi Robert, I didn't delete the content, just moved it into the lead. I altered the format (lost the headings) because I noticed it was a straight copy of what was on WP.[[User:Gareth Leng|Gareth Leng]] 06:22, 20 November 2007 (CST)
:I wrote it at WP. See what I did now - I did not want the thought to be missing from the TOC. - [[User:Robert Badgett|Robert Badgett]] 08:59, 20 November 2007 (CST)
:: Looks good to me[[User:Gareth Leng|Gareth Leng]] 11:54, 20 November 2007 (CST)
 
==Specialists physicians reading habits==
The abstract of the article states "Primary care physicians, more so than specialists, chose full-text articles from clinical journals deemed important by several measures of value". It does not seem correct to delete this because the result is a surprise. If you want to interpret the study differently, then I suggest adding your interpretation or editing mine, but do not delete unless you think the article seriously flawed (unlikely as the McMaster group is pretty careful). Regarding it being a surprise, it is in line with 1) observations on specialists being more likely to accept new therapies of unproven benefit, 2) specialists journals in general are not rated as high with the McMaster/ACPJC methods. There is a difference between reading more journals versus reading better journals. It is a provocative study that should not be suppressed. - [[User:Robert Badgett|Robert Badgett]] 16:06, 19 November 2007 (CST)
:I'm  a bit confused here.  Wasn't the original sentence:
::"''Specialists may be less discriminating in their choice of journal reading. [39]''" See my original comment above and [http://en.citizendium.org/wiki?title=Evidence-based_medicine&diff=100219343&oldid=100219337 this edit] by Gareth Leng.
:Which implied that specialists read more broadly. But the study suggested that they read with the same breadth but  much more of the specialist journals (i.e. no more broadly). Or is this a different sentence you are refering to? For me the surprise was that the specialists read more broadly.  Above you seem to be saying its the Primary care physicians that read more broadly.  Maybe we have diferent usage when considering the phrase "less discriminating"? [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 21:54, 19 November 2007 (CST)
::Maybe what you meant originally was "''less discriminating in their choice of treatment''"? That would make more sense. But is that proven by the study you cited.  Gareth's cited quoted says that specialists downloaded the same breadth of journals but downloaded more on speacialist topics. There seems to be an assumption here that the specialists did not read all of what they downloaded. But does the study actually say this? And even if they do, is this a valid conclusion? [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 22:04, 19 November 2007 (CST)
:::By using the word 'discriminating', I was trying to summarize the finding in the study that the primary care doctors were more likely to read articles from journals of higher quality. - [[User:Robert Badgett|Robert Badgett]] 22:13, 19 November 2007 (CST)
::::I agree it seemed to say that primary care doctors read 'less broadly' (to use Chris' words), though both downloaded 'full text' articles from high quality journals, primary care was consistently of higher quality.  This makes sense to me as primary care doctors are likely to refer to specialists  once they have exhausted the 'traditional' methods.  It's the specialists that have to 'think outside the box.' --[[User:D. Matt Innis|D. Matt Innis]] 22:52, 19 November 2007 (CST)
 
::::Well how can you define quality in this case? The less specialist journals are higher quality?  This seems a little subjective, does the source make such as statement? Why wouldn't specialist journals be on the ball with respect to treatments in their specialty? And what of Gareth's quote that says that specialists and primary care doctors download from the same journals? Do they discuss what is read or only what is downloaded in the cited reference?  We can't discuss what is read if the source only discusses what is downloaded. At present I don't feel such a strong statement is justified based on the current source.
::::Sorry if I'm sounding confused here but this whole line of reasoning seem very confusing, as well as the original text, which I now see I had misinterpreted completely.  If this is to be included the argument need to be much more transparent and I'd prefer a source where they actually dicuss the knowledge of the doctors involved not what they downloaded (which they may or may not have read). [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 23:19, 19 November 2007 (CST)
 
:::::Definition of quality is were the articles included in the summary journals acpjc or ebm. See acpjc's criteira at http://www.acpjc.org/shared/purpose_and_procedure.htm. I think it would be a mistake to get hung up on download versus read - surely they are well correlated. It is very plausible that specialists are not reading as high of quality content. Matt's scenario could be right (specialists are confronted with difficult problems that require them to be more adventuresome in their reading) or another reason is that we have know for years that the general journals tend to have higher quality research (Haynes B.  Where's the meat in clinical journals?  ACP Journal Club  1993; 119: A22-A23.) Going back to why I included this thought inthe article, either of these scenarios could contribute to why studies have observed that specialists might be more like than generalists to adopt new treatments that have not been adequately studied. I think these are important thoughts to include in the EBM article. Admittedly the research is not definitive proof, but it seems possible enough and interesting enough to include these citations (with a disclaimer that these observations are not proof). - [[User:Robert Badgett|Robert Badgett]] 23:43, 19 November 2007 (CST)
 
::::::My point about reading vs download is that the specialists download a lot more.  Do we know they read it all and what subset do they read? As far as I can tell your point requires that the specialists don't read everything they download (since they do actually download from the high quality journals too, as often as the primary care doctors according to the paper).  For the record, given how much they download, I'm sure that that they don't read it all, nevertheless, this is all speculation at best.  It also generalises between primary and specialist carte to an extreme. I think there is a good chance you are right, but that does not mean it should be written, IMO. [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 00:04, 20 November 2007 (CST)
:::::::I am not following the need for "specialists don't read everything they download" to be true. - [[User:Robert Badgett|Robert Badgett]] 00:07, 20 November 2007 (CST)
 
::::::::The citation says that the specialists and primary care doctors download from the '''same''' journals, except that the specialists also download from their specialist journals and downloaded a lot more in general.  Here is the quote:
::::::::: "''Although they accessed many of the same journals as did the primary care physicians, the specialists accessed journals almost twice as often and accessed a greater number of more specialized journals, consistent with their clinical populations. "
::::::::So specialists may well be downloading the high quality articles too. So the assumption must be they download so much that they can't cover it all and miss the important bits. I'm just going from the text Gareth guoted, I have no idea if it true or not. This is why we need to know what they read not what they download. If you assume they read everything they download then the citation does not support your case. Do they discuss this issue in the paper? [[User:Chris Day|Chris Day]] [[User talk:Chris Day|(talk)]] 00:13, 20 November 2007 (CST)
 
I think I see what the confusion is. It is true that both groups of docs are downloading from the same pool of journals. However, within that pool of journals, there is a spectrum of quality of journals (as defined by the proportion of articles in a journal that meets [http://www.acpjc.org/shared/purpose_and_procedure.htm criteria]). In the results, the article states: "Correlations for each quality indicator were stronger for the primary care physicians than for the specialists ([http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1924945&rendertype=table&id=i1536-5050-095-03-0246-t06 Table 6]). Access by specialists correlated most strongly with ACP Journal Club abstracted journals (ACP-abstr, r = 0.610, 95% CI 0.391 to 0.763). Statistical difference between the primary care physicians and the specialists occurred only for the abstracted ACP Journal Club accesses (ACP-abstr, r = 0.915 vs. 0.610)."
 
So both statements are true:
# "specialists and primary care doctors download from the '''same''' journals"
# Within the pool of journals, the primary care docs are more likely to access articles from the higher quality journals.
 
I think their research is pretty tight, but I admit it can be hard to follow if you are not familiar with their work. - [[User:Robert Badgett|Robert Badgett]] 01:41, 20 November 2007 (CST)
 
I think the point is that specialists (plausibly) read more. They not only read the high impact journals, they also read the specialist journals. I don't find that surprising, and there's no indication that specialists read fewer articles from high quality journals than generalists. Of course if people don't read what they download there's not much that can be said anyway from the study.[[User:Gareth Leng|Gareth Leng]] 06:31, 20 November 2007 (CST)
 
:I went over the full text again of the article, [http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1924945 Which journals do primary care physicians and specialists access from an online service?], to investigate your hypothesis. I believe you are saying that 1) primary care docs and specialists might be reading the same amount from the high quality journals, 2) in addition, specialists are reading more additional content from lower quality journals (maybe due to Matt's suggestion that the specialists may have no choice as "once they have exhausted the 'traditional' methods.  It's the specialists that have to 'think outside the box.'".
 
:So I looked for the absolute numbers of access to articles from only the high quality journals; however, this data is not in the article. It looks like all that can be confidently said with the data provided in the article is that 1) specialists read more 2), specialists read from a broader spectrum of quality.
 
:I restored the text trying to reflect this. You can find the text in the article by searching for 'spectrum'. Seem ok? - [[User:Robert Badgett|Robert Badgett]] 06:46, 21 November 2007 (CST)
 
== Steps_in_evidence-based_medicine ==
 
The [http://en.citizendium.org/wiki/Evidence-based_medicine#Steps_in_evidence-based_medicine Steps in evidence-based medicine] section has some valuable info, but is it titled correctly?  In other words, is 'publication bias' a step? or more like a consideration?  Unless these are documented guidelines from somewhere special, maybe we should consider renaming the section? I'll leave that to others better qualified to decide. --[[User:D. Matt Innis|D. Matt Innis]] 13:46, 20 November 2007 (CST)
:Ahh, I see, '====publication bias====' is actually a subheading of '===Appraisal of evidence==='.  It doesn't show that well as it looks like it is just another step.  Is there a better way to do this? --[[User:D. Matt Innis|D. Matt Innis]] 13:49, 20 November 2007 (CST)
::Chris, your changes definitely helped the TOC and I think the section works better as well.  I made some changes (italics, etc.) to try and set the terms apart from the rest of the text. Anyone feel free to revert or rewrite anything that does not look right or changes content inappropriately. --[[User:D. Matt Innis|D. Matt Innis]] 15:21, 20 November 2007 (CST)
 
==Medical informatics==
I tightened the wording at the start of this section; however, I do not see the need for the second and third paras. Does anyone see a reason to retain these paras? If so, can they be more succinct? - [[User:Robert Badgett|Robert Badgett]] 06:59, 21 November 2007 (CST)
 
Agree with you, I think they can be cut.[[User:Gareth Leng|Gareth Leng]] 11:46, 21 November 2007 (CST)
 
 
==Two things==
1) I've added a long note to the butterfly image. I d know (a bit) about chaos and complexity, but not about its application here beyond a very superficial look at some of the cited literature. What I have written is therefore very much my understanding/expectation of its possible relevance, not written with any actual authority of knowing the work. So if it is wrong in this context, please just delete it. However I felt that if complexity/chaos is worth mentioning here at all (and I'm not sure how significant it is), it should probably be explained a little more fully.
 
2) I have added an image of Hume and two display boxes. I don't mean to bypas the discussions on content here, so please don't hesitate to remove them if they're not thought necessary or appropriate. I am quite a hard person to offend, and certainly wouldn't feel any offence there :-)[[User:Gareth Leng|Gareth Leng]] 12:06, 21 November 2007 (CST)
 
==Chaos, complexity and other alternate models==
I don't know enough either about chaos theory and related topics, but I have the following article, a highly accessed one, from BMC - Medical Research Theory, to suggest as a possible (alternate?) framework. The most important point is that the hierarchical model of evidence can be questioned. The proposed framework is the circular methodology.
 
[http://www.biomedcentral.com/1471-2288/6/29 Circular instead of hierarchical: methodological principles for the evaluation of complex interventions Harald Walach, Torkel Falkenberg, Vinjar Fønnebø, George Lewith and Wayne B Jonas]
 
PS: Addition of images and the text box were great ideas, in my opinion.
 
[[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 09:41, 22 November 2007 (CST)
 
: Oops, your comment highlights that we never discussed levels of evidence. I added that to the appraisal section and also added your article.- [[User:Robert Badgett|Robert Badgett]] 02:42, 23 November 2007 (CST)
::I'm glad that it helped. I find that the insertion of objections and criticisms in the body of the article (also see ''ethical problems with placebos''), rather than in a separate section, is a very good editorial policy (I think it can be found in the CZ guidelines). [[User:Pierre-Alain Gouanvic|Pierre-Alain Gouanvic]] 14:24, 23 November 2007 (CST)
 
== Too many sections? ==
I'm sure this article is excellent, but, without reading it, I wonder if we could sensibly and usefully reduce the number of headings?  This tends to interrupt the flow of the article.  Actually, so many headings actually makes it hard for a "flow," or a narrative, to develop in the first place.  Please see [[CZ:Article Mechanics|Article Mechanics]] on this; the longer version goes into this in some detail. --[[User:Larry Sanger|Larry Sanger]] 22:03, 21 February 2008 (CST)
 
Hey, this page needs to be archived!  It's getting very long! --[[User:Larry Sanger|Larry Sanger]] 22:03, 21 February 2008 (CST)
:I cut out some stuff. Also, does anybody mind if I cut out the section "Why do we need EBM"? I do not see that it adds much to the text in the introduction. Also, it contains no references. - [[User:Robert Badgett|Robert Badgett]] 22:14, 21 February 2008 (CST)

Latest revision as of 16:02, 5 March 2024

This article has a Citable Version.
 Main Article
 Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
To learn how to update the categories for this article, see here. To update categories, edit the metadata template.
 Definition:  The conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients. [d] [e]
Checklist and Archives
 Workgroup category:  Health Sciences [Categories OK]
 Talk Archive:  1  English language variant:  American English

Too many sections?

I'm sure this article is excellent, but, without reading it, I wonder if we could sensibly and usefully reduce the number of headings? This tends to interrupt the flow of the article. Actually, so many headings actually makes it hard for a "flow," or a narrative, to develop in the first place. Please see Article Mechanics on this; the longer version goes into this in some detail. --Larry Sanger 22:03, 21 February 2008 (CST)

Hey, this page needs to be archived! It's getting very long! --Larry Sanger 22:03, 21 February 2008 (CST)

Okay, I archived for a fresh new outlook. --D. Matt Innis 11:58, 12 March 2008 (CDT)
I cut out some stuff. Also, does anybody mind if I cut out the section "Why do we need EBM"? I do not see that it adds much to the text in the introduction. Also, it contains no references. - Robert Badgett 22:14, 21 February 2008 (CST)

Agree it can be cut.Gareth Leng 11:46, 12 March 2008 (CDT) Can we cut out the sentences like "For more information, see: Clinical practice guideline" and instead a) link the phrase at first appearance and b) add to the related articles subpage?Gareth Leng 11:48, 12 March 2008 (CDT)

Responses to too many sections

I agree succinct is nice; however, I find that WikiPedia can be hard to follow when a topic is scattered over several pages. I am not as bothered by the length. In part because I do not see further sections that can easily be lopped off and put in their own pages. Maybe the metric section could be moved to a statistics article. We have already separate pages for Teaching evidence-based medicine and Evidence-based individual decision making. Should these have been subpages?? I suggest leaving clinical practice guidelines represented in the TOC so the concept is not lost.

  1. As nobody complained about my suggestion Feb 21 to delete the "Why do we need EBM", I have done so.
  2. In the sections "Methods proposed for assessing validity" and "Criticisms of EBM" I made the subsections not appear in the TOC.
  3. I moved publication bias content to article of that name.
  4. I removed the section heading "Methods proposed for assessing validity" but left the content. This content should be merged with the later occurring section titled "Levels of evidence".

- Bob - Robert Badgett 15:48, 12 March 2008 (CDT)

I think there is more that can be done. Question: ok if I move most of informatics content to the existing article of that name?


Approval?

I've gone through this with a copyedit run and made some minor adjustments to lose some subsections and compress some bits of text on the page.

In my view, this is a very scholarly, comprehensive and useful guide to EBM, and a good gateway to many related articles.

I think the last section should go because it seems not really in tune with the article scope as its developed - but should be moved somewhere; the point is a good one, but is overweighted by the (very nice but tangential) image.

Please see if my edits are good with you Bob, and delete the last section if you agree, and I'm ready to propose approval. I think I've only copy edited here.Gareth Leng 17:53, 15 January 2009 (UTC)

Regarding the complexity science question. What about just reducing the image (as I have done) or removing the image (which might be better and is ok with me)? If the image stays, its caption could be more succinct than I have done. By the way, the Hume statue is a great addition that you or someone did a while back. Otherwise all looks ok. - Robert Badgett 18:10, 15 January 2009 (UTC)

Snag?

I edited the metadata template to flag To Approve but it hasn't registered - help anyone?Gareth Leng 10:49, 16 January 2009 (UTC)

Got it, you must have deleted a "|" when you put your name in. D. Matt Innis 14:31, 16 January 2009 (UTC)
Anyone know if there is a way to add metadata in a more user friendly manner? I think that would help a lot, especially with newbies who get intimidated by the metadata template issues. Possibly Howard could dust off the programming side of his brain. Or we could recruit someone who needs a project for their computer programming course? Or science fair. As for the article, it looks good. Chris Day 15:00, 16 January 2009 (UTC)
Interesting that you mention that, Chris. I have a couple of unfunded potential projects, one in intelligent systems for both optimization and administration of drug prescribing, and another for process control of hydroponic cultivation of culinary herbs (I might have a question or two for you on botanical sensors). My last substantial programming was ten years or so ago, much of it real-time router code, and mostly in C. Somewhat later, I did some prototypes in Perl.
It is clear that I am going to have to learn some more current languages, much more Web integrated, as well as things that I can use with open source process control. Just at the moment, I've ben trying to decide on the priority of language skill to acquire. So, if you could tell me (email or here) what is used in MediaWiki and any tools, that would be a significant help to my planning. Not promising to deliver code yet, and I usually do design before coding; I am affected but not fully convinced by the Agile Programming manifesto. Nevertheless, I need to do some study anyway. My desktop environment is Windows, but I can certainly put server-appropriate Linux on a server here. Howard C. Berkowitz 15:41, 16 January 2009 (UTC)

APPROVED Version 1.0

Congratulations on approval of this version. D. Matt Innis 02:15, 27 January 2009 (UTC)

Discussion for Version 1.0 stopped here. Please continue further discussion under this break.

Toward Approval of version 1.1

I notice that the version number ToApprove points to the current Approved version. I assume it should point to this version that includes these edits that are Robert's. That means that this would be a three editor approval and everything looks okay for that tomorrow. If there is any objection or if I have made the wrong assumption, please let me know here before tomorrow. Thanks, D. Matt Innis 02:43, 1 July 2009 (UTC)

APPROVED Version 1.1

Discussion for Version 1.1 stopped here. Please continue further discussion under this break.

Reference needs fixing

In http://en.citizendium.org/wiki/Evidence-based_medicine/Draft#Acquisition_of_evidence, a reference needs fixing. Not evident how to do it. Anthony.Sebastian 03:21, 1 October 2009 (UTC)

Thanks for finding that, it was pretty ugly but is now fixed. Robert Badgett 03:34, 1 October 2009 (UTC)

approval

Now that there are three editors on board for reapproval (thanks guys), there is much less reason to wait another month before approval. If you'd like to move the target date sooner, you should feel free. --Joe (Approvals Manager) 12:47, 1 October 2009 (UTC)


APPROVED Version 2.0

Discussion for Version 2.0 stopped here. Please continue further discussion under this break.

New version 2 has an error in a section heading

The error:

===Acquisition of evidence===

...harms the contents menu. Should I start approval for another version? The draft does not have that error and has a number of new changes as well. The frequent approvals are very awkward. Robert Badgett 19:18, 2 November 2009 (UTC)

Well, I can correct that, since you're an editor telling me to do a minor typo fix. What should it be? ==Acquisition of evidence==? Hayford Peirce 19:52, 2 November 2009 (UTC)
The number of '='s is ok, but I believe there is a space accidentally placed before the first '='. - Robert Badgett 20:03, 2 November 2009 (UTC)
Yes. I just fixed it. Hayford Peirce 20:33, 2 November 2009 (UTC)
Thanks - Robert Badgett 20:34, 2 November 2009 (UTC)

See also section

Ok to delete the EHR, EMR, and Clinical Data warehouse links? - Robert Badgett 20:29, 9 February 2010 (UTC)

Retrieved from "https://citizendium.org/wiki/index.php?title=Talk:Evidence-based_medicine/Draft&oldid=924932"