MEDICAL INSIGHTS · 08
What evidence should doctors examine for a new operation?
Key answer
A new operation is not judged by publication or case counts alone. Check comparisons with existing care, patient selection, follow-up, and complete reporting of complications and reoperations. Device authorization and course completion do not replace comparative evidence of clinical effectiveness.
Medical explanation
These questions help assess a new technique.
- Was there a comparison group receiving established care or no treatment?
- Was follow-up long enough to reveal the main risks?
- Do the participants resemble the patients I treat?
- Who counted complications, and using which definitions?
- Were the developer or device manufacturer involved?
- If other operations were performed simultaneously, can their effects be separated?
Patients can ask not only whether a method is new, but what it has actually shown and what remains unknown. These questions apply equally to established and new techniques.
Evidence
IDEAL divides surgical innovation into idea, development, exploration, assessment and long-term study, with evaluation methods for each stage. Early work should prospectively record technique changes and consecutive patients; later work needs appropriate comparisons and long-term observation.
Calling a study a meta-analysis does not remove the limitations of small single-arm studies within it. Such studies still provide information about feasibility and reported complications, but should not be confused with evidence of superiority or causation.
Questions before a consultation
- Check the comparator, missing patients, reoperations and long-term follow-up.
- Disclose developer involvement and conflicts of interest, and check independent reproducibility.
- Discuss uncertainty alongside established treatment and observation as alternatives.
References
- McCulloch P, Altman DG, Campbell WB, et al. No surgical innovation without evaluation: the IDEAL recommendations. Lancet. 2009;374(9695):1105-1112. https://doi.org/10.1016/S0140-6736(09)61116-8
This is general medical information edited against published literature. Literature review and editing are distinct from final physician review and do not replace individual diagnosis or treatment. All procedures carry risks and outcomes vary.