American Journal of Neuroradiology 23:768-771, May 2002
© 2002 American Society of Neuroradiology
INTERVENTIONAL
The Learning Curve for Coil Embolization of Unruptured Intracranial Aneurysms
a Department of Neurology, University of California, San Francisco
b the Division of Interventional Neuroradiology, University of California, San Francisco
Address reprint requests to Vineeta Singh, MD, Department of Neurology, Box 0114, 505 Parnassus Avenue, San Francisco, CA 94143-0114
 |
Abstract |
|---|
 TOP Abstract IntroductionMethodsResultsDiscussionConclusionReferences |
|---|
BACKGROUND AND PURPOSE: Several studies have shown that procedural outcomes are better at high-volume institutions, possibly due to greater physician experience (learning) or practice (repetition). Our purpose was to determine whether outcomes for coil embolization improved with the experience of the practitioner, after adjusting for the perceived risk of treatment.
METHODS: We identified all unruptured aneurysms treated with coil embolization at our institution from 1990 through 1997. A clinical nurse specialist abstracted the characteristics from cases that met the entry criteria. Two neurologists independently determined the complications by using definitions established a priori. The influence of experience of the treating-physician on complications was evaluated with univariate and multivariable logistic regression analyses.
RESULTS: Sixteen complications occurred in 94 patients (17%) treated with coil embolization. Complications occurred in 53% of the first five cases that each of three physicians treated, and in 10% of later cases (P < .001). After an adjustment for all other predictors, including physician assessment of the risk of the procedure, the odds of a complication decreased with increasing physician experience (odds ratio, 0.69 for every five cases treated; 95% confidence interval: 0.50, 0.96; P=.03).
CONCLUSION: The risk of complications with coil embolization of unruptured aneurysms appears to decrease dramatically with physician experience. Because the physicians in this study were highly experienced in other endovascular techniques at study onset, the rate of learning may not be generalizable to other centers.
|
Introduction |
|---|
|
TOPAbstractIntroductionMethodsResultsDiscussionConclusionReferences |
|---|
Outcomes of complex procedures improve with the experience of the practitioners (1–3). This association, termed the learning curve, has been demonstrated in several complex procedures, including laparoscopic cholecystectomy, laparoscopic fundoplication, coronary angioplasty, and laser-assisted in situ keratomileusis (LASIK) surgery of the eye (4–8).
Endovascular therapy with platinum coils (Guglielmi detachable coils [GDCs]) was introduced in 1990 as an alternative to surgical clip placement for the treatment of cerebral aneurysms (9, 10). Endovascular therapy with coils is a complex procedure, and extensive training has been recommended (11, 12). With its appeal as a minimally invasive technique, an increasing number of centers are treating unruptured and ruptured aneurysms with endovascular coil embolization.
We sought to determine whether outcomes for endovascular coil embolization improved with the experience of the practitioner after adjusting for the perceived risk of treatment.
|
Methods |
|---|
|
TOPAbstractIntroductionMethodsResultsDiscussionConclusionReferences |
|---|
Cohort Definition
We searched a computerized database of hospital admissions at the University of California San Francisco (UCSF) Medical Center for all unruptured aneurysms treated by endovascular means from 1990 through 1997, as previously described (13). Medical records were reviewed to confirm that patients met the following inclusion criteria: endovascular coil embolization of an unruptured aneurysm, age 18 years or older at follow-up, no associated arteriovenous malformation, no subarachnoid hemorrhage from a different aneurysm within 6 months before treatment, and no aneurysm treated on a second occasion within 2 months of treatment. This cohort was developed as a part of larger study to compare endovascular and surgical treatment (13).
To obtain an overall estimate of procedural risk, the following information was presented to three neurointerventional radiologists who were unaware of the actual treatment modality and outcome: 1) patient age, past medical history, symptoms, and signs on presentation based on medical records abstraction and 2) relevant preprocedural radiographic images. Physicians familiar with a case were excluded from its review. Anticipated procedural risk was rated on a four-point Likert scale. Neurointerventional radiologists (R.T.H., C.F.D., V.V.H.) were asked to estimate the aneurysm size and neck-to-dome ratio.
Outcomes
The occurrence of a procedure-related complication was the primary outcome for this analysis. A procedure-related complication was defined as an adverse event that was clearly a result of the procedure and that led to prolonged hospitalization or a change in the Rankin Scale score of 1 or more points at discharge. This outcome was believed to be important because it reflected morbidity and resource consumption, although it was likely that previously applied definitions increased the detection of complications.
Two neurologists (S.C.J., D.R.G.) independently determined the procedure-related complications for the entire course of treatment (13). Agreement on whether a procedure-related complication occurred was substantial ( 54=0.86) (14). Disagreements were resolved through discussion. The effectiveness of treatment was estimated by assessing the presence of residual neck or coil compaction during initial follow-up angiography (generally performed within 6 months) that required additional coil embolization. The length of stay was recorded as the number of days that the patient spent in the hospital; this included acute as well as all follow-up hospitalizations. Hospital charges were obtained from institutional administrative databases and included those from initial and all follow-up care at UCSF.
Statistical Analysis
Physician-anticipated risk ratings were transformed to z scores so that the mean response for each reviewer was 0 with a standard deviation of 1. For each patient, z scores were averaged so that each reviewer contributed equally to the risk assessment. The case number in a rank series for a given practitioner was used as a surrogate for that practitioner’s experience. For univariate analyses, we compared cases from the first half of the collective experience with later cases. To illustrate changes in outcomes with experience, we plotted the proportion with complications by the case number.
Univariate comparisons of continuous variables that were not normally distributed were performed with the Wilcoxon rank-sum test. The chi-square test was used for comparing the categorical variables unless any cell in a 2 x 2 table was less than five, in which case we used the Fisher exact test. We used logistic regression to determine the independent association of experience on the risk of complications after we adjusted for risk assessments, age, female sex, Rankin score at admission, presenting symptoms, number of aneurysms, aneurysmal location, aneurysmal size, aneurysmal neck-to-dome ratio.
|
Results |
|---|
|
TOPAbstractIntroductionMethodsResultsDiscussionConclusionReferences |
|---|
A total of 98 patients were treated by means of coil embolization for unruptured aneurysms; of these, 94 met the inclusion criteria. Compared with the other patients, those treated in the later period were slightly younger and less likely to have presented with compressive symptoms, such as cranial neuropathies (Table 1). In the initial treatment group, more aneurysms were in the posterior circulation, whereas in the later group, aneurysms were more common in the anterior circulation. The neck-to-dome ratio was greater in the aneurysms that were treated later. Anticipated procedural risks estimated by the neurointerventional radiologists were similar in the two groups.
|
When cases were dichotomized at the midpoint of practitioner experience, 24% of the initial cases and 10% of the later cases had a complication P=.07 (Table 2). There were no significant differences in the types of adverse events (Table 3). An additional analysis was performed, in which we considered only those adverse events that were neurologically or directly related to the procedure. The proportion of these adverse events was 15 33% in the initial group and nine (18%) in the later group. The total length of stay, intensive care days, and hospital charges, including all follow-up care at UCSF, were similar in both groups. Further embolization was required less frequently in the later cases (Table 2). The cumulative proportion with complications dramatically decreased with the number of cases previously treated by each neurointerventional radiologist (Fig 1).
|
|
|
We compared complications for the first five cases for each of these neuroradiologists with those of subsequent cases (Fig 2). Complications occurred in 53% of the first five cases that each of the three physicians treated and in 10% of later cases (P < .001). After we adjusted for all other predictors, the odds of complication were lower with increasing physician experience (odds ratio, 0.69 for every five cases treated; 95% confidence interval: 0.50, 0.96; P= .03); the result correspond to a 30% odds reduction for complication for every five cases treated.
|
|
Discussion |
|---|
|
TOPAbstractIntroductionMethodsResultsDiscussionConclusionReferences |
|---|
In our study of three practitioners at a single center, the risk of complications with coil embolization of unruptured aneurysms dramatically decreased with physician experience, even after adjustment for case complexity. As endovascular coil embolization is introduced in an increasing number of centers, the recognition that the practitioner’s lack of initial experience with the technique is likely to be associated with rates of complications that are higher than those reported in the literature (13, 15). Similar to other complex procedures, coil embolization is associated with a steep learning curve.
One prior group (16) evaluated the learning curve for coil embolization, comparing the first 100 cases with the second 100 treated at a single institution. The rate of procedure-related complications decreased from 14% to 7%. This study included patients with ruptured aneurysms, and the definition of complications in that study was more conservative than ours. Results from unruptured aneurysm treatment provide more direct information about the procedural risk because patients with this condition have minimal aneurysm-related impairment prior to treatment (17). Although our study was smaller, we only included cases in which new deficits could be attributed to treatment, and we were able to control for the procedural risk to isolate the influence of experience on outcome.
Two main limitations of this study should be acknowledged. First, advances in coil technology, catheters, wires, and imaging modalities could simplify the procedures and result in more rapid training. These advances may account for some of the improvement seen in the later part of the study. Second, this study included experienced neurointerventional radiologists who were trained in other endovascular techniques prior to the study period; therefore, the results may not be reproducible in a community-based practice. Those with less experience who are performing endovascular techniques may be expected to improve more slowly with coil embolization.
|
Conclusion |
|---|
|
TOPAbstractIntroductionMethodsResultsDiscussionConclusionReferences |
|---|
Practitioners should be aware of the influence of the learning curve on the procedure-related complication rate for coil embolization. Extensive formal training could reduce early complications. Recognition of the steep learning curve may also be important in considering referrals for coil embolization.
|
References |
|---|
|
TOPAbstractIntroductionMethodsResultsDiscussionConclusionReferences |
|---|
- Barrat C, Cueto-Rozon R, Catheline JM, Rizk N, Champault G. Impact of learning and experience on the laparoscopic treatment of gastroesophageal reflux. Chirurgie1999; 124 :675 –80[Medline]
- Hawasli A, Lloyd LR. Laparoscopic cholecystectomy: the learning curve—report of 50 patients. Am Surg1991; 57 :542 –4[Medline]
- Kopacz DJ, Neal JM, Pollock JE. The regional anesthesia " learning curve". What is the minimum number of epidural and spinal blocks to reach consistency? Reg Anesth1996; 21 :182 –90[Medline]
- Buonanno C. Transluminal coronary angioplasty: is a learning curve necessary? G Ital Cardiol1986; 16 :457 –62[Medline]
- Blanckaert J, Sallet G. Lasik learning curve: clinical study of 300 myopic eyes. Bull Soc Belge Ophtalmol1998; 268 :7 –12[Medline]
- Cagir B, Rangraj M, Maffuci L, Herz BL. The learning curve for laparoscopic cholecystectomy. J Laparoendosc Surg1994; 4 :419 –27[Medline]
- Lekawa M, Shapiro SJ, Gordon LA, Rothbart J, Hiatt JR. The laparoscopic learning curve. Surg Laparosc Endosc1995; 5 :455 –8[Medline]
- Watson DI, Baigrie RJ, Jamieson GG. A learning curve for laparoscopic fundoplication: definable, avoidable, or a waste of time? Ann Surg1996; 224 :198 –203[Medline]
- Guglielmi G, Vinuela F, Sepetka I, Macellari V. Electrothrombosis of saccular aneurysms via endovascular approach, 1: electrochemical basis, technique, and experimental results. J Neurosurg1991; 75 :1 –7[Medline]
- Guglielmi G, Vinuela F, Dion J, Duckwiler G. Electrothrombosis of saccular aneurysms via endovascular approach, II: preliminary clinical experience. J Neurosurg1991; 75 :8 –14[Medline]
-
Higashida RT. Evolution of a new multidisciplinary subspecialty: interventional neuroradiology/neuroendovascular surgery.
AJNR Am J Neuroradiol2000; 21
:1151
–2.
[Free Full Text] -
Higashida RT, Hopkins LN, Berenstein A, Halbach VV, Kerber C. Program requirements for residency/fellowship education in neuroendovascular surgery/interventional neuroradiology: a special report on graduate medical education.
AJNR Am J Neuroradiol2000; 21
:1153
–9
[Abstract/Free Full Text] - Johnston SC, Wilson CB, Halbach VV, et al. Endovascular and surgical treatment of unruptured cerebral aneurysms: comparison of risks. Ann Neurol2000; 48 :11 –9[Medline]
- Landis JR, Koch GG. An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics1977; 33 :363 –74[Medline]
-
Brilstra EH, Rinkel GJ, van der Graaf Y, van Rooij WJ, Algra A. Treatment of intracranial aneurysms by embolization with coils: a systematic review.
Stroke1999; 30
:470
–6
[Abstract/Free Full Text] - Malisch TW, Guglielmi G, Vinuela F, et al. Intracranial aneurysms treated with the Guglielmi detachable coil: midterm clinical results in a consecutive series of 100 patients. J Neurosurg1997; 87 :176 –83[Medline]
- Solomon RA, Fink ME, Pile-Spellman J. Surgical management of unruptured intracranial aneurysms. J Neurosurg1994; 80 :440 –6[Medline]
This article has been cited by other articles:
 |
|
 |
|
  J. B. Bederson, E. S. Connolly Jr, H. H. Batjer, R. G. Dacey, J. E. Dion, M. N. Diringer, J. E. Duldner Jr, R. E. Harbaugh, A. B. Patel, and R. H. Rosenwasser Guidelines for the Management of Aneurysmal Subarachnoid Hemorrhage: A Statement for Healthcare Professionals From a Special Writing Group of the Stroke Council, American Heart Association Stroke, March 1, 2009; 40(3): 994 - 1025. [Full Text] [PDF]
|
|
|
|
 |
|
 S. Gallas, J. Drouineau, J. Gabrillargues, A. Pasco, C. Cognard, L. Pierot, and D. Herbreteau Feasibility, Procedural Morbidity and Mortality, and Long-Term Follow-Up of Endovascular Treatment of 321 Unruptured Aneurysms AJNR Am. J. Neuroradiol., January 1, 2008; 29(1): 63 - 68. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. S. Leopold, H. D. Morgan, N. J. Kadel, G. C. Gardner, D. C. Schaad, and F. M. Wolf Impact of Educational Intervention on Confidence and Competence in the Performance of a Simple Surgical Task J. Bone Joint Surg. Am., May 1, 2005; 87(5): 1031 - 1037. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. J. Connors III, D. Sacks, A. J. Furlan, W. R. Selman, E. J. Russell, P. E. Stieg, M. N. Hadley, and for the NeuroVascular Coalition Writing Group Training, competency, and credentialing standards for diagnostic cervicocerebral angiography, carotid stenting, and cerebrovascular intervention: A Joint Statement from the American Academy of Neurology, the American Association of Neurological Surgeons, the American Society of Interventional and Therapeutic Neuroradiology, the American Society of Neuroradiology, the Congress of Neurological Surgeons, the AANS/CNS Cerebrovascular Section, and the Society of Interventional Radiology Neurology, January 25, 2005; 64(2): 190 - 198. [Full Text] [PDF]
|
|
|
|
 |
|
 J. J. Connors III, D. Sacks, A. J. Furlan, W. R. Selman, E. J. Russell, P. E. Stieg, M. N. Hadley, and For the NeuroVascular Coalition Writing Group Training, Competency, and Credentialing Standards for Diagnostic Cervicocerebral Angiography, Carotid Stenting, and Cerebrovascular Intervention: A Joint Statement from the American Academy of Neurology, American Association of Neurological Surgeons, American Society of Interventional and Therapeutic Radiology, American Society of Neuroradiology, Congress of Neurological Surgeons, AANS/CNS Cerebrovascular Section, and Society of Interventional Radiology Radiology, January 1, 2005; 234(1): 26 - 34. [Full Text] [PDF]
|
|
|
|
|
|
C. P. Derdeyn, J. D. Barr, A. Berenstein, John. J. Connors, J. E. Dion, G. R. Duckwiler, R. T. Higashida, C. M. Strother, T. A. Tomsick, and P. Turski The International Subarachnoid Aneurysm Trial (ISAT): A Position Statement from the Executive Committee of the American Society of Interventional and Therapeutic Neuroradiology and the American Society of Neuroradiology AJNR Am. J. Neuroradiol., August 1, 2003; 24(7): 1404 - 1408. [Full Text] [PDF]
|
|
|
|
|
|
B. L. Hoh, J. D. Rabinov, J. C. Pryor, B. S. Carter, and F. G. Barker II In-Hospital Morbidity and Mortality after Endovascular Treatment of Unruptured Intracranial Aneurysms in the United States, 1996-2000: Effect of Hospital and Physician Volume AJNR Am. J. Neuroradiol., August 1, 2003; 24(7): 1409 - 1420. [Abstract] [Full Text] [PDF]
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||