Skip Navigation
Skip to contents

Clin Endosc : Clinical Endoscopy



Page Path
HOME > Clin Endosc > Volume 46(6); 2013 > Article
Original Article Learning Curve of Capsule Endoscopy
Korean Gut Image Study Group, Yun Jeong Lim1, Young Sung Joo2, Dae Young Jung3, Byong Duk Ye4, Ji Hyun Kim5, Jae Hee Cheon6, Seong Eun Kim7, Jae Hyuk Do8, Byung Ik Jang9, Jeong Seop Moon5, Jin Oh Kim10, Hoon Jae Chun11, Myung-Gyu Choi3
Clinical Endoscopy 2013;46(6):633-636.
Published online: November 19, 2013

1Department of Internal Medicine, Dongguk University College of Medicine, Goyang, Korea.

2Department of Statistics, Dongguk University, Seoul, Korea.

3Department of Internal Medicine, The Catholic University of Korea College of Medicine, Seoul, Korea.

4Department of Internal Medicine, University of Ulsan College of Medicine, Seoul, Korea.

5Department of Internal Medicine, Inje University College of Medicine, Busan, Korea.

6Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea.

7Department of Internal Medicine, Ewha Womans University School of Medicine, Seoul, Korea.

8Department of Internal Medicine, Chung-Ang University College of Medicine, Seoul, Korea.

9Department of Internal Medicine, Yeungnam University College of Medicine, Daegu, Korea.

10Department of Internal Medicine, Soonchunhyang University College of Medicine, Seoul, Korea.

11Department of Internal Medicine, Korea University College of Medicine, Seoul, Korea.

Correspondence: Myung-Gyu Choi. Department of Internal Medicine, Seoul St. Mary's Hospital, The Catholic University of Korea College of Medicine, 222 Banpo-daero, Seocho-gu, Seoul 137-701, Korea. Tel: +82-2-2258-2083, Fax: +82-2-2258-2089,
• Received: April 21, 2013   • Revised: June 12, 2013   • Accepted: June 16, 2013

Copyright © 2013 Korean Society of Gastrointestinal Endoscopy

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License ( which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

  • 58 Download
  • 19 Crossref
  • 22 Scopus
prev next
  • Background/Aims
    Capsule endoscopy (CE) has become an important tool for the diagnosis of small bowel disease. Although CE does not require the skill of endoscope insertion, the images should be interpreted by a person with experience in assessing images of the gastrointestinal mucosa. This investigation aimed to document the number of cases needed by trainees to gain the necessary experience for CE competency.
  • Methods
    Fifteen cases were distributed to 12 trainees with no previous experience of CE during their gastroenterology training as clinical fellows. Twelve trainees and an expert were asked to read CE images from one patient each week for 15 weeks. The diagnosis was reported using five categories (no abnormalities detected, small bowel erosion or ulcer, small bowel tumor, Crohn disease, and active small bowel bleeding with no identifiable source). We then examined, using the κ coefficient, how the degree of mean agreements between the trainees and the expert changed as the training progressed each week.
  • Results
    The agreement rate of CE diagnosis increased as the frequencies of interpretation increased. Most of the mean κ coefficients were >0.60 and >0.80 after week 9 and 11, respectively.
  • Conclusions
    Experience with approximately 10 cases of CE is appropriate for trainees to attain CE competency.
Capsule endoscopy (CE) is a convenient method that eliminates the discomfort of endoscope insertion for the patient and provides valuable information for the physician.1-4 CE is a valuable screening diagnostic modality for the small bowel, which is otherwise difficult to access.1-5 However, the quality control of the CE procedure can be difficult to maintain if CE data are not interpreted by a qualified person. The American Society of Gastrointestinal Endoscopy recommends that interpretation of CE data be performed by a person familiar with the mucosa of the gastrointestinal (GI) tract and the diagnosis of small bowel disease.3 American and Korean societies of gastrointestinal endoscopy have recommended 25, 20, and 10 cases of CE as necessary to ensure competence in the interpretation of findings.2,3,6 However, actual data supporting the adequate numbers of cases have not been reported. We conducted this investigation in trainees to determine the number of cases required to gain competence in CE interpretation.
In the training experiment, 12 trainees and an expert were asked to read CE images from one patient each week for 15 weeks. The 15 educational cases in this investigation were selected from four different university hospitals. The 15 enrolled case patients had adequate bowel preparation after fasting for 12 hours and consuming a liquid diet for 24 hours, or ingesting 2 L of polyethylene glycol.7-10 All CE images were acquired using Pillcam SB capsules from Given company (Israel). The expert was a faculty member of the division of gastroenterology with more than a decade of experience in wired endoscopy and wireless CE. Fourteen clinical fellows from the division of gastroenterology of different university hospitals voluntarily participated. Two clinical fellows dropped out because of their inability to interpret the CE images within the appointed period. The 12 remaining trainees completed the interpretation of 15 cases within the allotted time. All trainees had experiences of approximately 1,000 cases of wired endoscopy, including esophagogastroduodenoscopy and colonofiberscopy. Before the study, the trainees received education about the CE hardware and software. They simultaneously downloaded the same CE image from an Internet disc every week and reported their interpretation of each CE image through e-mail. The trainees had no knowledge of the other participants and were therefore unable to communicate with each other about the CE results. The clinical information of each case patient, including age, sex, and the reason for CE, was provided to the trainees. The result of interpretation included two components: small bowel transit time (minutes) and diagnosis. Small bowel diagnosis involved five categories: no abnormalities detected, small bowel erosion or ulcer, small bowel tumor, Crohn disease, and active small bowel bleeding with no identifiable source.
Statistical analyses
We examined how the degree of mean agreements between the trainees and the expert changed as the training experiment progressed each week, by using the κ coefficient, defined as K=[P(o)-P(e)]/[1-P(e)], where P(o) is the percentage of the observed agreement calculated on the basis of multiple ratings of two or more raters and P(e) is the probability of random agreement. If the raters perfectly agree, the κ coefficient (K)=1. If there is no agreement, K=0. In this study, it was inappropriate to use conventional multirater κ coefficients because they treat the trainees and the expert as equivalent raters.11 Also, as each rater (trainee or expert) conducted only one rating (reading the images from one patient) per week, we could not calculate κ coefficients properly with any given 1-week data. To overcome such problems, Cohen κ coefficients, Ks, were calculated with pooled data over a span of S weeks for each pair of one trainee and the expert.12 Within the 15-week period, there were 15-(S-1) spans. The mean, Ks, was calculated with the K values of all pairs for each week. For example, when the span size S is 3 weeks, the κ coefficient K3 of week W was calculated for each pair of one trainee and the expert with pooled data from week W-1, W, and W+1. Then, for each of the weeks 2, 3, …, and 14, K3 is calculated by averaging 12 K3's. The significant difference was checked by a p-value calculated using a two-sample test of two groups at each number of interpretations. All analyses were performed with SPSS version 12.0 for Windows (SPSS Inc., Chicago, IL, USA).
We determined the meaningful factors for a κ>0.5 between the expert and the trainees in the small bowel transit time and small bowel diagnosis. The agreement rate of the small bowel transit time was significantly associated with two variables: trainee (p=0.001) and capsule case (p=0.0011) (Table 1). The accuracy of the measurement of small bowel transit time depends on the trainee and the capsule image. If the capsule image failed to demonstrate the ileocecal valve and pylorus definitely, the measurement of small bowel transit time varied according to the trainee and capsule image. Small bowel tumors had maximum agreement, whereas Crohn disease had the lowest agreement between the trainees and the expert (Table 2). In diagnosing small bowel tumor, trainees had a mean agreement rate of 57% with the expert. They had a 29% agreement with the expert in diagnosing Crohn disease. Moreover, trainees tended to diagnose ulcer rather than Crohn disease owing to limited clinical information. Small bowel non-specific ulcers could not be discriminated as being induced by nonsteroidal anti-inflammatory drugs (NSAIDs) or Crohn disease solely through CE findings. The agreement rate of CE diagnosis increased as the frequencies of interpretation increased. Fig. 1 presents the K3, K5, and K7 values from our data. Regardless of the span sizes, most of the mean κ coefficients were >0.60 and >0.80 after week 9 and 11, respectively. The trainees demonstrated good agreement with the expert after 9 weeks and very good agreement after 11 weeks.
A capsule endoscope is a self-contained system that transmits images of the GI tract to an external receiver. The system produces little discomfort of endoscope insertion as compared with wired endoscopy.1-5 CE has become an important tool for the diagnosis of small bowel disease.1-5 As CE can be performed without the skilled technique of an operator, it is easy to use imprudently; however, it is important to maintain the quality control of the CE process. The American Society of Gastrointestinal Endoscopy recommends the use of CE to be limited to practitioners who are already competent in the procedure, who have performed standard endoscopy, and who have extensive experience in viewing the GI mucosa.3,6 Required threshold numbers of procedures (>10 or >25) to assess competency have been proposed.3,6 However, experimental studies or evidence supporting these proposed numbers are lacking. We performed this investigation to know how many cases are needed to ensure competency in performing CE.
We measured two parameters: small bowel transit time and small bowel diagnosis. Small bowel transit time is determined using the landmarks of the pylorus and the ileocecal valve.13,14 Images of the pylorus and ileocecal valve cannot be captured by CE. At that time, the interpreter should consider the first image of the duodenal lumen as the first observation of the small bowel and that just before first finding fecal material in the large lumen as the last observation of the small bowel. The agreement of small bowel transit time between the expert and trainees was associated with each capsule image and the trainee's trait.
The agreement rate of small bowel diagnosis varied according to small bowel disease entities. Crohn disease could not be differentiated from NSAID-induced ulcer or erosion only through the CE image. Trainees had difficulties in diagnosing Crohn disease. Crohn disease should be diagnosed on the basis of both the capsule image and patient's clinical information (e.g., weight loss, diarrhea, unexplained abdominal pain, elevated C-reactive protein, hypoalbuminemia, and no recent NSAID use).15-19 Small bowel tumor is sometimes difficult to differentiate from extrinsic compression. Interpreters should judge a CE finding considering the clinical information of each patient during the diagnosis. Accordingly, CE data should be interpreted by a gastroenterologist who can diagnose small bowel disease and perform small bowel endoscopy.
The limitation of this experiment was the lack of sufficient education and continuous feedback under proper supervision because the trainees worked in different hospitals located in different remote districts. Interpreters of CE findings must understand in advance the indications, contraindications, and risks of the procedure, and be familiar with the hardware and software necessary to perform CE and interpret the findings.1-6 The interpreters should be capable of detecting and describing abnormal CE findings accurately with proper terminology, and to judge CE findings considering the clinical situation of each case.
We used the κ coefficient as a statistical measure. The κ coefficient is one of most common measures for evaluating interrater agreement. Landis and Kock20 suggested how to interpret κ coefficients by using five categories (<0.20, poor; 0.21 to 0.40, fair; 0.41 to 0.60, moderate; 0.61 to 0.80, good; >0.80, very good). In this investigation, most of the mean κ coefficients were >0.60 after week 9 and >0.80 after week 11, which indicates good agreement of the trainees with the expert after 9 weeks and very good agreement after 11 weeks.
As with other endoscopic procedures, trainees should receive proper endoscopic training programs and must be exposed to a sufficient number of endoscopic experiences. Although the performance of an arbitrary number of procedures does not guarantee competence, experience with approximately 10 cases of CE is appropriate for trainees to attain competency in CE.
We deeply appreciate the participation of the 12 trainees in this study.
This work supported by the Gastrointestinal Endoscopy Research Foundation of Korea.

The authors have no financial conflicts of interest.

  • 1. Mishkin DS, Chuttani R, Croffie J, et al. ASGE Technology Status Evaluation Report: wireless capsule endoscopy. Gastrointest Endosc 2006;63:539–545. 16564850.ArticlePubMed
  • 2. American Association for the Study of Liver Diseases. American College of Gastroenterology. American Gastroenterological Association (AGA) Institute. American Society for Gastrointestinal Endoscopy. The gastroenterology core curriculum, third edition. Gastroenterology 2007;132:2012–2018. 17484892.ArticlePubMed
  • 3. Faigel DO, Baron TH, Adler DG, et al. ASGE guideline: guidelines for credentialing and granting privileges for capsule endoscopy. Gastrointest Endosc 2005;61:503–505. 15812400.ArticlePubMed
  • 4. Varela Lema L, Ruano-Ravina A. Effectiveness and safety of capsule endoscopy in the diagnosis of small bowel diseases. J Clin Gastroenterol 2008;42:466–471. 18277887.ArticlePubMed
  • 5. Rey JF, Ladas S, Alhassani A, Kuznetsov K. ESGE Guidelines Committee. European Society of Gastrointestinal Endoscopy (ESGE). Video capsule endoscopy: update to guidelines (May 2006). Endoscopy 2006;38:1047–1053. 17058174.ArticlePubMed
  • 6. Gut Image Study Group. Lim YJ, Moon JS, et al. Korean Society of Gastrointestinal Endoscopy (KSGE) guidelines for credentialing and granting previleges for capsule endoscopy. Korean J Gastrointest Endosc 2008;37:393–402.
  • 7. Viazis N, Sgouros S, Papaxoinis K, et al. Bowel preparation increases the diagnostic yield of capsule endoscopy: a prospective, randomized, controlled study. Gastrointest Endosc 2004;60:534–538. 15472674.ArticlePubMed
  • 8. Dai N, Gubler C, Hengstler P, Meyenberger C, Bauerfeind P. Improved capsule endoscopy after bowel preparation. Gastrointest Endosc 2005;61:28–31. 15672052.ArticlePubMed
  • 9. Niv Y, Niv G. Capsule endoscopy: role of bowel preparation in successful visualization. Scand J Gastroenterol 2004;39:1005–1009. 15513342.ArticlePubMed
  • 10. Ben-Soussan E, Savoye G, Antonietti M, Ramirez S, Ducrotté P, Lerebours E. Is a 2-liter PEG preparation useful before capsule endoscopy? J Clin Gastroenterol 2005;39:381–384. 15815205.ArticlePubMed
  • 11. Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull 1971;76:378–382.Article
  • 12. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960;20:37–46.Article
  • 13. Selby W. Complete small-bowel transit in patients undergoing capsule endoscopy: determining factors and improvement with metoclopramide. Gastrointest Endosc 2005;61:80–85. 15672061.ArticlePubMed
  • 14. Korman LY, Delvaux M, Gay G, et al. Capsule endoscopy structured terminology (CEST): proposal of a standardized and structured terminology for reporting capsule endoscopy procedures. Endoscopy 2005;37:951–959. 16189767.ArticlePubMedPDF
  • 15. Ahmad NA, Iqbal N, Joyce A. Clinical impact of capsule endoscopy on management of gastrointestinal disorders. Clin Gastroenterol Hepatol 2008;6:433–437. 18325843.ArticlePubMed
  • 16. van Tuyl SA, van Noorden JT, Stolk MF, Kuipers EJ. Clinical consequences of videocapsule endoscopy in GI bleeding and Crohn's disease. Gastrointest Endosc 2007;66:1164–1170. 17904134.ArticlePubMed
  • 17. Mergener K, Ponchon T, Gralnek I, et al. Literature review and recommendations for clinical application of small-bowel capsule endoscopy, based on a panel discussion by international experts. Consensus statements for small-bowel capsule endoscopy, 2006/2007. Endoscopy 2007;39:895–909. 17968807.ArticlePubMed
  • 18. Maiden L, Thjodleifsson B, Theodors A, Gonzalez J, Bjarnason I. A quantitative analysis of NSAID-induced small bowel pathology by capsule enteroscopy. Gastroenterology 2005;128:1172–1178. 15887101.ArticlePubMed
  • 19. Kornbluth A, Colombel JF, Leighton JA, Loftus E. ICCE. ICCE consensus for inflammatory bowel disease. Endoscopy 2005;37:1051–1054. 16189789.ArticlePubMedPDF
  • 20. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–174. 843571.ArticlePubMed
Fig. 1
Mean κ values at different span sizes.
Table 1
Accuracy of Small Bowel Transit Time between the Expert and Trainees

CE, capsule endoscopy.

Table 2
Agreement Rate of Small Bowel Diagnosis between the Expert and Trainees

Figure & Data



    Citations to this article as recorded by  
    • Road map to small bowel endoscopy quality indicators
      Mohamed G. Shiha, David S. Sanders, Reena Sidhu
      Current Opinion in Gastroenterology.2024; 40(3): 183.     CrossRef
    • Pediatric Web-based Video Capsule Endoscopy Curriculum: A Pilot Study to Determine the Ability to Implement a Standardized Educational Curriculum
      Uma Padhye Phatak, Corey Scherer, Nan Du, Joel A. Friedlander
      JPGN Reports.2022; 3(1): e130.     CrossRef
    • Colon capsule endoscopy in colorectal cancer screening: a systematic review
      Fanny E. R. Vuik, Stella A. V. Nieuwenburg, Sarah Moen, Cristiano Spada, Carlo Senore, Cesare Hassan, Marco Pennazio, Emanuele Rondonotti, Silvia Pecere, Ernst J. Kuipers, Manon C. W. Spaander
      Endoscopy.2021; 53(08): 815.     CrossRef
    • Training, Reading, and Reporting for Small Bowel Video Capsule Endoscopy
      Ariosto Hernandez-Lara, Elizabeth Rajan
      Gastrointestinal Endoscopy Clinics of North America.2021; 31(2): 237.     CrossRef
    • The impact of reader fatigue on the accuracy of capsule endoscopy interpretation
      Sabina Beg, Tim Card, Reena Sidhu, Ewa Wronska, Krish Ragunath, Hey-Long Ching, Anastasios Koulaouzidis, Diana Yung, Simon Panter, Mark Mcalindon, Matthew Johnson, Arun Kurup, Anthony Shonde, Miliedis San-Juan Acosta, Stefano Sansone, Ebby Simmon, Victori
      Digestive and Liver Disease.2021; 53(8): 1028.     CrossRef
    • Prospective multicenter study to evaluate capsule endoscopy competency using a validated assessment tool
      Elizabeth Rajan, Manuel Martinez, Emmanuel Gorospe, Badr Al Bawardy, Akira Dobashi, Kristin C. Mara, Stephanie L. Hansel, David H. Bruining, Joseph A. Murray, Cadman L. Leggett, Vandana Nehra, Prasad G. Iyer, Shabana F. Pasha, Jonathan A. Leighton, Arthur
      Gastrointestinal Endoscopy.2020; 91(5): 1140.     CrossRef
    • Training in video capsule endoscopy: Current status and unmet needs
      Apostolos Koffas, Faidon-Marios Laskaratos, Owen Epstein
      World Journal of Gastrointestinal Endoscopy.2019; 11(6): 395.     CrossRef
    • Optimising the performance and interpretation of small bowel capsule endoscopy
      Sabina Beg, Adolfo Parra-Blanco, Krish Ragunath
      Frontline Gastroenterology.2018; 9(4): 300.     CrossRef
    • Influencia de la experiencia acumulada del explorador en el valor predictivo negativo de la cápsula endoscópica
      Benito Velayos Jiménez, Noelia Alcaide Suárez, Guillermo González Redondo, Luis Fernández Salazar, Rocío Aller de la Fuente, Lourdes del Olmo Martínez, Lourdes Ruiz Rebollo, José Manuel González Hernández
      Gastroenterología y Hepatología.2017; 40(1): 10.     CrossRef
    • Impact of the endoscopist's experience on the negative predictive value of capsule endoscopy
      Benito Velayos Jiménez, Noelia Alcaide Suárez, Guillermo González Redondo, Luis Fernández Salazar, Rocío Aller de la Fuente, Lourdes del Olmo Martínez, Lourdes Ruiz Rebollo, José Manuel González Hernández
      Gastroenterología y Hepatología (English Edition).2017; 40(1): 10.     CrossRef
    • Colon capsule endoscopy: toward the future
      Naoki Muguruma, Kumiko Tanaka, Satoshi Teramae, Tetsuji Takayama
      Clinical Journal of Gastroenterology.2017; 10(1): 1.     CrossRef
    • NASPGHAN Capsule Endoscopy Clinical Report
      Joel A. Friedlander, Quin Y. Liu, Benjamin Sahn, Koorosh Kooros, Catharine M. Walsh, Robert E. Kramer, Jenifer R. Lightdale, Julie Khlevner, Mark McOmber, Jacob Kurowski, Matthew J. Giefer, Harpreet Pall, David M. Troendle, Elizabeth C. Utterson, Herbert
      Journal of Pediatric Gastroenterology and Nutrition.2017; 64(3): 485.     CrossRef
    • A 13-year time trend analysis of 3724 small bowel video capsule endoscopies and a forecast model during the financial crisis in Greece
      Konstantinos Triantafyllou, Paraskevas Gkolfakis, Nikos Viazis, Panagiotis Tsibouris, Athanasios Tsigaridas, Periklis Apostolopoulos, John Anastasiou, Eleni Hounda, Ioannis Skianis, Konstantina Katopodi, Xhoela Ndini, George Alexandrakis, Demetrios G. Kar
      European Journal of Gastroenterology & Hepatology.2017; 29(2): 185.     CrossRef
    • Recommandations du CDU–HGE, du CNU d’HGE et de la SFED sur la formation en endoscopie digestive
      M. Robaszkiewicz, M. Barthet, P. Bulois, S. Chaussade, E. Coron, X. Dray, R. Laugier, T. Lecomte, D. Moussata, T. Ponchon, F. Prat, J. -M. Reimund, J. -C. Saurin, D. Sautereau, M. Dapoigny, C. Silvain
      Acta Endoscopica.2016; 46(5): 282.     CrossRef
    • Experiencia de cápsula endoscópica en sangrado de origen obscuro y dolor abdominal crónico recurrente en Pediatría del CMN «20 de Noviembre» del ISSSTE
      Ramón Alfredo Castañeda-Ortiz, Plácido Espinosa-Rosas, Rodrigo Alejandro Rodriguez-Izaguirre, Anahi Anzo-Osorio, Enory Almanza-Miranda, Luis Ariel Waller-Gónzalez, Guillermina Gómez-Navarro, Pedro Salvador Jimenez-Urueta
      Endoscopia.2016; 28(3): 96.     CrossRef
    • Optimizing lesion detection in small-bowel capsule endoscopy: from present problems to future solutions
      Anastasios Koulaouzidis, Dimitris K Iakovidis, Alexandros Karargyris, John N Plevris
      Expert Review of Gastroenterology & Hepatology.2015; 9(2): 217.     CrossRef
    • A Simple Evaluation Tool (ET-CET) Indicates Increase of Diagnostic Skills From Small Bowel Capsule Endoscopy Training Courses
      J.G. Albert, O. Humbla, M.E. McAlindon, C. Davison, U. Seitz, C. Fraser, F. Hagenmüller, E. Noetzel, C. Spada, M.E. Riccioni, J. Barnert, N. Filmann, M. Keuchel
      Medicine.2015; 94(43): e1941.     CrossRef
    • Training in Video Capsule Endoscopy
      Cary G. Sauer, Steven H. Erdman
      Journal of Pediatric Gastroenterology and Nutrition.2015; 61(4): 381.     CrossRef
    • Perfecting Video Capsule Endoscopy: Is There Need for Training?
      Jae Hee Cheon, Ki Baik Hahm
      Clinical Endoscopy.2013; 46(6): 599.     CrossRef

    • PubReader PubReader
    • ePub LinkePub Link
    • Cite
      export Copy
      Download Citation
      Download a citation file in RIS format that can be imported by all major citation management software, including EndNote, ProCite, RefWorks, and Reference Manager.

      • RIS — For EndNote, ProCite, RefWorks, and most other reference management software
      • BibTeX — For JabRef, BibDesk, and other BibTeX-specific software
      • Citation for the content below
      Learning Curve of Capsule Endoscopy
      Clin Endosc. 2013;46(6):633-636.   Published online November 19, 2013
    • XML DownloadXML Download
    We recommend

    Clin Endosc : Clinical Endoscopy Twitter Facebook
    Close layer