Published Sep 1, 2023


Google Scholar
Search GoogleScholar

Sandra Patricia Usaquén-Perilla, MSc

Deliana Ropero-Rojas, PhD

Jaime Mosquera-Restrepo, PhD

Jonathan D. Kirsch, MD

Zachary P. Kaltenborn, MD

José Isidro García-Melo, PhD

Lyda Elena Osorio-Amaya, PhD



Objective: Point of care ultrasound (POCUS) is a widely used clinical tool. This operator-dependent technique requires methods to establish individual benchmarks and to monitor the learning process. We present the use of the learning curve standard cumulative summation (LC-CUSUM) and CUSUM control charts to establish and monitor, respectively, the proficiency of a physician to detect pulmonary B-lines with POCUS. Materials and Methods: A training course for general practitioners was conducted to detect plasma leakage using POCUS. The trainees and an expert radiologist identified the number of pulmonary B-lines in the POCUS images of 53 hospitalized patients. The interpretation of one trainee was compared to that of the expert radiologist using LC-CUSUM and CUSUM considering image quality and anatomical site. Results and Discussion: We found that image quality was better in the apices than the bases of the lungs. The trainee learning curve differed by anatomical site and the results of LC-CUSUM and CUSUM differed when only high-quality (first scenario) or all images (second scenario) were included in the analysis. Conclusion: The LC-CUSUM and CUSUM control charts were useful to evaluate the learning curve in this case and to identify image quality as an important factor in the evaluation process. They warrant further study as graphical tools for real-time monitoring of POCUS training.


Ecografía en el punto de atención, ultrasonografía, curva de aprendizajePoint-of-care ultrasound, ultrasonography, learning curve


[1] Filly R, “Ultrasound: the stethoscope of the future, alas,” Radiology, vol. 167, no. 2, p. 400, 1988, doi:
[2] American College of Emergency Physicians (ACEP), Emergency Ultrasound Standard Reporting Guidelines, vol. 2018, no. October. 2018.
[3] S. Akhtar et al., “Resident training in emergency ultrasound: Consensus recommendations from the 2008 council of emergency medicine residency directors conference,” Acad. Emerg. Med., vol. 16, no. SUPPL. 2, 2009, doi:
[4] J. R. Marin and R. E. Lewiss, “Point-of-Care Ultrasonography by Pediatric Emergency Medicine Physicians,” Pediatrics, vol. 135, no. 4, pp. e1113–e1122, 2015, doi:
[5] R. E. Lewiss et al., “CORD-AEUS: Consensus document for the emergency ultrasound milestone project,” Acad. Emerg. Med., vol. 20, no. 7, pp. 740–745, 2013, doi:
[6] R. E. Lewiss et al., “Research priorities in the utilization and interpretation of diagnostic imaging: Education, assessment, and competency,” Acad. Emerg. Med., vol. 22, no. 12, pp. 1447–1454, 2015, doi:
[7] American College of Emergency Physicians, Ultrasound Guidelines: Emergency, Point-of-care, and Clinical Ultrasound Guidelines in Medicine. 2016.
[8] Z. Feilchenfeld, A. Kuper, and C. Whitehead, “Stethoscope of the 21st century: dominant discourses of ultrasound in medical education,” Med. Educ., vol. 52, no. 12, pp. 1271–1287, 2018, doi:
[9] V. Swamy, P. Brainin, T. Biering-Sørensen, and E. Platz, “Ability of non-physicians to perform and interpret lung ultrasound: A systematic review,” Eur. J. Cardiovasc. Nurs., vol. 18, no. 6, pp. 474–483, 2019, doi:
[10] S. Hamid, R. Aislynn, F. Katelyn, S. James, and K. Vanessa, “Assessment Of Point-Of-Care Ultrasound Training For Clinical education in Malawi, Tanzania and Uganda,” Ultrasound Med. Biol, vol. 45, no. 6, pp. 1351–1357, 2019, doi:
[11] B. P. Nelson and A. Sanghvi, “Out of hospital point of care ultrasound: current use models and future directions,” Eur. J. Trauma Emerg. Surg., vol. 42, no. 2, pp. 139–150, 2016, doi:
[12] C. A. Gravel, M. C. Monuteaux, J. A. Levy, A. F. Miller, R. L. Vieira, and Richard G. Bachur, “Interrater reliability of pediatric point-of-care lung ultrasound findings,” Am. J. Emerg. Med., vol. 38, pp. 1–6, 2020, doi:
[13] J. R. Vieira et al., “Avaliação das linhas B pulmonares utilizando ultrassonografia à beira leito por diferentes médicas intensivistas: um estudo de confiabilidade,” Rev. Bras. Ter. intensiva, vol. 31, no. 3, pp. 354–360, 2019, doi:
[14] O. Peyrony et al., “Accuracy of Emergency Department clinical findings for diagnostic of coronavirus disease-2019,” Ann. Emerg. Med., 2020, doi:
[15] K. Yasukawa and T. Minami, “Point-of-Care Lung Ultrasound Findings in Patients with COVID-19 Pneumonia,” Am. J. Trop. Med. Hyg., vol. 102, no. 6, pp. 1198–1202, 2020, doi:
[16] D. Colombi et al., “Comparison of admission chest computed tomography and lung ultrasound performance for diagnosis of COVID-19 pneumonia in populations with different disease prevalence,” Eur. J. Radiol., vol. 133, no. 109344, p. 9, 2020, doi:
[17] B. P. Nelson and A. Sanghvi, “Point-of-Care Cardiac Ultrasound: Feasibility of Performance by Noncardiologists,” vol. 8, no. 4, pp. 293–297, 2013, doi:
[18] B. P. Lucas et al., “Credentialing of hospitalists in ultrasound-guided bedside procedures: A position statement of the society of hospital medicine,” J. Hosp. Med., vol. 13, no. 2, pp. 117–125, 2018, doi:
[19] R. B. Liu, J. H. Donroe, R. L. McNamara, H. P. Forman, and C. L. Moore, “The practice and implications of finding fluid during point-of-care ultrasonography: A review,” JAMA Internal Medicine, vol. 177, no. 12. pp. 1818–1825, 2017, doi:
[20] A. Bhagra, D. M. Tierney, H. Sekiguchi, and N. J. Soni, “Point-of-Care Ultrasonography for Primary Care Physicians and General Internists,” Mayo Clin. Proc., vol. 91, no. 12, pp. 1811–1827, 2016, doi:
[21] D. J. Schnobrich, B. K. Mathews, B. E. Trappey, B. K. Muthyala, and A. P. J. Olson, “Entrusting internal medicine residents to use point of care ultrasound: Towards improved assessment and supervision,” Med. Teach., vol. 40, no. 11, pp. 1130–1135, 2018, doi:
[22] D. J. Blehar, B. Barton, and R. J. Gaspari, “Learning Curves in Emergency Ultrasound Education,” Acad. Emerg. Med., vol. 22, no. 5, pp. 574–582, 2015, doi:
[23] The Royal College of Radiologists, Ultrasound training recommendations for medical and surgical specialties. 2015.
[24] D. J. Biau, S. M. Williams, M. M. Schlup, R. S. Nizard, and R. Porcher, “Quantitative and individualized assessment of the learning curve using LC-CUSUM,” Br. J. Surg., vol. 95, no. 7, pp. 925–929, 2008, doi:
[25] T. Todsen et al., “Reliable and valid assessment of point-of-care ultrasonography,” Ann. Surg., vol. 261, no. 2, pp. 309–315, 2015, doi:
[26] J. Chenkin, C. J. L. McCartney, T. Jelic, M. Romano, C. Heslop, and G. Bandiera, “Defining the learning curve of point-of-care ultrasound for confirming endotracheal tube placement by emergency physicians,” Crit. Ultrasound J., vol. 7, no. 1, 2015, doi:
[27] S. Di Pietro, F. Falaschi, A. Bruno, T. Perrone, V. Musella, and S. Perlini, “The learning curve of sonographic inferior vena cava evaluation by novice medical students: the Pavia experience,” J. Ultrasound, vol. 21, no. 2, pp. 137–144, 2018, doi:
[28] N. T. Townsend, J. Kendall, C. Barnett, and T. Robinson, “An effective curriculum for focused assessment diagnostic echocardiography: Establishing the learning curve in surgical residents,” J. Surg. Educ., vol. 73, no. 2, pp. 190–196, 2016, doi:
[29] T. Bonnafy et al., “Reliability of the measurement of the abdominal aortic diameter by novice operators using a pocket-sized ultrasound system,” Arch. Cardiovasc. Dis., vol. 106, no. 12, pp. 644–650, 2013, doi:
[30] B. Bataille et al., “Integrated Use of Bedside Lung Ultrasound and Echocardiography in Acute Respiratory Failure: A Prospective Observational Study in ICU,” Chest, vol. 146, no. 6, pp. 1586–1593, 2014, doi:
[31] P. Pirompanich and S. Romsaiyut, “Use of diaphragm thickening fraction combined with rapid shallow breathing index for predicting success of weaning from mechanical ventilator in medical patients,” J. Intensive Care, vol. 6, no. 1, pp. 1–7, 2018, doi:
[32] S. J. Millington et al., “The Assessment of Competency in Thoracic Sonography (ACTS) scale: validation of a tool for point-of-care ultrasound,” Crit. Ultrasound J., vol. 9, no. 1, 2017, doi:
[33] C. Arzola, J. C. A. Carvalho, J. Cubillos, X. Y. Ye, and A. Perlas, “Anesthesiologists’ learning curves for bedside qualitative ultrasound assessment of gastric content: A cohort study,” Can. J. Anesth., vol. 60, no. 8, pp. 771–779, 2013, doi:
[34] K. F. Oliveira, C. Arzola, X. Y. Ye, J. Clivatti, N. Siddiqui, and K. E. You-Ten, “Determining the amount of training needed for competency of anesthesia trainees in ultrasonographic identification of the cricothyroid membrane,” BMC Anesthesiol., vol. 17, no. 1, pp. 1–7, 2017, doi:
[35] M. Gómez Betancourt, J. Moreno-Montoya, A.-M. Barragán González, J. C. Ovalle, and Y. F. Bustos Martínez, “Learning process and improvement of point-of-care ultrasound technique for subxiphoid visualization of the inferior vena cava,” Crit. Ultrasound J., vol. 8, no. 1, p. 4, 2016, doi:
[36] D. J. Biau and R. Porcher, “A method for monitoring a process from an out of control to an in control state: Application to the learning curve,” Stat. Med., vol. 29, no. 18, pp. 1900–1909, 2010, doi:
[37] R. Papanna, D. J. Biau, L. K. Mann, A. Johnson, and K. J. Moise, “Use of the Learning CurveCumulative Summation test for quantitative and individualized assessment of competency of a surgical procedure in obstetrics and gynecology: Fetoscopic laser ablation as a model,” Am. J. Obstet. Gynecol., vol. 204, no. 3, 2011, doi:
[38] M. R. Reynolds and Z. G. Stoumbos, “A general approach to modeling CUSUM charts for a proportion,” IIE Trans. (Institute Ind. Eng., vol. 32, no. 6, pp. 515–535, 2000, doi:
[39] W. H. Woodall, G. Rakovich, and S. H. Steiner, “An overview and critique of the use of cumulative sum methods with surgical learning curve data,” Stat. Med., no. November, pp. 1–14, 2020, doi:
[40] D. A. Lichtenstein and G. A. Mezière, “The BLUE-points: Three standardized points used in the BLUE-protocol for ultrasound assessment of the lung in acute respiratory failure,” Crit. Ultrasound J., vol. 3, no. 2, pp. 109–110, 2011, doi:
[41] P. A. Harris, R. Taylor, R. Thielke, J. Payne, N. Gonzalez, and J. G. Conde, “Research electronic data capture (REDCap)-A metadata-driven methodology and workflow process for providing translational research informatics support,” J. Biomed. Inform., vol. 42, no. 2, pp. 377–381, 2009, doi:
[42] P. A. Harris et al., “The REDCap consortium: Building an international community of software platform partners,” Journal of Biomedical Informatics. 2019, doi:
[43] M. V. Pusic, K. Boutis, R. Hatala, and D. A. Cook, “Learning Curves in Health Professions Education,” Acad. Med., vol. 90, no. 8, pp. 1034–1042, 2015, doi:
[44] L. W. T. Schuwirth and C. P. M. Van Der Vleuten, “Programmatic assessment: From assessment of learning to assessment for learning,” Med. Teach., vol. 33, no. 6, pp. 478–485, 2011, doi:
How to Cite
Usaquén-Perilla, S. P., Ropero-Rojas, D., Mosquera-Restrepo, J., Kirsch, J. D., Kaltenborn, Z. P., García-Melo, J. I., & Osorio-Amaya, L. E. (2023). Control charts to establish and monitor proficiency in the detection of pulmonary B-lines with Point of Care Ultrasound. Ingenieria Y Universidad, 27.
Bioengineering and chemical engineering