‘Taking a calculated risk’- Is American College of Surgeon’s National Surgical Quality Improvement Program universal risk calculator a valuable tool to improve quality of surgical services in Indian surgical scenario?
DOI:
https://doi.org/10.18203/2349-2902.isj20204673Keywords:
American college of surgeon’s national surgical quality improvement program, Surgical risk calculator, Universal risk calculatorAbstract
Background: American College of Surgeon’s National Surgical Quality Improvement Program (ACS NSQIP) risk calculator is a valuable tool exercised in the hospitals across the USA for predicting risk rates for 8 post-operative complications till the 30th post-operative day, taking into account 21 risk factors. Its applicability in the surgical practice in India has not been popular. This study explores, if this model is accurate in predicting risk of post-operative complications in surgical patients in India.
Methods: Retrospective study done on 368 patients who underwent elective and emergency surgical procedures in a medical college hospital. Demographic data, contemplated surgery, co-morbid factors entered into the risk calculator and predicted personal risk calculated and compared to average risk. Post-operative progress reports retrieved. Complications till 30th post op day compared with the predicted risk estimates. Brier score, sensitivity and specificity, PPV/NPV, z and p values calculated for the probabilistic, predictive values of the model for validation.
Results: Emergency procedures done in 143 and elective in 225. 67 developed major, 35 minor, 11 fatal complications. The average Brier score was 0.00324. Mean sensitivity was 96.08 %, specificity 98.94%. Mean PPV 82.6%, NPV 99.6%. The predictions were inaccurate for serious, “any” complications, discharge to nursing and rehabilitative facility, the colectomy ileus and length of stay. The percentage of error ranged from 2.22 to 25.
Conclusions: Overall, the ACS NSQIP surgical risk calculator very fairly predicted the complications till the 30th post-operative day which naturally matched with actual complications that were seen.
References
Golden DL, Ata A, Kusupati V, Jenkel T, Khakoo NS, Taguma K, et al. Predicting Postoperative Complications after Acute Care Surgery: How Accurate is the ACS NSQIP Surgical Risk Calculator. The American Surgeon. 2019;85(4): 335-41.
Scotton G, Del Zotto G, Bernardi L, Zucca A, Terranova S, Fracon S, et al. Is the American College of Surgeons NSQIP Risk Calculator Accurate in Predicting Adverse Postoperative Outcomes in the Emergency Setting? An Italian Single-Center Study. J Ameri Coll Surg. 2019;229(4):S100.
Subramaniam N, Balasubramanian D, Pradeep RK, Murthy S, Rathod P, Vidhyadharan S, et al. ACSNSQIP Risk Calculator in Indian Patients Undergoing Surgery for Head and Neck Cancers: Is It Valid? Indian J Surg Oncol. 2018;9(2):122-5.
American College of Surgeons. ACS NSQIP Surgical risk calculator, 2014. Available at http://www.riskcalculator.facs.org. Accessed on 16 December 2019.
Abelson JS, Yeo HL, Pomp A, Fehling D, Michelassi F. Using the ACS NSQIP Surgical Risk Calculator for surgical education and quality improvement. Bull Am Coll Surg. 2016;101:29-31.
About ACS NSQIP: American College of Surgeons. ACS NSQIP Surgical risk calculator, 2014. Available at https://www.facs.org/quality-programs/acs-nsqip/about. Accessed on 16 August 2020.
Karl Y Bilimoria, Yaoming Liu, Jennifer L Paruch, Lynn Zhou, Thomas E Kmiecik, et al. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg. 2013;217(5):833-42
Mark E. Cohen, Yaoming Liu, Clifford Y. Ko. An Examination of ACS NSQIP Surgical Risk Calculator Accuracy. Journal of American Coll of Surgeons. 2017;224:787-95
El-Ghobashy A, Aggarwal A, Ijaz S. EP1202 The SORT and ACS-NSQIP scores in assessing the surgical outcome of gynaecological oncology patients; performance comparison. International J of Gynaecologic Cancer. 2019;29:618-9.
