A systematic review about costing methodology in robotic surgery: evidence for low quality in most of the studies
Health Economics Review volume 8, Article number: 21 (2018)
The main objective of this review was to evaluate the methodological design in studies reporting resource use and costs related to robotic surgery in gynecology.
Systematic searches were performed in the databases PubMed, Embase, Scopus, and The Centre for Reviews and Dissemination database for relevant studies before May 2016. The quality of the methodological design was assessed with items regarding methodology from the Consolidated Health Economic Evaluation Reporting Standards (CHEERS). The systematic review was reported according to the PRISMA guidelines.
Thirty-two relevant studies were included. None of the reviewed studied fully complied with the CHEERS methodological checklist. Background and objectives, Target population and subgroups and Setting and location were covered in sufficient details in all studies whereas the Study perspective, Justification of the time horizon, Discount rate, and Estimating resources and costs were covered in less than 50%. Most of the studies (29/32) used the health care sector perspective whereas the societal perspective was applied in three studies. The time horizon was stated in 18/32 of the studies.
The methodological quality of studies evaluating costs of robotic surgery was low. The longest follow-up was 4 months and in general, the use of detailed cost data were lacking in most of the investigations. Key determinants, such as purchasing, maintenance costs of the robotic platform, and the use of surgical equipment, were rarely reported. If health care cost analyses lack transparency regarding cost drivers included it may not provide a true foundation for decision-making.
Previous systematic reviews comparing the cost-effectiveness of Robotic Minimally Invasive Surgery (RMIS) with other surgical modalities found higher costs associated with RMIS. However, the conclusions were based on limited evidence due to heterogeneity in study designs, methodology, and time follow-up after surgery [1,2,3,4]. In a recent review, key determinants causing higher costs of RMIS compared to open- and laparoscopic surgery were purchase and maintenance cost of the robot, surgical equipment, and additional costs related to longer operation time. The costs were, to a lesser extent, affected by the lifespan of the robotic platform and the annual number of robotic procedures .
The guiding principle for cost analysis is to identify the “opportunity costs”, defined as the value of the next best option . Cost analyses are context specific and often limited by the availability of data. Lack of adherence to guiding principles and standards decreases transparency and quality of cost analyses  which may lead to wrong conclusions and decisions based on an insufficient foundation.
The aim of the present systematic review was to evaluate the methodological design employed in studies of resource use and costs related to RMIS within gynecology. We furthermore assed if the reporting quality complied with the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement . Hence, the focus was not to evaluate the cost of RMIS compared with other surgical modalities, but primarily to evaluate different methodological choices that may influence the validity of cost analyses.
The systematic review was reported according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines .
We included randomized controlled trials, prospective and retrospective cohorts, and case-control studies comparing the cost of hysterectomy conducted with RMIS versus laparoscopic, open, and vaginal access.
A systematic search was performed in the databases PubMed, EMBASE, Scopus, and The Centre for Reviews and Dissemination (CRD) database for relevant studies before May 2016 with assistance of a librarian. No language or date limits were imposed in the search. MK developed the PubMed search strategy with input from JS and PTJ. After the PubMed strategy was made, it was adapted to the syntax and subject headings of the other databases. Reference lists of included studies were examined for additional references .
Two authors (MK and KK) independently screened the titles and abstracts and obtained full text of all studies for the reviewing in Covidence . Covidence is a component of Cochrane’s review production, a web-based systematic review tool designed to facilitate the process of screening and enables two reviewers to work efficiently through the steps of a systematic review . The same two authors examined the full text articles and selected studies according to the inclusion criteria. Any inconsistency in the identification of potentially relevant papers was discussed until consensus.
Data collection process
The CHEERS recommendations attempt to optimize reporting of health economic evaluations and consist of 24 items. We selected eight items from the CHEERS recommendations which were specifically related to the methodological design and assessed important for the reporting of costs . The methodological Items included: 1) Background and objectives, 2) Target population and subgroups, 3) Setting and location, 4) Study perspective, 5) Comparators, 6) Time horizon, 7) Discount rate, 8) Estimating resources and costs. Further, we included items related to cost aspects associated to the robotic platform. The chosen items were translated into 12 questions, against which each study was assessed and marked either “yes”, “partly”, and “not available” and specification of the time follow-up after surgery (Table 1). MK and KK evaluated the quality of the methodological design in all studies independently . The same authors examined their findings and any disagreement was discussed until consensus.
We identified 763 references of which 32 met the inclusion criteria. The search, screening and exclusions are given in Fig. 1.
The cost studies (Table 2) were published from 2008 to 2016 and originated from the U.S. (n = 21), Europe (n = 9), and Canada (n = 2). In three studies, the cost analyses were conducted within the framework of a cost-minimization analysis [11, 12], one study used a cost-benefit framework  and one study used activity based costing . The remaining studies reported on costing analyses.
Results of individual studies
A visual presentation of the CHEERS criteria and the ranking of the quality assessment are shown in Table 3. All 12 questions from the CHEERS recommendations were marked either “yes”, “partly”, and “not available” for each study. A “yes” was given 1 point, “partly” a ½ point and “not available” none points.
None of the studies reported all 12 questions; one study (3%) was given 9.5 point , six studies (18.8%) 8–8.5 points [14, 16,17,18,19,20], three studies (9.4%) 7.5 point [12, 21, 22], three studies (9.4%) 6–6.5 points [23,24,25], fourteen studies (43.8%) 5–5.5 points [9, 26,27,28,29,30,31,32,33,34,35,36,37] and five studies (12.5%) 4.5 point [13, 38,39,40,41].
Results from the 12 questions
“Background and objectives”, “Target population and subgroups” and “Setting and location” were described in all studies. Comparators were partly described in most studies (30/32) but were fully reported in two studies only. The study perspective was clearly stated in seven studies but was not mentioned in 23 studies and only partly mentioned in two studies. Most of the studies (n = 29) used the health care sector perspective whereas the societal perspective was applied in three studies only [24, 35, 37]. The societal perspective included return to work/normal daily activity and estimated lost wages [24, 35, 37]. The time horizon was stated in 18/32 studies but none provided a reason for their choice of time horizon. Most studies reported from the inpatient stay (n = 6) and the time horizon ranged from inpatient stay to 4 months after discharge. One study measured the cancer recurrence rate 2 years after surgery but did not report the cost of the recurrence .
Seven studies estimated Resources and costs by micro-costing (collection of detailed data on resources used to assess costs of an activity) reporting detailed data from a single hospital. The majority of cost items derived from surgery and included the purchase and maintenance costs of the robotic platform with depreciation and yearly number of procedures [14,15,16,17,18,19, 22]. One of the seven studies combined micro-costing with gross-costing using hospital charge data but did not include detailed data on resource use . The discount rate was not reported in any of the studies due to the short time horizon applied. The depreciation period of the robotic lifespan ranged from five to 10 years in 8/32 of the studies and [12, 14,15,16, 18, 19, 22, 37] 7 years was most frequently used (n = 5). The number of annual robotic procedures ranged from 234 to 400 and was reported in five studies [12, 14, 16,17,18]. The service agreement costs of 10% of the purchasing prize of the robot were reported in five studies only [12, 15, 19, 22, 37].
From the index hospitalization Equipment costs were the most common included cost items reported from the operation (n = 18) and the exact numbers of operation equipment costs were reported in six studies [9, 12, 14, 16, 17, 42]. Other costs included: costs of the operating room (n = 18), room and board (costs of regular room and any intensive care unit stay) (n = 14), other cost categories (e.g. pathology, laboratory, central supply, pharmacy, and infusion) (n = 14), operation time and costs of anesthesia (n = 13). Less frequently included costs were cleaning and sterilizing equipment (n = 4). Other reported costs not related to the index hospitalization were costs of the patient being morbidly obese and insurance coverage (n = 3). An overview of reported costs is presented in Fig. 2.
Our study showed that only few cost studies complied with the methodological items recommended by the CHEERS checklist. We identified critical design issues.. Ideally, a broader cost perspective is recommended to clarify resource use from hospitalization and outside the healthcare system. The time horizon should include resource consumption and costs following the intervention e.g. include rehabilitation.
Only few studies [11, 37, 43] included the societal perspective thus avoiding potentially important cost elements such as estimated costs related to the use of patient time e.g. return to labor market, transportation, and costs from the non-health care sector. Collecting costs from the hospital perspective, only short-term cost implications are considered. When the loss of productivity or other patient related use outside the hospital is not included; additional costs or savings of the surgical procedure will not be elucidated. The societal perspective includes both short- and long-term outcomes. If costs outside the hospital are not included, investments with high purchasing costs may seem less attractive.
The time horizon was reported in a few studies and most often costs from the inpatient stay and up to 4 months after surgery was given. With a short follow-up time after surgery cost drivers as rehabilitation and return to work are missing and all costs and effects from surgery are therefore not displayed [3, 44, 45].
Most of the studies used gross-costing based on data from records, chart reviews, or databases. However, when comparing RMIS with other surgical procedures, gross-costing lacks specificity and primarily defines a total budget instead of detailed data. In a pragmatic world, micro-costing is possible from a single hospital, whereas gross-costing data may be the only available data suitable to perform large-scale analyses. Micro-costing is desirable but may be very costly and time consuming to collect. If health care cost analyses have omitted clarity of which cost items they have included it may have a great impact on the transparency and hence the conclusions being used for decision making. Costs of operative procedures should be transparent and state which cost drivers are included and whether indirect costs such as cleaning and staff salary are included in the calculation. It may be difficult to rank the most important cost items in cost studies depending of the aim and data available. One of the most crucial cost items is the purchasing and maintenance costs of the robotic platform. This will affect the result and should be very clearly stated. The operation time may seem as an important cost item, where the exact time can influence the overall costs. When using charges, the overall costs are often based on an average of utensils, staff salary and operation time etc. for the specific operation and it is not possible to measure the smaller variations in time consumption. Even though robotic operations have shorter length of stay compared to open surgery, the taxes may seem unaffected. Hospitals are paid a fixed price for each patient treated.
The purchase of the robotic platform and the maintenance costs were rarely included although they represent an important opportunity costs and have a potential to display major impact on the cost analyses. An increased number of operations per year will decrease the cost per operation [2, 3] but only a few studies included the number of annual procedures or procedures performed per robotic platform. Of notice, Reynisson, P. et al. reported twice as high in-patient charge compared to other studies due to a minor depreciation time of the robot and a decreased number of yearly operations . They also reported investment and equipment costs to be lower in North America than in Europe which should be taken into account when comparing the costs between countries .
Staff salaries may represent the most expensive cost driver when estimating the total costs. Only one study included staff salaries as a transparent cost estimation, dividing the time spent on the operation by the hourly wage . A study by Lonnerfors, C. et al. defined major cost drivers influencing the hospital costs as duration of operating time and length of inpatient stay . The majority of the studies did not report key cost items thus decreasing the generalizability.
Hospital charges based on what a health care provider bills for the service may be easily obtained from databases. However, hospital charges do not reflect the actual expenses; rather they represent local estimations of costs related to specific procedures. There can be great variations in the charges due to either over- or underestimation of the actual costs of hospital care, time variation, or variation in profit [32, 46]. Hence, use of the charging system may be inappropriate and prevent comparisons across countries or institutions due to variations in organizational structures, range of health care facilities, and different budgets.
Several studies have documented that great expertise with RMIS improves the surgical outcome in terms of decreased operation time, shorter length of stay and a decrease in readmissions [18, 26, 34, 38]. Many of the studies mentioned the importance of the learning curve of RMIS but did not adjust for it in the analysis. Laursen et al. examined the costs of RMIS in 7670 women over a period of 7 years showing costs to depend on the learning curve of RMIS . Hence, although difficult to account for, the learning curve may represent an important cost driver.
Inadequate reporting of the study perspective, short time horizon, and use of charge data decreased the methodological quality in studies of resource use and costs related to RMIS within gynecology. Few studies complied with the methodological items in the CHEERS checklist and the methodological quality was generally assessed low. If the results lack transparency of included cost elements it can lead to incorrect incentives for decision makers leading to inefficient allocation of hospital resources.
Pynna K, Vuorela P, Lodenius L, Paavonen J, Roine RP, Rasanen P. Cost-effectiveness of hysterectomy for benign gynecological conditions: a systematic review. Acta Obstet Gynecol Scand. 2014;93(3):225–32.
Tandogdu Z, Vale L, Fraser C, Ramsay C. A systematic review of economic evaluations of the use of robotic assisted laparoscopy in surgery compared with open or laparoscopic surgery. Appl Health Econ Health Policy. 2015;13(5):457–67.
Iavazzo C, Papadopoulou EK, Gkegkes ID. Cost assessment of robotics in gynecologic surgery: a systematic review. J Obstet Gynaecol Res. 2014;40(11):2125–34.
Tapper AM, Hannola M, Zeitlin R, Isojarvi J, Sintonen H, Ikonen TS. A systematic review and cost analysis of robot-assisted hysterectomy in malignant and benign conditions. Eur J Obstet Gynecol Reprod Biol. 2014;177:1–10.
Fuertes-Guiro F, Girabent-Farres M, Viteri-Velasco E. Opportunity cost in the economic evaluation of da Vinci robotic assisted surgery. Eur J Health Econ. 2016;17(3):245–56.
Walker DG, Wilson RF, Sharma R, Bridges J, Niessen L, Bass EB, et al. AHRQ methods for effective health care. Best practices for conducting economic evaluations in health care: a systematic review of quality assessment tools. Rockville (MD): Agency for Healthcare Research and Quality (US); 2012.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS)--explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Health. 2013;16(2):231–50.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J Surg (London, England). 2010;8(5):336–41.
El Hachem L, Andikyan V, Mathews S, Friedman K, Poeran J, Shieh K, et al. Robotic Single- Site and Conventional Laparoscopic Surgery in Gynecology: Clinical Outcomes and Cost Analysis of a Matched Case-Control Study. 2016.
Cochrane Pw. Covidence https://www.covidence.org/about-us.
Shah NT, Wright KN, Jonsdottir GM, Jorgensen S, Einarsson JI, Muto MG. The feasibility of societal cost equivalence between robotic hysterectomy and alternate hysterectomy methods for endometrial Cancer. Obstet Gynecol Int. 2011;2011:570464.
Teljeur C, O'Neill M, Moran PS, Harrington P, Flattery M, Murphy L, et al. Economic evaluation of robot-assisted hysterectomy: a cost-minimisation analysis. BJOG. 2014;121(12):1546–53.
Coronado PJ, Herraiz MA, Magrina JF, Fasero M, Vidart JA. Comparison of perioperative outcomes and cost of robotic-assisted laparoscopy, laparoscopy and laparotomy for endometrial cancer. Eur J Obstet Gynecol Reprod Biol. 2012;165(2):289–94.
Herling SF, Palle C, Moller AM, Thomsen T, Sorensen J. Cost-analysis of robotic-assisted laparoscopic hysterectomy versus total abdominal hysterectomy for women with endometrial cancer and atypical complex hyperplasia. Acta Obstet Gynecol Scand. 2016;95(3):299–308.
Desille-Gbaguidi H, Hebert T, Paternotte-Villemagne J, Gaborit C, Rush E, Body G. Overall care cost comparison between robotic and laparoscopic surgery for endometrial and cervical cancer. Eur J Obstet Gynecol Reprod Biol. 2013;171(2):348–52.
Eklind S, Lindfors A, Sjoli P, Dahm-Kahler P. A prospective, comparative study on robotic versus open-surgery hysterectomy and pelvic lymphadenectomy for endometrial carcinoma. Int J Gynecol Cancer. 2015;25(2):250–6.
Lonnerfors C, Reynisson P, Persson J. A randomized trial comparing vaginal and laparoscopic hysterectomy vs robot-assisted hysterectomy. J Minim Invasive Gynecol. 2015;22(1):78–86.
Reynisson P, Persson J. Hospital costs for robot-assisted laparoscopic radical hysterectomy and pelvic lymphadenectomy. Gynecol Oncol. 2013;130(1):95–9.
Lau S, Vaknin Z, Ramana-Kumar AV, Halliday D, Franco EL, Gotlieb WH. Outcomes and cost comparisons after introducing a robotics program for endometrial cancer surgery. Obstet Gynecol. 2012;119(4):717–24.
Winter ML, Leu SY, Lagrew DC Jr, Bustillo G. Cost comparison of robotic-assisted laparoscopic hysterectomy versus standard laparoscopic hysterectomy. J Robot Surg. 2015;9(4):269–75.
Scribner DR, Andre T, Lara-Torre E, Weiss PM. Cost analysis of robotic versus standard laparoscopic hysterectomies: a preliminary analysis. J Gynecol Surg. 2012;28(4):255–61.
Halliday D, Lau S, Vaknin Z, Deland C, Levental M, McNamara E, et al. Robotic radical hysterectomy: comparison of outcomes and cost. J Robot Surg. 2010;4(4):211–6.
Fader AN, Weise RM, Sinno AK, Tanner EJ, 3rd, Borah BJ, Moriarty JP, et al. Utilization of minimally invasive surgery in endometrial cancer Care: A quality and cost disparity. Obstet Gynecol. 2016;127(1):91–100.
Shah N, Wright K, Jonsdottir G, Jorgensen S, Einarrson J, Muto M. Comparing robotic hysterectomy with alternate operative strategies for endometrial cancer: a feasibility analysis of cost equivalence from the societal perspective. Gynecol Oncol. 2011;120:S125–S6.
Venkat P, Chen LM, Young-Lin N, Kiet TK, Young G, Amatori D, et al. An economic analysis of robotic versus laparoscopic surgery for endometrial cancer: costs, charges and reimbursements to hospitals and professionals. Gynecol Oncol. 2012;125(1):237–40.
Bogani G, Multinu F, Dowdy SC, Cliby WA, Wilson TO, Gostout BS, et al. Incorporating robotic-assisted surgery for endometrial cancer staging: analysis of morbidity and costs. Gynecol Oncol. 2016;141(2):218–24.
Brooks RA, Blansit K, Young-Lin N, Usach I, Chen LM, Yu X, et al. The economic impact of surgical care for morbidly obese endometrial cancer patients: a nationwide study. Am J Obstet Gynecol. 2016;214(4):498.
Chan JK, Gardner AB, Taylor K, Thompson CA, Blansit K, Yu X, et al. Robotic versus laparoscopic versus open surgery in morbidly obese endometrial cancer patients - a comparative analysis of total charges and complication rates. Gynecol Oncol. 2015;139(2):300–5.
Shepherd JP, Ahn K, Kantartzis KL, Bonidie MJ, Lee T. Minimizing hysterectomy costs transitioning from open to minimally invasive techniques. J Minim Invasive Gynecol. 2014;21(2 SUPPL. 1):S7–8.
Wright JD, Ananth CV, Tergas AI, Herzog TJ, Burke WM, Lewin SN, et al. An economic analysis of robotically assisted hysterectomy. Obstet Gynecol. 2014;123(5):1038–48.
Woelk JL, Borah BJ, Trabuco EC, Heien HC, Gebhart JB. Cost differences among robotic, vaginal, and abdominal hysterectomy. Obstet Gynecol. 2014;123(2 Pt 1):255–62.
Rosero EB, Kho KA, Joshi GP, Giesecke M, Schaffer JI. Comparison of robotic and laparoscopic hysterectomy for benign gynecologic disease. Obstet Gynecol. 2013;122(4):778–86.
Wright JD, Ananth CV, Lewin SN, Burke WM, Lu YS, Neugut AI, et al. Robotically assisted vs laparoscopic hysterectomy among women with benign gynecologic disease. JAMA. 2013;309(7):689–98.
Wright JD, Burke WM, Wilde ET, Lewin SN, Charles AS, Kim JH, et al. Comparative effectiveness of robotic versus laparoscopic hysterectomy for endometrial cancer. J Clin Oncol. 2012;30(8):783–91.
Jonsdottir GM, Jorgensen S, Cohen SL, Wright KN, Shah NT, Chavan N, et al. Increasing minimally invasive hysterectomy: effect on cost and complications. Obstet Gynecol. 2011;117(5):1142–9.
Pasic RP, Rizzo JA, Fang H, Ross S, Moore M, Gunnarsson C. Comparing robot-assisted with conventional laparoscopic hysterectomy: impact on cost and clinical outcomes. J Minim Invasive Gynecol. 2010;17(6):730–8.
Bell MC, Torgerson J, Seshadri-Kreaden U, Suttle AW, Hunt S. Comparison of outcomes and cost for endometrial cancer staging via traditional laparotomy, standard laparoscopy and robotic techniques. Gynecol Oncol. 2008;111(3):407–11.
Turunen H, Pakarinen P, Sjöberg J, Loukovaara M. Laparoscopic vs robotic-assisted surgery for endometrial carcinoma in a Centre with long laparoscopic experience. J Obstet Gynaecol. 2013;33(7):720–4.
Yu X, Lum D, Kiet TK, Fuh KC, Orr J, Jr., Brooks RA, et al. Utilization of and charges for robotic versus laparoscopic versus open surgery for endometrial cancer. J Surg Oncol. 2013;107(6):653–8.
Holtz DO, Miroshnichenko G, Finnegan MO, Chernick M, Dunton CJ. Endometrial cancer surgery costs: robot vs laparoscopy. J Minim Invasive Gynecol. 2010;17(4):500–3.
Sarlos D, Kots L, Stevanovic N, Schaer G. Robotic hysterectomy versus conventional laparoscopic hysterectomy: outcome and cost analyses of a matched case-control study. Eur J Obstet Gynecol Reprod Biol. 2010;150(1):92–6.
Lee T, Shepherd JP, Kantartzis KL, Ahn KH, Bonidie MJ. Cost analysis when open surgeons perform minimally invasive hysterectomy. J Soc Laparoendosc Surg. 2014;18(4)
Jonsdottir G, Jorgensen S, Cohen S, Wright K, Shah N, Chavan N, et al. Increasing minimally invasive hysterectomy. Effects on cost and complications. Acta Obstet Gynecol Scand. 2012;91:14.
Liu H, Lawrie TA, Lu D, Song H, Wang L, Shi G. Robot-assisted surgery in gynaecology. The Cochrane database of systematic reviews. 2014;(12):Cd011422.
Gala RB, Margulies R, Steinberg A, Murphy M, Lukban J, Jeppson P, et al. Systematic review of robotic surgery in gynecology: robotic techniques compared with laparoscopy and laparotomy. J Minim Invasive Gynecol. 2014;21(3):353–61.
Swan K, Advincula AP. Understanding the financial impact of robotics in gynecologic surgery. Clin Obstet Gynecol. 2011;54(3):449–57.
Laursen KR, Hyldgard VB, Jensen PT, Sogaard R. Health care cost consequences of using robot technology for hysterectomy: a register-based study of consecutive patients during 2006- 2013. J Robot Surg. 2017.
The author acknowledges Herdis Foverskov, The Medical Research Library at Odense University Hospital for competent advice in systematic search strategies. We would like to thank Asbjørn Hrobjartsson, Centre for Evidence-Based Medicine Odense (CEBMO), Odense University Hospital, Odense, Denmark for competent advice regarding the methodology in systematic reviews.
Availability of data and materials
All data was obtained from through systematic literature searches in included databases.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Korsholm, M., Sørensen, J., Mogensen, O. et al. A systematic review about costing methodology in robotic surgery: evidence for low quality in most of the studies. Health Econ Rev 8, 21 (2018). https://doi.org/10.1186/s13561-018-0207-5