Recap, Review, and High Performers
The 2020 AAMD Plan Study was a great success! The meeting was virtual this year, so the cloud-based ProKnow software fit perfectly well and allowed international participation. Over 300 people registered, and over 140 submitted valid, composite plans in the allotted time.
This year’s clinical planning and presentation team was led by dosimetrists Chavanon Apinorasethkul, CMD, and Kalin Shipman, CMD. They provided the anonymized planning images and anatomical structure set. They also led the design of the metrics and plan scorecard, which featured a total of 24 metrics studied (20 of which were scored; 4 others collected for added analysis) for a total of 150 points.
The featured plan was a base of skull chordoma. Participants were to design and submit a sequential plan prescribed to a total of 77.4 Gy and made up of two fraction groups: 54 Gy in 30 fractions followed by 23.4 Gy in 13 fractions. Participants used a dedicated ProKnow domain (https://aamd.proknow.com), where they could upload their plan(s) and dose(s), sum them to create a composite plan (if necessary), render their scorecard, and iterate until they were happy with their performance. Scores were kept blind (i.e., participants could only see their own plan and score) up until the AAMD presentation which took place on July 6, 2020. (Note: Visit the AAMD website to get access to their presentation.)
The scorecard’s metrics and objectives were based on current clinical goals for this type of treatment without extra challenges for target coverage objectives or ALARA scoring for organs-at-risk. As a result, an impressive number of participants met every highest objective over all metrics to achieve perfect scores of 150 out of 150.
A list of “High Performers” was defined as any/all users who scored in one of the “top three bins” in terms of overall plan score histogram (in this case, that means a score greater than 137.50 out of 150). Please see the “High Performers Summary” section, below.
We used a dedicated ProKnow “big data” repository and analytics domain for this study rather than the conventional Plan Study quality system technology. This offers some nice advantages:
- Participants were able to sum their dose grids here to get their composite plan/score, when applicable.
- This domain allows retrospective analysis and interactive visualization of each and every anonymized submission.
- This domain also allows full navigation of population scorecards, histograms/variation per metric, and scatterplots/correlation for any pair of the derived or numeric custom metrics.
To study and analyze the results yourself, simply sign in to the domain, then use the many population analysis tools and of course the plan-by-plan analysis tools. The domain has been set to “read-only” mode, so you will not be able to edit contours, metrics, or scorecards, or upload any new data, but you can survey the plan submissions one-by-one or as a population.
Note: If you did not participate but would like to inspect and navigate the plans, doses, DVHs, scorecards, and population results, you can submit a request to Elekta/ProKnow team members at firstname.lastname@example.org.
Figure 1. This is a histogram of the composite scores for the final valid, submitted plans. You can separate these by modality, TPS, or radiation type. You can also click on any bin to see all the plans whose metric fell in that bin. This goes for any derived or custom metric.
Figure 2. Here is a snapshot of the plan scorecard extracted across the whole population of submitted plans. The variation of each metric’s result is shown as a box plot atop the scoring objectives. Any row can be selected (double-clicked) for drill-down analysis of the underlying data.
Figure 3. Condensed boxplot view of all plan scores filtered by modality.
High Performers Summary
Congratulations to all participants, and especially to the following individuals who scored in one of the top performance bins of this plan study.
Table 1. The following users scored in the “top three bins” in terms of total plan score. For the cohort of users who scored 150, the order in the table is set simply by alphabetical order based on first name.
|150.00||Alberto Adrada||Clinica de occidente||Colombia||VMAT||Eclipse|
|150.00||Chun Long Lee||St. Teresa’s Hopsital||Hong Kong||VMAT||Eclipse|
|150.00||Dalibor Lojko||Nemocnica Komarno||Slovakia||IMRT (Dynamic)||Eclipse|
|150.00||Daniel Sullivan||Grand Valley State||USA||VMAT||Eclipse|
|150.00||David Littlejohn||Varian Medical Systems||USA||VMAT||Eclipse|
|150.00||David Stewart||Prince of Wales Hospital||Australia||VMAT||RayStation|
|150.00||Drew Granatowicz||Nebraska Medicine||USA||VMAT||Eclipse|
|150.00||Friedemann Herberth||Kantonsspital St.Gallen||Switzerland||VMAT||Eclipse|
|150.00||Gary Ka Yu Tso||St. Teresa’s Hospital||Hong Kong||VMAT||Eclipse|
|150.00||Igor Prokofev||European medical center||Moscow||VMAT||Eclipse|
|150.00||James Henry||Willis Knighton Cancer Center||USA||VMAT||RayStation|
|150.00||Julien Rolland||Institut Paoli Calmettes & CHICAS||France||VMAT||RayStation|
|150.00||Li Kai Leung||St Teresa’s Hospital||Hong Kong||VMAT||Eclipse|
|150.00||Luke Mackowiak||Mountain States Medical Physics||USA||VMAT||Eclipse|
|150.00||Madison Newkirk||University of Arkansas||USA||VMAT||Eclipse|
|150.00||Mark Arends||RIF||The Netherlands||VMAT||RayStation|
|150.00||Nicolas Depauw||Massachusetts General Hospital||USA||Protons||Astroid|
|150.00||Perumal Murugan||Sri Shankara Cancer Hospital||India||VMAT||Eclipse|
|150.00||Peter Treon||Rhode Island Hospital||USA||VMAT||RayStation|
|150.00||Richard Shores||Prisma Health – GHS||USA||VMAT||Eclipse|
|150.00||Scott Senick||Varian Medical Systems||USA||VMAT||Eclipse|
|150.00||Simon Heinze||Kantonsspital St.Gallen||Switzerland||VMAT||Eclipse|
|150.00||Siva Kumar||Sri Shankara Cancer Hospital||India||VMAT||Eclipse|
|150.00||Thomas Costantino, Frank Simac, Bruce Phillip||21st Century Oncology||USA||IMRT (Dynamic)||Eclipse|
|150.00||Yik Shing Cheung||Hong King St. Teresa Hospital||Hong Kong||VMAT||Eclipse|
|149.97||Irina Fotina||IBA Dosimetry||Germany||VMAT||Monaco|
|149.97||Xuanfeng Ding||Beaumont Proton Therapy Center||USA||Protons||RayStation|
|149.88||Sut I Chim||St. Teresa Hospital||Hong Kong||VMAT||Eclipse|
|149.84||Gajendran N||Regency Hospital Ltd||India||VMAT||Eclipse|
|149.78||Tomas Prochazka||Masaryk Memorial Cancer Institute||Czech Republic||VMAT||Eclipse|
|149.75||Michael Mast||Community Howard Regional Health||USA||VMAT||Eclipse|
|149.69||Kazuyuki Uehara||Kobe Minimally Invasive Cancer Center||Japan||VMAT||Eclipse|
|149.62||Matthew Thomas||Emory Healthcare||USA||VMAT||Eclipse|
|149.27||Mahmoud Al Fishawy||International Medical Center||Egypt||VMAT||Eclipse|
|149.04||Alejandro Rincones||Instituto del Cancer SOLCA Cuenca||Ecuador||VMAT||Eclipse|
|148.83||Murali Govindaraj||Kailash Cancer Hospital||India||VMAT||Eclipse|
|148.76||Kirby DeLozier||Moffitt Cancer Center||USA||VMAT||Pinnacle|
|148.39||Juan Perez||Quironsalud Protontherapy Center||Spain||Protons||RayStation|
|148.37||Justin Miller||Moffitt Cancer Center||USA||VMAT||Pinnacle|
|148.02||Warwick Mok||HKSH||Hong Kong||Helical Arc||TomoTherapy|
|147.78||Aurelie Sors||Oncorad Garonne montauban||France||VMAT||Eclipse|
|147.54||Mark Bowers||Moffitt Cancer Center||USA||VMAT||Pinnacle|
|147.47||Jessica Caselli||Northside Hospital||USA||VMAT||Eclipse|
|147.32||Christopher Amaloo||Conehealth Cancer Center||USA||VMAT||Eclipse|
|147.32||Lev Haim||Assuta ashdod hospital||Israel||VMAT||Eclipse|
|146.79||Timothy Hancock||Kantonsspital Aarau||Switzerland||VMAT||Eclipse|
|146.73||Hisato Nagano||Shonan Fujisawa Tokushukai Hp.||Japan||VMAT||RayStation|
|146.62||Lai mun Yap||Beacon hospital||Malaysia||VMAT||Eclipse|
|145.99||Paolo Ferrari||Azienda Sanitaria dell’Alto Adige – Bolzano||Italia||VMAT||RayStation|
|145.86||Barry Melancon||Ochsner Health||USA||VMAT||Eclipse|
|145.80||Tyler Williamson||MD Anderson Proton Therapy Center||USA||VMAT||RayStation|
|145.28||C P Bhatt||Sarvoday Hospital Faridabad Inida||India||VMAT||Monaco|
|144.94||Bruce Ha||Peter MacCallum Cancer CEentre||Australia||VMAT||Eclipse|
|143.98||Kevin Greco||Moffitt Cancer Center||USA||VMAT||RayStation|
|143.31||Laertes Papaspyrou||Philips Healthcare||Greece||Protons||Pinnacle|
|142.67||Eugene Holdman||Alexandrov National Cancer Center||Belarus||IMRT (Dynamic)||Eclipse|
|142.06||Sergei Rusetckii||LLC Medscan||Russia||VMAT||Eclipse|
|142.05||Philip Bowen||Agnesian Cancer Center/SSM||USA||VMAT||Pinnacle|
|140.82||Bradley Dubois||Goshen Center For Cancer Care||USA||VMAT||Eclipse|
|140.77||Morgan Griffin||Hartford Healthcare||USA||VMAT||Eclipse|
|140.44||Kadishe Balazi||OSF Saint Francis Medical Center||USA||VMAT||Eclipse|
|140.06||Sarah Johnson||Cincinnati Childrens/UC Health Proton Center||USA||Protons||Eclipse|
|139.72||Chung Yin Mak||St Teresa’s hospital||Hong Kong||VMAT||Eclipse|
|139.39||Matev Mleku||Institute of Oncology Ljubljana||Slovenia||VMAT||Monaco|
|139.25||Nadine Hong||Austin Health||Australia||VMAT||Monaco|
|139.09||Ellen Kurdzo||Hartford Hospital||USA||VMAT||Eclipse|
|138.63||Luis Fernando Paredes Ocampo||Clinica de Occidente||Colombia||VMAT||Eclipse|
|138.49||Ashley Chackalayil||Northside Hospital||USA||VMAT||Eclipse|
|138.06||Maia Topeshashvili||Research Institute of Clinical Medicine||Georgia||VMAT||Eclipse|