Sign in to the applicationSign in

Methods

Results

Methods · Results

How the figures of a report are put together and qualified: the scope of a study, the checks before publishing, the spread between procedures, costs, the quality of the data and the uncertainty. The figures on this page come from the reports of two fictitious demonstration studies.

In short

Methods of ClinImpact 2.21. Reports name the version they were computed with; the changelog says what changed.

Contents

Procedure studies and component studies#

A project has a scope. A procedure study is the default and the model every other section of the methods describes. Procedures are recorded one by one, the total is the sum over them, and the per-procedure figure is their mean. No report can be published before one is recorded.

A component study is a project with no procedures at all, in which materials, anaesthesia or sterilisation are studied on their own, or one product's footprint. Its functional unit is one use of its template: what is entered on the project is counted once, and every figure is "per use". The database refuses procedures on a component study and refuses to turn a project with procedures into one.

A component study is compared only with other component studies. It is left out of a subject's pooled averages and of a subject's comparison, which stay clinical. Its published report, the Standard report and the exports name the unit. The two kinds are never divided by the same thing, so they are never put on one axis.

A project can carry a study scope statement in the study team's words, and a partial scope mark. A partial scope means the study leaves out what the compared alternatives share, so its results are a difference between them and not a complete footprint. Both are frozen with each published version.

The Standard report prints the statement under its goal. For a partial scope it also says so on the cover, in the summary and in the limitations, as does the methods paragraph of the export.

Study A: general anaesthesia, main operating roomStudy B: WALANT, minor procedure roomProductsProducts: study A 7.53, study B 1.89 kg CO₂ eq per procedureWasteWaste: study A 6.04, study B 1.02 kg CO₂ eq per procedureRoom useRoom use: study A 2.06, study B 0.20 kg CO₂ eq per procedureAnaesthetic gasesAnaesthetic gases: study A 1.39, study B 0.00 kg CO₂ eq per procedureSterilisationSterilisation: study A 0.92, study B 0.46 kg CO₂ eq per procedureTransportTransport: study A 0.45, study B 0.09 kg CO₂ eq per procedureDrugsDrugs: study A 0.01, study B 0.01 kg CO₂ eq per procedure02468kg CO₂ eq per procedure Study A: general anaesthesia, main operating roomStudy B: WALANT, minor procedure roomProductsProducts: study A 7.53, study B 1.89 kg CO₂ eq per procedureWasteWaste: study A 6.04, study B 1.02 kg CO₂ eq per procedureRoom useRoom use: study A 2.06, study B 0.20 kg CO₂ eq per procedureAnaesthetic gasesAnaesthetic gases: study A 1.39, study B 0.00 kg CO₂ eq per procedureSterilisationSterilisation: study A 0.92, study B 0.46 kg CO₂ eq per procedureTransportTransport: study A 0.45, study B 0.09 kg CO₂ eq per procedureDrugsDrugs: study A 0.01, study B 0.01 kg CO₂ eq per procedure02468kg CO₂ eq per procedure
Figure 1. Two techniques for the same procedure, compared section by section: study A under general anaesthesia in a main operating room (report version 2), study B under local anaesthesia without a tourniquet (WALANT) in a minor procedure room (report version 4); EF 3.1 climate change, the mean of 6 procedures each. Both are procedure studies, so the two are divided by the same thing and share one axis. Fictitious demonstration data: the studies are made up to show how a report reads, and describe no real hospital or patient.
Figure 1 as a table
SectionStudy A (kg CO₂ eq per procedure)Study B (kg CO₂ eq per procedure)
Products7.531.89
Waste6.041.02
Room use2.060.20
Anaesthetic gases1.390.00
Sterilisation0.920.46
Transport0.450.09
Drugs0.010.01
Total18.403.67

Checks and sensitivity#

Before publishing, the project page flags one line that is more than half of the total under EF 3.1 Climate change, because a figure that rests on one quantity and one factor is worth checking. The Standard report names such a line in its findings and limitations.

Besides the other characterisations, the anaesthetic gases and the waste method, the Standard report's sensitivity table gives the result with the hospital's electricity on another national grid, taking the lowest and the highest of the grids in the catalogue, and the grids of the neighbouring countries (for Belgium: France, Germany, Luxembourg and the Netherlands). These totals are frozen at publication, under the published indicator.

Three more rows are calculated from the frozen lines:

Only electricity that resolves through the hospital's grid moves (sterilisation, room use, and any material recorded as electricity), never the energy inside a background dataset. The project page's grid selector gives the same figure for any one country.

Spread between procedures#

For each project the comparison gives the spread between the project's own procedures. It is stated in the same way everywhere (on screen, in the comparison and Standard reports, the exports and the paper figure), as the mean ± the sample standard deviation. Where a comparison pools projects, a ± between the project means says so. Each line of the project is apportioned to its procedures:

Lines Share of a procedure
products, drugs with a product, their transport its units of the product ÷ units consumed
room use its minutes × the room's kWh/h ÷ the project's kWh
waste (disposal and transport to the processor) its weighed kg (the mean where not weighed or excluded) ÷ the project's kg
anaesthesia its own anaesthesia records
sterilisation its DIN baskets ÷ the project's DIN baskets

By construction, the procedures add up to the project total. A single procedure gives no standard deviation. A comparison needs at least two published variants, and there is no minimum number of procedures per variant.

Clinical equivalence#

A comparison is only meaningful when its variants do the same thing clinically: the functional unit of ISO 14044 has to hold across the arms. Since 2.20.6 a comparison is therefore published under a clinical equivalence statement in the study team's words, with a reference, of up to 1,000 characters.

The database refuses to publish a comparison without one, on both paths: a chosen selection and a study subject's one-click comparison. The statement is frozen with the version and printed under the introduction of the comparison report, in its PDF and Excel exports, on the public link and in the methods paragraph of the export. A new version starts from the previous one's text.

A single study has no such field: with one variant there is nothing to be equivalent to. Comparisons published before 2.20.6 carry no statement and print nothing.

A published comparison freezes each arm's spread under its published indicator at the moment of publishing, and says when more procedures were recorded after the arm's report. The Standard report computes the spread when it is downloaded, and prints it only while the project still has the version's procedures and mean. Otherwise it says that the spread is not shown, and why.

Study A, general anaesthesia± 1 SD (0.49)mean 18.40Study A, procedure 1: 18.07 kg CO₂ eq per procedureStudy A, procedure 2: 18.41 kg CO₂ eq per procedureStudy A, procedure 3: 18.13 kg CO₂ eq per procedureStudy A, procedure 4: 18.33 kg CO₂ eq per procedureStudy A, procedure 5: 19.36 kg CO₂ eq per procedureStudy A, procedure 6: 18.12 kg CO₂ eq per procedure17.518.018.519.019.5Study A, kg CO₂ eq per procedureStudy B, WALANT± 1 SD (0.13)mean 3.67Study B, procedure 1: 3.65 kg CO₂ eq per procedureStudy B, procedure 2: 3.59 kg CO₂ eq per procedureStudy B, procedure 3: 3.82 kg CO₂ eq per procedureStudy B, procedure 4: 3.64 kg CO₂ eq per procedureStudy B, procedure 5: 3.83 kg CO₂ eq per procedureStudy B, procedure 6: 3.50 kg CO₂ eq per procedure2.53.03.54.04.5Study B, kg CO₂ eq per procedure Study A, general anaesthesia± 1 SD (0.49)mean 18.40Study A, procedure 1: 18.07 kg CO₂ eq per procedureStudy A, procedure 2: 18.41 kg CO₂ eq per procedureStudy A, procedure 3: 18.13 kg CO₂ eq per procedureStudy A, procedure 4: 18.33 kg CO₂ eq per procedureStudy A, procedure 5: 19.36 kg CO₂ eq per procedureStudy A, procedure 6: 18.12 kg CO₂ eq per procedure17.518.018.519.019.5Study A, kg CO₂ eq per procedureStudy B, WALANT± 1 SD (0.13)mean 3.67Study B, procedure 1: 3.65 kg CO₂ eq per procedureStudy B, procedure 2: 3.59 kg CO₂ eq per procedureStudy B, procedure 3: 3.82 kg CO₂ eq per procedureStudy B, procedure 4: 3.64 kg CO₂ eq per procedureStudy B, procedure 5: 3.83 kg CO₂ eq per procedureStudy B, procedure 6: 3.50 kg CO₂ eq per procedure2.53.03.54.04.5Study B, kg CO₂ eq per procedure
Figure 2. The spread between the procedures of each study: every dot is one procedure, the vertical line the mean, the bracket one sample standard deviation either side. Study A 18.40 ± 0.49, study B 3.67 ± 0.13 kg CO₂ eq per procedure (report version 2 and report version 4, 6 procedures each). Each panel spans 2 kg, so the two spreads can be compared even though the means lie far apart. The report lines are apportioned to the procedures as described above, and they add up to the report's total. Fictitious demonstration data: the studies are made up to show how a report reads, and describe no real hospital or patient.
Figure 2 as a table
ProcedureStudy A (kg CO₂ eq per procedure)Study B (kg CO₂ eq per procedure)
Procedure 118.073.65
Procedure 218.413.59
Procedure 318.133.82
Procedure 418.333.64
Procedure 519.363.83
Procedure 618.123.50
Mean18.403.67
Standard deviation0.490.13

Costs#

A product can carry several prices, one per label (hospital contract, online, list). The cost per procedure on a project and in the comparison is units consumed × the price under the chosen label, or the earliest price recorded, plus the DIN sterilised (over all procedures) × the hospital's cost per DIN.

A reusable instrument's price is divided by its uses, so it counts per use like its footprint. The project page shows the cost per module (products, drugs, sterilisation) and names what has no price, in which case the cost is a lower bound.

A cost is not an impact and is frozen in no report.

Staff#

Staff are a module too, per recorded procedure. Their cost is:

The number of nurses has no default. A missing fee, number of nurses, hourly cost or time makes the staff cost a lower bound, and the page says which.

Cost against impact#

The comparison sets cost and impact side by side for the projects ticked. Each project is a point, cost per procedure against impact per procedure.

The abatement cost against a reference project is (cost − reference cost) ÷ (reference impact − impact), in euros per unit of impact avoided. A project whose impact is not lower has no abatement cost, and one that is both cheaper and lower saves money as well. Where a product has no price the costs are lower bounds, and the figure is marked as approximate.

Cheaper,higher impacta trade-offMore expensive,higher impactworse on bothCheaper,lower impactbetter on bothMore expensive,lower impactpays for each kg avoidedThe reference techniquereferenceA new technique: more expensive, lower impactnew techniqueΔ cost per procedure (€), new technique minus reference →Δ impact per procedure (kg CO₂ eq) → Cheaper,higher impacta trade-offMore expensive,higher impactworse on bothCheaper,lower impactbetter on bothMore expensive,lower impact€ per kg avoidedThe reference techniquereferenceA new technique: more expensive, lower impactnew techniqueΔ cost per procedure (€) →Δ kg CO₂ eq per procedure →
Figure 3. Cost against impact, a schematic: a new technique against a reference, per procedure, with the reference at the centre. Below the axis the new technique has the lower impact; to the left it is cheaper. Bottom left is better on both and top right worse on both; the other two are a choice. For a technique that costs more and emits less (bottom right), the cost per kg CO₂ eq avoided is the difference in cost divided by the impact avoided: the flatter the dashed line from the reference, the more each kg avoided costs. The techniques compared must give an equivalent clinical outcome.

Data quality#

Each figure can carry two ratings, set by the person who enters it:

Rating Levels
How the figure was obtained measured (weighed, metered or counted at the hospital, or the manufacturer's own data for this product or machine model: its weight, its consumption per programme, an EPD), sourced (literature, generic databases, averages from other hospitals or countries), estimated (an expert guess, a proxy or a default)
How well the background dataset stands for the real material or treatment exact, close (the same kind of material or process), proxy (a stand-in for something the database does not hold)

The ratings apply to:

Some ratings follow from the data. A weighed bin is measured, a manufacturer's place found by lookup is sourced, and one taken from the country's capital is estimated, as is a drug or agent volume converted at the assumed density of 1.00 g/mL.

A report line takes the weakest rating among the figures it was computed from, and a figure without a rating makes the line unrated. For each section the report states the share of the result resting on each level, and the share of the part computed from a chosen dataset per fit. Lines without a chosen dataset (drugs, sterilisation, room use, transport) have no fit.

The ratings are frozen with each version and change no figure. "Before you publish" flags more than half of the result on estimated or unrated figures and, separately, more than 10 % on unrated ones (a missing rating, as opposed to an estimate). There is no single score, because an average of levels would hide which part of the result is uncertain.

Uncertainty#

Each figure has a range. By default it follows the data-quality rating: measured ± 5 %, sourced ± 10 %, estimated ± 30 % and unrated ± 30 % (defaults an administrator can change). A range set on the figure's product or anaesthesia record takes precedence, for example the spread of sevoflurane use by fresh gas flow.

One driver at a time (a product, an anaesthesia record, sterilisation, room use, waste) is moved to either end of its range with the others unchanged. Because the result is linear in every quantity, the total moves by Σ |line result| × range over the driver's lines.

Ranking the drivers by that effect gives the tornado diagram, and moving every driver to the same end at once gives the lowest and highest result. The GWP time horizon is a separate scenario (IPCC 2021 GWP 20) and not a range. The ranges are frozen with each version.

WasteWaste: 16.59 to 20.22 (± 1.81) kg CO₂ eq per procedure± 1.81Custom procedure packCustom procedure pack: 17.24 to 19.56 (± 1.16) kg CO₂ eq per procedure± 1.16Room useRoom use: 17.78 to 19.02 (± 0.62) kg CO₂ eq per procedure± 0.62Anaesthetic gas (sevoflurane)Anaesthetic gas (sevoflurane): 17.98 to 18.82 (± 0.42) kg CO₂ eq per procedure± 0.42SterilisationSterilisation: 18.13 to 18.68 (± 0.27) kg CO₂ eq per procedure± 0.27Breathing circuitBreathing circuit: 18.19 to 18.61 (± 0.21) kg CO₂ eq per procedure± 0.21Tourniquet cuffTourniquet cuff: 18.23 to 18.57 (± 0.17) kg CO₂ eq per procedure± 0.17Sterile barrier wrapSterile barrier wrap: 18.25 to 18.56 (± 0.15) kg CO₂ eq per procedure± 0.1527 other products and drugs27 other products and drugs: 17.70 to 19.10 (± 0.70) kg CO₂ eq per procedure± 0.70161718192021Total of study A, kg CO₂ eq per procedure WasteWaste: 16.59 to 20.22 (± 1.81) kg CO₂ eq per procedure± 1.81Custom procedure packCustom procedure pack: 17.24 to 19.56 (± 1.16) kg CO₂ eq per procedure± 1.16Room useRoom use: 17.78 to 19.02 (± 0.62) kg CO₂ eq per procedure± 0.62Anaesthetic gas (sevoflurane)Anaesthetic gas (sevoflurane): 17.98 to 18.82 (± 0.42) kg CO₂ eq per procedure± 0.42SterilisationSterilisation: 18.13 to 18.68 (± 0.27) kg CO₂ eq per procedure± 0.27Breathing circuitBreathing circuit: 18.19 to 18.61 (± 0.21) kg CO₂ eq per procedure± 0.21Tourniquet cuffTourniquet cuff: 18.23 to 18.57 (± 0.17) kg CO₂ eq per procedure± 0.17Sterile barrier wrapSterile barrier wrap: 18.25 to 18.56 (± 0.15) kg CO₂ eq per procedure± 0.1527 other products and drugs27 other products and drugs: 17.70 to 19.10 (± 0.70) kg CO₂ eq per procedure± 0.70161718192021Total of study A, kg CO₂ eq per procedure
Figure 4. The drivers of uncertainty in study A (report version 2): each bar is the range of the total, 18.40 kg CO₂ eq per procedure, when that one driver moves to either end of its range and everything else stays put. This version carries no data-quality ratings, so every figure takes the range of an unrated figure, ± 30 %, and the ranking follows the size of each driver. Moving every driver to the same end at once gives 12.88 to 23.92. Fictitious demonstration data: the studies are made up to show how a report reads, and describe no real hospital or patient.
Figure 4 as a table
DriverResult (kg CO₂ eq per procedure)Moves the total by ±
Waste6.041.81
Custom procedure pack3.871.16
Room use2.060.62
Anaesthetic gas (sevoflurane)1.390.42
Sterilisation0.920.27
Breathing circuit0.710.21
Tourniquet cuff0.560.17
Sterile barrier wrap0.520.15
27 other products and drugs2.330.70

Back to top