PSPrem P. SinghPlant scientist · Data scientist
Methods That Travel
Effort normalization

When More Records Do Not Mean More Disease

Normalize pathogen observations by reporting effort so the map reflects surveillance intensity instead of simply rewarding countries that publish more data.

August 12, 2026 · 2 min read

Illustrated visual summary of When More Records Do Not Mean More Disease
Method at a glanceOpen full size
1,170RecordsPublic occurrences checked
309MappedRecords with coordinates
7thUnited StatesAfter effort correction
0PortugalRecords despite a known outbreak

The bias

Raw occurrence counts mix two signals: where a pathogen has been observed and where institutions publish the most biodiversity records. Nearly half of the public Xylella records came from one country, but that did not mean disease pressure was highest there.

The correction

For each country, divide its Xylella records by its total GBIF publishing volume:

effort-corrected rate=Xylella recordsall GBIF records×106\text{effort-corrected rate} = \frac{\textit{Xylella}\ \text{records}}{\text{all GBIF records}} \times 10^6

This produces a comparable rate per million records instead of a leaderboard dominated by database size.

Surveillance portfolio

Reporting effort reshapes the country ranking

The United States leads raw records but falls to seventh after normalizing for total GBIF publishing volume.

01Iran
7.7
02Italy
7.5
03Brazil
2.2
04Argentina
1.0
05China
0.7
06United Kingdom
0.5
07United States
0.4
08Spain
0.3
09France
0.3
10Taiwan
0.2

Normalized index · Xylella records per one million records published by that country

Source: GBIF occurrence records for Xylella fastidiosa. The index measures records per million total GBIF records—not disease incidence.
Evidence detail
CountryNormalized indexXylella records
Iran7.710
Italy7.5104
Brazil2.296
Argentina1.019
China0.710
United Kingdom0.5122
United States0.4543
Spain0.331
France0.363
Taiwan0.25

The validation step

A normalized index can still miss an outbreak, so it needs an external check. I compared the first public record in each European country with documented plant-health reports.

Data-readiness check

Public data does not provide a consistent outbreak alert

Italy appears on time, Spain within one year, Germany a decade late, and Portugal is missing entirely.

Italy
On time
Spain
+1 year
France
3 years earlier
Germany
+10 years
Portugal
×
Missing
Confirmed outbreakFirst public record2012 → 2026
Sources: GBIF occurrence records and documented European plant-health detections. A public record can predate a confirmed outbreak and is not itself an outbreak diagnosis.
Evidence detail
CountryConfirmedFirst public recordTiming
Italy20132013On time
Spain20162017+1 year
France201520123 years earlier
Germany20162026+10 years
Portugal2019No recordMissing

Italy appeared in the same year. Portugal's 2019 outbreak never appeared in the occurrence data. That absence is the limit of the method: correction makes comparisons fairer, but it cannot turn incomplete surveillance into proof of absence.

Use this when

  • groups differ greatly in how much data they contribute;
  • the outcome is a count generated by observation effort;
  • an external benchmark exists to test whether the corrected signal is credible.

Do not use it to claim

  • true disease prevalence;
  • that an empty map is disease-free;
  • that every source record has equal diagnostic quality.

How this was done

Every figure and number on this page is produced by the linked code.

PythonGBIF APIEffort normalizationGround-truth validationGeospatial dataReproducible analysis

Built for

GBIF occurrence data for Xylella fastidiosa

Re-applied to

Country-level outbreak surveillance

Reproducible code

View analysis code