The SEPEM reference datasets
In order to perform meaningful statistical analyses on SEP events, a
contiguous, uniform, high quality dataset is needed, which spans as many
solar cycles as possible.
In practice, there are only two data sources that can fullfill the above
criteria: the IMP8/GME data, and the SEM/EPS data from successive GOES
spacecraft (click
here
for an overview of the data sources that have been ingested in SEPEM).
Even these datasets need substantial processing before they can be used
in statistical processing, in order to:
- remove data spikes;
- correct or at least remove episodes where problems such as saturation,
pulse pile-up, contamination etc. occur;
- fill data gaps (including gaps introduced by removing bad data).
After correcting and completing the data, there still remains the issue
that the energy bins in the respective instrument channels are different
(even for the SEM instruments there are non-neglible differences),
so the data cannot easily be combined. This requires additional
processing of the data:
- cross-calibration of the data;
- rebinning of the individual data point spectra into a common set of
energy bins;
- merging of the individual datasets without overlaps in time;
- background subtraction.
Only at this stage can the data be used for statistical analyses.
At present, there are two versions of the SEPEM reference dataset (RDS):
- v1.0: a H dataset based on GOES/SEM
data cross-calibrated with IMP-8/GME data, and IMP-8/GME before 1984;
- v2.0: a H and He dataset using GOES/SEM/EPS data only (starting in
1974), whereby IMP-8/GME data were used to re-calibrate the GOES
instrument energy channels.
The construction of the v1.0 H dataset is described in detail
here. RDS V2.0 is described in the sections
below. All processing (except the dataset merging, which was done
manually) was performed by means of the tools available on the SEPEM
server, and can be verified or repeated by any registered user. Detailed
descriptions of the data processing are provided in Technical Notes
TN2 (ESA Contract No 4000115930/15/NL/HK) and
TN1B (ESA Contract No 4000107025/12/NL/AK)
for H and He, respectively.
The SEPEM reference proton dataset is intended to be used for analysing
proton induced radation effects. The energy range covered by the dataset
is 5–200 MeV, in ten logarithmically spaced channels, which can
be interpreted as a virtual instrument dataset (the energy channels are
listed below).
Data selection
The long duration datasets used to construct the SEPEM reference proton
dataset have been collected by instruments on IMP8 and on the GOES
spacecraft series.
For IMP8, data from the GME and CPME instruments have
been analysed for suitability in the reference dataset construction. It
turned out that the CPME instrument suffered from severe saturation
(and possibly other) effects, and that in addition there were numerous
gaps in the dataset. Therefore, it was decided not to use these data. The
GME data also show saturation effects and data gaps, but to a less severe
extent than the CPME data. Nevertheless, especially during the second
half of the mission, a number of very large SEP events are insufficiently
covered by the GME data. A detailed analysis of the data caveats was
compiled for the CPME and GME datasets.
The GOES/SEM proton data do not suffer from saturation, and only have
relatively small data gaps, which can be filled with interpolation or
usage of the secondary GOES spacecraft data. A detailed description of
the GOES/SEM proton datasets and caveats was also
compiled.
In order to make maximum use of the strong points of the respective
datasets, the following procedure was used to combine the data:
- IMP8/CPME data were not used.
- For the period prior to the GOES05 mission (01-01-1984), IMP8/GME
data were used. Older GOES data (dating back to 1974) are available and
have been processed and ingested into the SEPEM database. After analysing
these additional data, it was concluded that they are too noisy to be
used for the reference proton dataset (note that the GOES05 data for
years 1984 and 1985 were retrieved from this old FITS file series).
- For the period 01-01-1984 to 28-02-2011, SEM proton data were used
from successive GOES spacecraft as specified in the table below. The G data series (uncorrected
five minute averaged data) was used.
- From 01-03-2011 onward, GOES13/EPS data were used (again, uncorrected
five minute averaged data).
Data selection for the reference proton dataset
Original dataset |
Original time span |
Time span of the selected data |
Comments |
IMP8/GME |
01-11-1973–26-10-2001 |
01-11-1973–26-10-2001 |
Primary dataset prior to 01-01-1984. Data were also
used to cross-calibrate the GOES/SEM data. Channel 92.5–107.0 MeV
was not used. |
GOES05/SEM |
01-01-1984–24-03-1987 |
01-01-1984–05-03-1987 |
|
GOES07/SEM |
06-03-1987–12-08-1996 |
06-03-1987–28-02-1995 |
|
GOES08/SEM-2 |
01-03-1995–31-05-2003 |
01-03-1995–31-05-2003 |
|
GOES11/SEM-2 |
01-07-2000–28-02-2011 |
21-06-2003–28-02-2011 |
Due to large data gaps, data prior to 21-06-2003 are
only used for cross-calibration. |
GOES12/SEM-2 |
01-01-2003–28-02-2010 |
01-06-2003–20-06-2003 |
Used to bridge the three week gap between GOES08
and GOES11. Channels P6 and P7 are missing, data values for this period
set to 0.0026 and 0.0012, respectively (surrounding background level,
verified with GOES10 that these channels remain at background level
during this period). |
GOES13/EPS |
01-05-2010–30-06-2013 |
01-03-2011–31-03-2013 |
The cross-calibration factors for GOES11 were applied
as there is insufficient overlap. |
As the energy range of the SEPEM proton reference dataset is limited to
5–200 MeV, not all energy channels of the GME, SEM and EPS instruments
are required. The tables below list the channels which were retained for
the construction of the reference dataset.
Energy channels used for the proton reference dataset.
Energies are given in MeV.
Reference dataset |
Channel name | Energy range |
F1 | 5.00–7.23 |
F2 | 7.23–10.46 |
F3 | 10.46–15.12 |
F4 | 15.12–21.87 |
F5 | 21.87–31.62 |
F6 | 31.62–45.73 |
F7 | 45.73–66.13 |
F8 | 66.13–95.64 |
F9 | 95.64–138.3 |
F10 | 138.3–200.0 |
|
GOES05-07/SEM |
Channel name | Energy range |
P2 | 4.2–8.7 |
P3 | 8.7–14.5 |
P4 | 15.0–44.0 |
P5 | 39.0–82.0 |
P6 | 84.0–200.0 |
P7 | 110.0–500.0 |
|
GOES08-12/SEM-2 |
Channel name | Energy range |
P2 | 4.0–9.0 |
P3 | 9.0–15.0 |
P4 | 15.0–40.0 |
P5 | 40.0–80.0 |
P6 | 80.0–165.0 |
P7 | 165.0–500.0 |
|
GOES13/EPS |
Channel name | Energy range |
P2 | 4.2–8.7 |
P3 | 8.7–14.5 |
P4 | 15.0–40.0 |
P5 | 38.0–82.0 |
P6 | 84.0–200.0 |
P7 | 110.0–900.0 |
|
IMP8/GME |
Channel name | Energy range |
DIntn_8 | 4.94–5.96 |
DIntn_9 | 5.96–7.25 |
DIntn_10 | 7.25–8.65 |
DIntn_11 | 8.65–11.10 |
DIntn_12 | 11.10–13.60 |
DIntn_13 | 13.60–16.10 |
DIntn_14 | 16.10–18.70 |
DIntn_15 | 18.70–22.50 |
DIntn_16 | 19.80–24.20 |
DIntn_17 | 24.20–28.70 |
DIntn_18 | 28.70–35.20 |
DIntn_19 | 35.20–42.90 |
DIntn_20 | 42.90–51.00 |
DIntn_21 | 51.00–63.20 |
DIntn_22 | 63.20–81.00 |
DIntn_23 | 87.00–92.50 |
DIntn_25 | 107.0–121.0 |
DIntn_26 | 121.0–154.0 |
DIntn_27 | 154.0–178.0 |
DIntn_28 | 178.0–230.0 |
|
Last modified on: 14 December 2018.