HSK data datation problem
=========================
== HSK data MEA1 2014-11-19
We get regularly space HSK data from the start of the day : one HSK packet each 8 seconds,
with sequence numbers growing from 4018 up to 7183.
Starting a T07:02:03, we get now up to ten HSK data records per seconds, starting from sequence number 3111.
[role='red']
====
* What is this data sequence ?
* Is there a dump of recorded data ?
* How to detect this data?
====
It seems we are merging here data download from Real TIme mode and Reprocessed data.
Full detail on link:/documents/HSK/MEA1_20141119_HSK.dat[]
----
2014-323T00:00:04.761718Z Size = 253 APID = 0628 Seq = 4018 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:00:12.761718Z Size = 253 APID = 0628 Seq = 4019 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:00:20.823718Z Size = 253 APID = 0628 Seq = 4020 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:00:28.761718Z Size = 253 APID = 0628 Seq = 4021 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:00:36.760718Z Size = 253 APID = 0628 Seq = 4022 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:00:44.760718Z Size = 253 APID = 0628 Seq = 4023 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:00:52.760718Z Size = 253 APID = 0628 Seq = 4024 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:00.760718Z Size = 253 APID = 0628 Seq = 4025 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:08.760718Z Size = 253 APID = 0628 Seq = 4026 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:16.760718Z Size = 253 APID = 0628 Seq = 4027 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:24.760718Z Size = 253 APID = 0628 Seq = 4028 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:32.760718Z Size = 253 APID = 0628 Seq = 4029 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:40.759718Z Size = 253 APID = 0628 Seq = 4030 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:48.822718Z Size = 253 APID = 0628 Seq = 4031 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T00:01:56.759718Z Size = 253 APID = 0628 Seq = 4032 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
...
2014-323T07:00:11.297718Z Size = 253 APID = 0628 Seq = 7169 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:00:19.297718Z Size = 253 APID = 0628 Seq = 7170 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:00:27.297718Z Size = 253 APID = 0628 Seq = 7171 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:00:35.297718Z Size = 253 APID = 0628 Seq = 7172 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:00:43.297718Z Size = 253 APID = 0628 Seq = 7173 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:00:51.297718Z Size = 253 APID = 0628 Seq = 7174 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:00:59.296718Z Size = 253 APID = 0628 Seq = 7175 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:07.296718Z Size = 253 APID = 0628 Seq = 7176 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:15.296718Z Size = 253 APID = 0628 Seq = 7177 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:23.296718Z Size = 253 APID = 0628 Seq = 7178 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:31.296718Z Size = 253 APID = 0628 Seq = 7179 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:39.296718Z Size = 253 APID = 0628 Seq = 7180 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:47.296718Z Size = 253 APID = 0628 Seq = 7181 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:01:55.296718Z Size = 253 APID = 0628 Seq = 7182 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:03.295718Z Size = 253 APID = 0628 Seq = 7183 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
#
restarting from Seq 3111, with up to 10 HSK data record per second
#
2014-323T07:02:03.795718Z Size = 253 APID = 0628 Seq = 3111 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:03.983718Z Size = 253 APID = 0628 Seq = 3112 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.045718Z Size = 253 APID = 0628 Seq = 3113 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.170718Z Size = 253 APID = 0628 Seq = 3114 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.233718Z Size = 253 APID = 0628 Seq = 3115 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.358718Z Size = 253 APID = 0628 Seq = 3116 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.483718Z Size = 253 APID = 0628 Seq = 3117 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.545718Z Size = 253 APID = 0628 Seq = 3118 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.670718Z Size = 253 APID = 0628 Seq = 3119 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.795718Z Size = 253 APID = 0628 Seq = 3120 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.858718Z Size = 253 APID = 0628 Seq = 3121 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:04.983718Z Size = 253 APID = 0628 Seq = 3122 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:05.045718Z Size = 253 APID = 0628 Seq = 3123 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:05.170718Z Size = 253 APID = 0628 Seq = 3124 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:05.295718Z Size = 253 APID = 0628 Seq = 3125 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
2014-323T07:02:05.545718Z Size = 253 APID = 0628 Seq = 3126 Cat = 33 Pckid = 0 (HSK) Adu_size = 0
----
=== Example of MEA1 2014/11/19
Initialy, we were downloading both Real and Repro data :
----
* Real + repro
APID = 0528 18230 packets (Science)
APID = 0628 12301 packets (HSK)
---------------------
30531 packets
----
We made some tries recovering separately data for VCID = Real and VCID = Repro
----
* VCID = 1 : Repro
APID = 0528 18230 packets (Science)
APID = 0628 5876 packets (HSK)
---------------------
24106 packets
* VCID = 2 : Real
APID = 0528 0 packets (Science)
APID = 0628 6425 packets (HSK)
---------------------
6425 packets
* Total
APID = 0528 18230 packets (Science)
APID = 0628 12301 packets (HSK)
---------------------
30531 packets
----
So we found the same results, after merging the Real and Repro
[CAUTION]
====
* When recovering HSK from VCID = Real, we get HSK records spaced by 8 seconds (SDTP timetags)
* When recovering HSK from VCID = Repro, we get up to 10 HSK records per seconds (SDTP timetags),
and we will have to recompute timetags from CCSDS time
====
