How to interpret the Stderr output

Gunnar Kaestle
Gunnar Kaestle
Joined: 14 Jul 06
Posts: 8
Credit: 10894
RAC: 84
Topic 231091

Hi,

What does "------> Starting from scratch..." this mean, after checkpoints have been written roughly each minute. It seems to happen regularily. Is this a finished subtask which needs a new checkpoint file?

Regards,

Gunnar

 

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
5:36][9527][INFO ] Checkpoint committed!
[14:56:38][9527][INFO ] Checkpoint committed!
[14:57:40][9527][INFO ] Checkpoint committed!
[14:58:44][9527][INFO ] Checkpoint committed!

...

[20:24:41][9527][INFO ] Checkpoint committed!
[20:25:45][9527][INFO ] Checkpoint committed!
[20:26:47][9527][INFO ] Checkpoint committed!
[20:27:53][9527][INFO ] Checkpoint committed!
[20:28:17][9527][INFO ] Statistics: count dirty SumSpec pages 360 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 329052
[20:28:17][9527][INFO ] Data processing finished successfully!
[20:28:17][9527][INFO ] Starting data processing...
[20:28:17][9527][INFO ] Checkpoint file unavailable: p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory).
------> Starting from scratch...
[20:28:17][9527][INFO ] Header contents:
------> Original WAPP file: ./p2030.20191127.G184.70-00.58.N.b2s0g0.00000_DM212.50
------> Sample time in microseconds: 65.4762
------> Observation time in seconds: 274.62705
------> Time stamp (MJD): 58814.21584203044
------> Number of samples/record: 0
------> Center freq in MHz: 1214.289551
------> Channel band in MHz: 0.336182022
------> Number of channels/record: 960
------> Nifs: 1
------> RA (J2000): 55446.2099991
------> DEC (J2000): 243828.9006
------> Galactic l: 0
------> Galactic b: 0
------> Name: G184.70-00.58.N
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 4194304
------> Trial dispersion measure: 212.5 cm^-3 pc
------> Scale factor: 0.0012882
[20:28:17][9527][INFO ] Seed for random number generator is 1175555430.
[20:28:29][9527][INFO ] Derived global search parameters:
------> f_A probability = 0.08
------> single bin prob(P_noise > P_thr) = 1.32531e-08
------> thr1 = 18.139
------> thr2 = 21.241
------> thr4 = 26.2686
------> thr8 = 34.6478
------> thr16 = 48.9581
[20:28:55][9527][INFO ] Checkpoint committed!
[20:30:03][9527][INFO ] Checkpoint committed!
[20:31:07][9527][INFO ] Checkpoint committed!

...

[01:41:12][9527][INFO ] Checkpoint committed!
[01:42:14][9527][INFO ] Checkpoint committed!
[01:43:16][9527][INFO ] Checkpoint committed!
[01:44:20][9527][INFO ] Checkpoint committed!
[01:44:55][9527][INFO ] Statistics: count dirty SumSpec pages 391 (not checkpointed), Page Size 1024, fundamental_idx_hi-window_2: 329052
[01:44:55][9527][INFO ] Data processing finished successfully!
[01:44:55][9527][INFO ] Starting data processing...
[01:44:55][9527][INFO ] Checkpoint file unavailable: p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory).
------> Starting from scratch...
[01:44:55][9527][INFO ] Header contents:
------> Original WAPP file: ./p2030.20191127.G184.70-00.58.N.b2s0g0.00000_DM212.60
------> Sample time in microseconds: 65.4762
------> Observation time in seconds: 274.62705
------> Time stamp (MJD): 58814.215842028403
------> Number of samples/record: 0
------> Center freq in MHz: 1214.289551
------> Channel band in MHz: 0.336182022
------> Number of channels/record: 960
------> Nifs: 1
------> RA (J2000): 55446.2099991
------> DEC (J2000): 243828.9006
------> Galactic l: 0
------> Galactic b: 0
------> Name: G184.70-00.58.N
------> Lagformat: 0
------> Sum: 1
------> Level: 3
------> AZ at start: 0
------> ZA at start: 0
------> AST at start: 0
------> LST at start: 0
------> Project ID: --
------> Observers: --
------> File size (bytes): 0
------> Data size (bytes): 0
------> Number of samples: 4194304
------> Trial dispersion measure: 212.6 cm^-3 pc
------> Scale factor: 0.00128824
[01:44:55][9527][INFO ] Seed for random number generator is 1173525504.
[01:45:04][9527][INFO ] Derived global search parameters:
------> f_A probability = 0.08
------> single bin prob(P_noise > P_thr) = 1.32531e-08
------> thr1 = 18.139
------> thr2 = 21.241
------> thr4 = 26.2686
------> thr8 = 34.6478
------> thr16 = 48.9581
[01:45:23][9527][INFO ] Checkpoint committed!
[01:46:27][9527][INFO ] Checkpoint committed!
[01:47:32][9527][INFO ] Checkpoint committed!
[01:48:34][9527][INFO ] Checkpoint committed!

mikey
mikey
Joined: 22 Jan 05
Posts: 12495
Credit: 1838530893
RAC: 3654

Gunnar Kaestle

Gunnar Kaestle wrote:

Hi,

What does "------> Starting from scratch..." this mean, after checkpoints have been written roughly each minute. It seems to happen regularily. Is this a finished subtask which needs a new checkpoint file?

Regards,

Gunnar

 

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
5:36][9527][INFO ] Checkpoint committed!

...


[20:28:17][9527][INFO ] Data processing finished successfully!
[20:28:17][9527][INFO ] Starting data processing...
[20:28:17][9527][INFO ] Checkpoint file unavailable: p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory).
------> Starting from scratch...

Gary Roberts is an expert at reading these but I will give it a shot...you have to look at the lines above it as I cut out above....you can see it finished one part of the task on the line "[20:28:17][9527][INFO ] Data processing finished successfully!" and then it starts a new part of the task and looks for a checkpoint file but doesn't fine one and says "[20:28:17][9527][INFO ] Checkpoint file unavailable:". After that it reports the name of the checkpoint file and says "p2030.20191127.G184.70-00.58.N.b2s0g0.00000_2120.cpt (No such file or directory). ------> Starting from scratch..."

 

Gunnar Kaestle
Gunnar Kaestle
Joined: 14 Jul 06
Posts: 8
Credit: 10894
RAC: 84

Thanks, Mikey, for the

Thanks, Mikey, for the explanation.

Gunnar

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.