Started working on galaxy PGC1368512 at Sun Jun  7 07:28:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.887458 9.6810556 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T07:29:07.306125
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '32.887458', '9.6810556', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.887458 9.6810556 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 32.887458 9.6810556
Starting process 50501 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057332 MB
Starting process 50504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057332 MB
Starting process 50507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057332 MB
Starting process 50510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057336 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T07:29:07.660938
Keeping 15 CCDs:
   c4d_181017_053823_ooi_z_ls9.fits.fz c4d_181017_053823_ooi_z_ls9-S7 z exptime 204.0 propid 2014B-0404 seeing 1.42 MJD 58408.235 object DECaLS_42218_z
   c4d_181006_033240_ooi_g_ls9.fits.fz c4d_181006_033240_ooi_g_ls9-S7 g exptime 141.0 propid 2014B-0404 seeing 1.33 MJD 58397.148 object DECaLS_42218_g
   c4d_181016_024617_ooi_z_ls9.fits.fz c4d_181016_024617_ooi_z_ls9-S7 z exptime 127.0 propid 2014B-0404 seeing 1.45 MJD 58407.115 object DECaLS_42218_z
   c4d_170920_081942_ooi_r_ls9.fits.fz c4d_170920_081942_ooi_r_ls9-S7 r exptime 154.0 propid 2014B-0404 seeing 1.57 MJD 58016.347 object DECaLS_42218_r
   c4d_181005_040225_ooi_r_ls9.fits.fz c4d_181005_040225_ooi_r_ls9-S1 r exptime 74.0 propid 2014B-0404 seeing 1.22 MJD 58396.168 object DECaLS_42198_r
   c4d_181005_034945_ooi_g_ls9.fits.fz c4d_181005_034945_ooi_g_ls9-S1 g exptime 200.0 propid 2014B-0404 seeing 1.47 MJD 58396.160 object DECaLS_42198_g
   c4d_180922_041752_ooi_z_ls9.fits.fz c4d_180922_041752_ooi_z_ls9-S1 z exptime 250.0 propid 2014B-0404 seeing 1.60 MJD 58383.179 object DECaLS_42198_z
   c4d_180810_083753_ooi_g_ls9.fits.fz c4d_180810_083753_ooi_g_ls9-S2 g exptime 166.0 propid 2014B-0404 seeing 1.43 MJD 58340.360 object DECaLS_26326_g
   c4d_180810_083630_ooi_r_ls9.fits.fz c4d_180810_083630_ooi_r_ls9-S2 r exptime 55.0 propid 2014B-0404 seeing 1.38 MJD 58340.359 object DECaLS_26326_r
   c4d_160724_093345_ooi_z_ls9.fits.fz c4d_160724_093345_ooi_z_ls9-S2 z exptime 124.0 propid 2016A-0190 seeing 0.99 MJD 57593.396 object DECaLS_26326_z
   c4d_181002_065425_ooi_z_ls9.fits.fz c4d_181002_065425_ooi_z_ls9-S2 z exptime 80.0 propid 2014B-0404 seeing 1.03 MJD 58393.288 object DECaLS_26326_z
   c4d_171111_041031_ooi_r_ls9.fits.fz c4d_171111_041031_ooi_r_ls9-S10 r exptime 80.0 propid 2014B-0404 seeing 0.89 MJD 58068.174 object DECaLS_10454_r
   c4d_160722_101513_ooi_z_ls9.fits.fz c4d_160722_101513_ooi_z_ls9-S10 z exptime 80.0 propid 2016A-0190 seeing 0.89 MJD 57591.426 object DECaLS_10454_z
   c4d_180908_060439_ooi_g_ls9.fits.fz c4d_180908_060439_ooi_g_ls9-S10 g exptime 78.0 propid 2014B-0404 seeing 1.21 MJD 58369.253 object DECaLS_10454_g
   c4d_181111_044947_ooi_g_ls9.fits.fz c4d_181111_044947_ooi_g_ls9-S10 g exptime 164.0 propid 2014B-0404 seeing 1.21 MJD 58433.201 object DECaLS_10454_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181017T053823_oi[S7,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95316b1-z-20181016T024617_oi[S7,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953704b-g-20181006T033240_oi[S7,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524507-r-20170920T081942_oi[S7,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T040225_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532385-g-20180810T083753_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181005T034945_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T083630_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160724T093050_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953057e-z-20181002T065425_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T060439_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T101303_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20180922T041752_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181111T044947_oi[S10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171111T041031_oi[S10,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 299.41 s, CPU: 1.00 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.454608 MB
Stage tims finished: 2020-06-07T07:34:07.068965
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524507-r-20170920T081942_oi[S7,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532385-g-20180810T083753_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953057e-z-20181002T065425_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T060439_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953704b-g-20181006T033240_oi[S7,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20180922T041752_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181017T053823_oi[S7,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T040225_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9531ac3-r-20180810T083630_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T101303_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181111T044947_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95316b1-z-20181016T024617_oi[S7,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181005T034945_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160724T093050_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526fce-r-20171111T041031_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.317 s worker CPU, 1071.303 s worker Wall, Wall: 299.409 s, Cores in use: 0.02, Total efficiency (on 4 cores): 0.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T07:34:07.262509
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05067.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05196.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04940.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/reference-custom-032887p09681.fits
Stage refs : Wall: 10.24 s, CPU: 9.89 s, VmPeak: 1027 MB, VmSize: 1008 MB, VmRSS: 196 MB, VmData: 228 MB, maxrss: 0.454608 MB
Stage refs finished: 2020-06-07T07:34:17.498486
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.237 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T07:34:17.500081
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/outlier-mask-custom-032887p09681.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/outliers-pre-custom-032887p09681.jpg
Image c4d_181006_033240_ooi_g_ls9-S7 g : masking 317 positive outlier pixels and 0 negative outlier pixels
Image c4d_181005_034945_ooi_g_ls9-S1 g : masking 186 positive outlier pixels and 0 negative outlier pixels
Image c4d_170920_081942_ooi_r_ls9-S7 r : masking 727 positive outlier pixels and 0 negative outlier pixels
Image c4d_181005_040225_ooi_r_ls9-S1 r : masking 0 positive outlier pixels and 78 negative outlier pixels
Image c4d_181016_024617_ooi_z_ls9-S7 z : masking 376 positive outlier pixels and 0 negative outlier pixels
Image c4d_180922_041752_ooi_z_ls9-S1 z : masking 420 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/outlier-mask-custom-032887p09681.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/outliers-post-custom-032887p09681.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/outliers-masked-pos-custom-032887p09681.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/outliers-masked-neg-custom-032887p09681.jpg
Stage outliers : Wall: 8.15 s, CPU: 7.76 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.454608 MB
Stage outliers finished: 2020-06-07T07:34:25.646833
Resources for stage outliers : 1.792 s worker CPU, 1.825 s worker Wall, Wall: 8.148 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T07:34:25.648370
Stage halos : Wall: 15.28 s, CPU: 7.56 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.454608 MB
Stage halos finished: 2020-06-07T07:34:40.926474
Resources for stage halos : 0.308 s worker CPU, 20.378 s worker Wall, Wall: 15.279 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.9 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T07:34:40.928457
PSF sigmas in coadd pixels: ['2.17', '2.38', '2.32', '1.96', '1.96']
Using average PSF sigma 2.1573721486835984
Gaussian PSF norm 0.13075852116938141 vs pixelized 0.11470298
average tim pixel scale / coadd scale: 1.001213055160892
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.54', '1.99', '2.23', '1.45']
Using average PSF sigma 2.0540829610752196
Gaussian PSF norm 0.13733368959266098 vs pixelized 0.11671072
average tim pixel scale / coadd scale: 1.0012122603597204
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.31', '2.35', '2.59', '1.61', '1.67', '1.45']
Using average PSF sigma 1.996948722946529
Gaussian PSF norm 0.14126291202792773 vs pixelized 0.11269539
average tim pixel scale / coadd scale: 1.0011702292076248
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.30 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 219 MB, VmData: 247 MB, maxrss: 0.454608 MB
Stage fit_on_coadds finished: 2020-06-07T07:34:41.275672
Resources for stage fit_on_coadds : 0.395 s worker CPU, 0.401 s worker Wall, Wall: 0.348 s, Cores in use: 1.99, Total efficiency (on 4 cores): 49.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T07:34:41.278452
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 61 potential peaks
Of 61 potential peaks: 42 in veto map, 4 cut by saddle test, 0 cut by aper test, 15 kept
SED z : 15 new peaks
Found 77 potential peaks
Of 77 potential peaks: 65 in veto map, 7 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 60 potential peaks
Of 60 potential peaks: 52 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 86 potential peaks
Of 86 potential peaks: 72 in veto map, 12 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 98 potential peaks
Of 98 potential peaks: 85 in veto map, 12 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 25 new sources
Median coadd sky for g : 0.00010348171
Median coadd sky for r : 0.00024701227
Median coadd sky for z : 0.0003764599
Stage srcs : Wall: 6.46 s, CPU: 6.41 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.454608 MB
Stage srcs finished: 2020-06-07T07:34:47.741893
Resources for stage srcs : 0.126 s worker CPU, 0.138 s worker Wall, Wall: 6.464 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/PGC1368512-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T07:34:48.080788
Blob 1 of 13, id: 3, sources: 10, size: 255x172, npix 26154, brick X: 0,255, Y: 50,222, one pixel: 28 50
Blob 2 of 13, id: 9, sources: 5, size: 59x91, npix 2967, brick X: 236,295, Y: 196,287, one pixel: 264 196
Blob 3 of 13, id: 7, sources: 2, size: 35x66, npix 1662, brick X: 260,295, Y: 130,196, one pixel: 289 130
Blob 4 of 13, id: 8, sources: 1, size: 45x44, npix 1438, brick X: 33,78, Y: 178,222, one pixel: 51 178
Blob 5 of 13, id: 1, sources: 2, size: 44x44, npix 1094, brick X: 250,294, Y: 17,61, one pixel: 264 17
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 2.15 s, CPU: 2.15 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 144 MB, VmData: 185 MB, maxrss: 0.14756 MB
Blob 6 of 13, id: 10, sources: 1, size: 28x27, npix 499, brick X: 1,29, Y: 212,239, one pixel: 11 212
Measuring 2 iterative sources
Blob 5 finished, total: Wall: 3.05 s, CPU: 3.05 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149772 MB
Blob 7 of 13, id: 12, sources: 1, size: 30x27, npix 487, brick X: 195,225, Y: 257,284, one pixel: 213 257
Blob 3 finished, total: Wall: 5.97 s, CPU: 5.96 s, VmPeak: 1029 MB, VmSize: 786 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150088 MB
Blob 8 of 13, id: 0, sources: 1, size: 27x27, npix 474, brick X: 61,88, Y: 11,38, one pixel: 72 11
Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149772 MB
Blob 9 of 13, id: 2, sources: 1, size: 27x25, npix 423, brick X: 150,177, Y: 41,66, one pixel: 161 41
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 6.76 s, CPU: 6.76 s, VmPeak: 1032 MB, VmSize: 786 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150536 MB
Blob 10 of 13, id: 6, sources: 1, size: 24x23, npix 349, brick X: 266,290, Y: 110,133, one pixel: 278 110
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149772 MB
Blob 11 of 13, id: 5, sources: 1, size: 25x23, npix 347, brick X: 242,267, Y: 93,116, one pixel: 253 93
Blob 10 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149772 MB
Blob 12 of 13, id: 11, sources: 1, size: 21x23, npix 299, brick X: 0,21, Y: 243,266, one pixel: 8 243
Blob 11 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149772 MB
Blob 13 of 13, id: 4, sources: 1, size: 14x21, npix 193, brick X: 281,295, Y: 65,86, one pixel: 290 65
Blob 9 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 1032 MB, VmSize: 786 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150536 MB
Blob 7 finished, total: Wall: 1.86 s, CPU: 1.86 s, VmPeak: 1029 MB, VmSize: 786 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150088 MB
Blob 12 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1028 MB, VmSize: 786 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149772 MB
Blob 13 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 1032 MB, VmSize: 786 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150536 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.69909, ee1=-0.064296, ee2=-0.330802
Measuring 13 iterative sources
Blob 1 finished, total: Wall: 24.81 s, CPU: 24.81 s, VmPeak: 1031 MB, VmSize: 792 MB, VmRSS: 158 MB, VmData: 191 MB, maxrss: 0.162156 MB
Old catalog: 31
New catalog: 42
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/blobs-custom-032887p09681.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/metrics/cus/all-models-custom-032887p09681.fits
Stage fitblobs : Wall: 31.66 s, CPU: 6.85 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.454608 MB
Stage fitblobs finished: 2020-06-07T07:35:19.742211
Resources for stage fitblobs : 48.701 s worker CPU, 48.718 s worker Wall, Wall: 31.663 s, Cores in use: 1.75, Total efficiency (on 4 cores): 43.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T07:35:19.743912
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/tmp-legacysurvey-custom-032887p09681-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/tmp-legacysurvey-custom-032887p09681-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/tmp-legacysurvey-custom-032887p09681-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/tmp-legacysurvey-custom-032887p09681-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-resid.jpg
Stage coadds : Wall: 5.94 s, CPU: 4.61 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.454608 MB
Stage coadds finished: 2020-06-07T07:35:25.680172
Resources for stage coadds : 2.773 s worker CPU, 2.880 s worker Wall, Wall: 5.937 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T07:35:25.681566
Cut to 1 unWISE tiles
Reading WISE tile 0321p090 band 2
Reading WISE tile 0321p090 band 1
Reading WISE tile 0321p090 band 3
Reading WISE tile 0321p090 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1028 MB, VmSize: 862 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.211952 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 1031 MB, VmSize: 866 MB, VmRSS: 155 MB, VmData: 181 MB, maxrss: 0.219636 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1032 MB, VmSize: 864 MB, VmRSS: 149 MB, VmData: 179 MB, maxrss: 0.192272 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0321p090/unwise-0321p090-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1029 MB, VmSize: 858 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207916 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/tmp-legacysurvey-custom-032887p09681-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/tmp-legacysurvey-custom-032887p09681-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 12.15 s, CPU: 7.69 s, VmPeak: 1027 MB, VmSize: 1017 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.454608 MB
Stage wise_forced finished: 2020-06-07T07:35:37.831621
Resources for stage wise_forced : 3.222 s worker CPU, 9.261 s worker Wall, Wall: 12.151 s, Cores in use: 0.90, Total efficiency (on 4 cores): 22.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T07:35:37.833376
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/coadd/cus/custom-032887p09681/legacysurvey-custom-032887p09681-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/tractor-i/cus/tractor-custom-032887p09681.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/tractor/cus/tractor-custom-032887p09681.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC1368512/tractor/cus/brick-custom-032887p09681.sha256sum
Stage writecat : Wall: 8.07 s, CPU: 7.94 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 223 MB, VmData: 248 MB, maxrss: 0.454608 MB
Stage writecat finished: 2020-06-07T07:35:45.907901
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.075 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.6 %
Stage writecat finished
All done: 62.635 s worker CPU, 1154.907 s worker Wall, Wall: 398.251 s, Cores in use: 0.31, Total efficiency (on 4 cores): 7.7 %
Finished galaxy PGC1368512 in 6.782 minutes.