Started working on galaxy PGC1318302 at Fri Jun  5 05:22:55 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.523333 7.2929444000000005 --width 307 --height 307 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T05:22:56.487967
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.523333', '7.2929444000000005', '--width', '307', '--height', '307', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.523333 7.2929444000000005 --width 307 --height 307 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 353.523333 7.2929444000000005
Starting process 51486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 51488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 51491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 51494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T05:23:07.020994
Keeping 11 CCDs:
   c4d_170721_073922_ooi_g_ls9.fits.fz c4d_170721_073922_ooi_g_ls9-S6 g exptime 126.0 propid 2014B-0404 seeing 1.25 MJD 57955.317 object DECaLS_23780_g
   c4d_160813_062857_ooi_z_ls9.fits.fz c4d_160813_062857_ooi_z_ls9-S6 z exptime 179.0 propid 2014B-0404 seeing 1.02 MJD 57613.267 object DECaLS_23780_z
   c4d_170724_071454_ooi_r_ls9.fits.fz c4d_170724_071454_ooi_r_ls9-S6 r exptime 73.0 propid 2014B-0404 seeing 1.76 MJD 57958.301 object DECaLS_23780_r
   c4d_140815_100431_ooi_z_ls9.fits.fz c4d_140815_100431_ooi_z_ls9-S8 z exptime 163.0 propid 2014B-0404 seeing 1.00 MJD 56884.417 object DECaLS_7891_z
   c4d_160812_064525_ooi_g_ls9.fits.fz c4d_160812_064525_ooi_g_ls9-S8 g exptime 146.0 propid 2014B-0404 seeing 1.30 MJD 57612.279 object DECaLS_7891_g
   c4d_170722_061151_ooi_r_ls9.fits.fz c4d_170722_061151_ooi_r_ls9-S8 r exptime 55.0 propid 2014B-0404 seeing 1.14 MJD 57956.257 object DECaLS_7891_r
   c4d_170724_060548_ooi_r_ls9.fits.fz c4d_170724_060548_ooi_r_ls9-S5 r exptime 125.0 propid 2014B-0404 seeing 1.97 MJD 57958.252 object DECaLS_39652_r
   c4d_170730_071743_ooi_g_ls9.fits.fz c4d_170730_071743_ooi_g_ls9-S5 g exptime 138.0 propid 2014B-0404 seeing 1.20 MJD 57964.302 object DECaLS_39652_g
   c4d_180918_015818_ooi_z_ls9.fits.fz c4d_180918_015818_ooi_z_ls9-S5 z exptime 126.0 propid 2014B-0404 seeing 1.10 MJD 58379.082 object DECaLS_39652_z
   c4d_170719_080615_ooi_z_ls9.fits.fz c4d_170719_080615_ooi_z_ls9-S5 z exptime 139.0 propid 2014B-0404 seeing 1.85 MJD 57953.335 object DECaLS_39652_z
   c4d_180914_033753_ooi_r_ls9.fits.fz c4d_180914_033753_ooi_r_ls9-S5 r exptime 52.0 propid 2014B-0404 seeing 1.36 MJD 58375.151 object DECaLS_39652_r
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T073623_oi[S6,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T100053_oi[S8,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f6d6-r-20170724T071248_oi[S6,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T062508_oi[S6,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95624c3-g-20160812T064204_oi[S8,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f6d6-r-20170724T060249_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170730T071432_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T015818_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170719T080302_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T033753_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951dcf7-r-20170722T061002_oi[S8,noinherit][2046,4094][real]: DECaLS_7
Stage tims : Wall: 79.79 s, CPU: 2.09 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 179 MB, VmData: 213 MB, maxrss: 0.45464 MB
Stage tims finished: 2020-06-05T05:24:26.810363
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T073623_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95624c3-g-20160812T064204_oi[S8,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T015818_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f6d6-r-20170724T071248_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f6d6-r-20170724T060249_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170719T080302_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T062508_oi[S6,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170730T071432_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T033753_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage tims : 4.455 s worker CPU, 296.493 s worker Wall, Wall: 79.793 s, Cores in use: 0.08, Total efficiency (on 4 cores): 2.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T100053_oi[S8,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951dcf7-r-20170722T061002_oi[S8,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
Running stage refs at 2020-06-05T05:24:27.072173
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05310.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05437.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05566.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/reference-custom-353523p07292.fits
Stage refs : Wall: 25.33 s, CPU: 3.41 s, VmPeak: 1026 MB, VmSize: 1010 MB, VmRSS: 195 MB, VmData: 227 MB, maxrss: 0.45464 MB
Stage refs finished: 2020-06-05T05:24:52.405306
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 25.334 s, Cores in use: 0.13, Total efficiency (on 4 cores): 3.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T05:24:52.406821
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/outlier-mask-custom-353523p07292.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/outliers-pre-custom-353523p07292.jpg
Image c4d_170724_060548_ooi_r_ls9-S5 r : masking 270 positive outlier pixels and 0 negative outlier pixels
Image c4d_180918_015818_ooi_z_ls9-S5 z : masking 404 positive outlier pixels and 0 negative outlier pixels
Image c4d_140815_100431_ooi_z_ls9-S8 z : masking 359 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/outlier-mask-custom-353523p07292.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/outliers-post-custom-353523p07292.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/outliers-masked-pos-custom-353523p07292.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/outliers-masked-neg-custom-353523p07292.jpg
Stage outliers : Wall: 15.96 s, CPU: 2.15 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.45464 MB
Stage outliers finished: 2020-06-05T05:25:08.369896
Resources for stage outliers : 1.315 s worker CPU, 1.332 s worker Wall, Wall: 15.964 s, Cores in use: 0.22, Total efficiency (on 4 cores): 5.4 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T05:25:08.371514
Stage halos : Wall: 1.15 s, CPU: 0.65 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.45464 MB
Stage halos finished: 2020-06-05T05:25:09.523723
Resources for stage halos : 0.167 s worker CPU, 1.829 s worker Wall, Wall: 1.168 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T05:25:09.540170
PSF sigmas in coadd pixels: ['2.04', '2.11', '1.95']
Using average PSF sigma 2.0340657307335612
Gaussian PSF norm 0.1386851897220372 vs pixelized 0.117149666
average tim pixel scale / coadd scale: 1.001185908618575
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.86', '1.85', '3.21', '2.21']
Using average PSF sigma 2.5332077084835714
Gaussian PSF norm 0.11135872942007813 vs pixelized 0.09078119
average tim pixel scale / coadd scale: 1.0012358044698935
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.66', '1.63', '1.79', '3.00']
Using average PSF sigma 2.0213945293851587
Gaussian PSF norm 0.1395545439908171 vs pixelized 0.1111012
average tim pixel scale / coadd scale: 1.0011919654367263
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.00 s, CPU: 0.25 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.45464 MB
Stage fit_on_coadds finished: 2020-06-05T05:25:10.542310
Resources for stage fit_on_coadds : 0.243 s worker CPU, 0.261 s worker Wall, Wall: 1.003 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T05:25:10.545078
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 40 potential peaks
Of 40 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 36 kept
SED z : 36 new peaks
Found 35 potential peaks
Of 35 potential peaks: 32 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 32 potential peaks
Of 32 potential peaks: 24 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 45 potential peaks
Of 45 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 49 potential peaks
Of 49 potential peaks: 42 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 43 new sources
Median coadd sky for g : -3.139523e-05
Median coadd sky for r : -4.243179e-05
Median coadd sky for z : 6.482506e-05
Stage srcs : Wall: 0.78 s, CPU: 0.72 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.45464 MB
Stage srcs finished: 2020-06-05T05:25:11.324157
Resources for stage srcs : 0.139 s worker CPU, 0.139 s worker Wall, Wall: 0.780 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/PGC1318302-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T05:25:11.541724
Blob 1 of 24, id: 9, sources: 8, size: 158x125, npix 10433, brick X: 42,200, Y: 94,219, one pixel: 130 94
Blob 2 of 24, id: 2, sources: 3, size: 47x73, npix 1849, brick X: 145,192, Y: 14,87, one pixel: 174 14
Blob 3 of 24, id: 19, sources: 3, size: 65x43, npix 1507, brick X: 117,182, Y: 238,281, one pixel: 148 238
Blob 4 of 24, id: 0, sources: 1, size: 43x39, npix 1333, brick X: 0,43, Y: 0,39, one pixel: 2 0
Blob 5 of 24, id: 15, sources: 3, size: 41x62, npix 1331, brick X: 16,57, Y: 211,273, one pixel: 41 211
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 2.56 s, CPU: 2.56 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 6 of 24, id: 10, sources: 2, size: 39x48, npix 1172, brick X: 251,290, Y: 168,216, one pixel: 281 168
Blob 3 finished, total: Wall: 2.91 s, CPU: 2.91 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 7 of 24, id: 17, sources: 2, size: 39x53, npix 1021, brick X: 265,304, Y: 231,284, one pixel: 282 231
Blob 4 finished, total: Wall: 3.35 s, CPU: 3.35 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 8 of 24, id: 5, sources: 2, size: 30x50, npix 905, brick X: 237,267, Y: 49,99, one pixel: 252 49
Blob 6 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 9 of 24, id: 13, sources: 1, size: 34x39, npix 894, brick X: 220,254, Y: 200,239, one pixel: 233 200
Blob 5 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 10 of 24, id: 23, sources: 2, size: 29x44, npix 787, brick X: 97,126, Y: 260,304, one pixel: 106 260
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 11 of 24, id: 21, sources: 2, size: 46x29, npix 736, brick X: 189,235, Y: 257,286, one pixel: 222 257
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 12 of 24, id: 18, sources: 1, size: 33x32, npix 706, brick X: 69,102, Y: 236,268, one pixel: 84 236
Blob 7 finished, total: Wall: 2.38 s, CPU: 2.38 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 13 of 24, id: 20, sources: 2, size: 24x50, npix 684, brick X: 236,260, Y: 240,290, one pixel: 246 240
Blob 11 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 14 of 24, id: 22, sources: 2, size: 25x45, npix 681, brick X: 59,84, Y: 260,305, one pixel: 68 260
Blob 10 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 15 of 24, id: 4, sources: 1, size: 32x32, npix 663, brick X: 209,241, Y: 39,71, one pixel: 226 39
Blob 12 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 16 of 24, id: 16, sources: 1, size: 29x28, npix 532, brick X: 191,220, Y: 226,254, one pixel: 205 226
Measuring 1 iterative sources
Blob 14 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 17 of 24, id: 7, sources: 1, size: 25x29, npix 518, brick X: 0,25, Y: 71,100, one pixel: 9 71
Blob 15 finished, total: Wall: 1.23 s, CPU: 1.21 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 18 of 24, id: 3, sources: 1, size: 24x25, npix 396, brick X: 22,46, Y: 31,56, one pixel: 32 31
Blob 13 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 19 of 24, id: 8, sources: 1, size: 24x23, npix 324, brick X: 33,57, Y: 82,105, one pixel: 42 82
Blob 16 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 20 of 24, id: 1, sources: 1, size: 27x15, npix 308, brick X: 123,150, Y: 0,15, one pixel: 125 0
Blob 17 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 21 of 24, id: 6, sources: 1, size: 21x22, npix 262, brick X: 101,122, Y: 61,83, one pixel: 111 61
Blob 18 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 22 of 24, id: 14, sources: 1, size: 22x21, npix 251, brick X: 59,81, Y: 205,226, one pixel: 69 205
Blob 20 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 23 of 24, id: 12, sources: 1, size: 20x19, npix 208, brick X: 5,25, Y: 174,193, one pixel: 13 174
Blob 19 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Blob 24 of 24, id: 11, sources: 1, size: 17x17, npix 145, brick X: 226,243, Y: 171,188, one pixel: 234 171
Blob 21 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 24 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147336 MB
Blob 22 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149728 MB
Blob 23 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149484 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.70265, ee1=0.43709, ee2=-0.569156
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 17.08 s, CPU: 17.05 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151336 MB
Old catalog: 49
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/blobs-custom-353523p07292.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/metrics/cus/all-models-custom-353523p07292.fits
Stage fitblobs : Wall: 43.07 s, CPU: 0.60 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.45464 MB
Stage fitblobs finished: 2020-06-05T05:25:54.610968
Resources for stage fitblobs : 45.980 s worker CPU, 49.298 s worker Wall, Wall: 43.070 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T05:25:54.612824
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/tmp-legacysurvey-custom-353523p07292-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/tmp-legacysurvey-custom-353523p07292-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/tmp-legacysurvey-custom-353523p07292-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/tmp-legacysurvey-custom-353523p07292-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-resid.jpg
Stage coadds : Wall: 216.96 s, CPU: 1.12 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.45464 MB
Stage coadds finished: 2020-06-05T05:29:31.570095
Resources for stage coadds : 3.106 s worker CPU, 3.294 s worker Wall, Wall: 216.958 s, Cores in use: 0.02, Total efficiency (on 4 cores): 0.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T05:29:31.571713
Cut to 1 unWISE tiles
Reading WISE tile 3538p075 band 1
Reading WISE tile 3538p075 band 2
Reading WISE tile 3538p075 band 3
Reading WISE tile 3538p075 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.21 s, CPU: 0.14 s, VmPeak: 966 MB, VmSize: 799 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.195272 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.214764 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205916 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3538p075/unwise-3538p075-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 967 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.214748 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/tmp-legacysurvey-custom-353523p07292-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/tmp-legacysurvey-custom-353523p07292-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 60.91 s, CPU: 0.47 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 217 MB, VmData: 243 MB, maxrss: 0.45464 MB
Stage wise_forced finished: 2020-06-05T05:30:32.478419
Resources for stage wise_forced : 4.622 s worker CPU, 5.515 s worker Wall, Wall: 60.908 s, Cores in use: 0.08, Total efficiency (on 4 cores): 2.1 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T05:30:32.480217
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/coadd/cus/custom-353523p07292/legacysurvey-custom-353523p07292-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/tractor-i/cus/tractor-custom-353523p07292.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/tractor/cus/tractor-custom-353523p07292.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1318302/tractor/cus/brick-custom-353523p07292.sha256sum
Stage writecat : Wall: 4.64 s, CPU: 0.54 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 219 MB, VmData: 243 MB, maxrss: 0.45464 MB
Stage writecat finished: 2020-06-05T05:30:37.120592
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.641 s, Cores in use: 0.12, Total efficiency (on 4 cores): 2.9 %
Stage writecat finished
All done: 60.028 s worker CPU, 358.163 s worker Wall, Wall: 458.356 s, Cores in use: 0.16, Total efficiency (on 4 cores): 3.9 %
Finished galaxy PGC1318302 in 14.584 minutes.