Started working on galaxy PGC3127650 at Thu Jun  4 14:18:49 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.783256 14.689802800000002 --width 261 --height 261 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T14:18:51.024766
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.783256', '14.689802800000002', '--width', '261', '--height', '261', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.783256 14.689802800000002 --width 261 --height 261 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.783256 14.689802800000002
Starting process 58987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 58988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 58989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 58990 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 58991 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 58992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 58994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 58993 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T14:18:52.477365
Keeping 13 CCDs:
   c4d_181005_041704_ooi_r_ls9.fits.fz c4d_181005_041704_ooi_r_ls9-S22 r exptime 70.0 propid 2014B-0404 seeing 1.06 MJD 58396.179 object DECaLS_34031_r
   c4d_170920_074823_ooi_g_ls9.fits.fz c4d_170920_074823_ooi_g_ls9-S22 g exptime 200.0 propid 2014B-0404 seeing 1.78 MJD 58016.325 object DECaLS_34031_g
   c4d_170921_064704_ooi_r_ls9.fits.fz c4d_170921_064704_ooi_r_ls9-S22 r exptime 156.0 propid 2014B-0404 seeing 1.88 MJD 58017.283 object DECaLS_34031_r
   c4d_181016_023352_ooi_z_ls9.fits.fz c4d_181016_023352_ooi_z_ls9-S22 z exptime 146.0 propid 2014B-0404 seeing 1.19 MJD 58407.107 object DECaLS_34031_z
   c4d_171025_053734_ooi_g_ls9.fits.fz c4d_171025_053734_ooi_g_ls9-S23 g exptime 143.0 propid 2014B-0404 seeing 1.28 MJD 58051.234 object DECaLS_18159_g
   c4d_171113_035937_ooi_r_ls9.fits.fz c4d_171113_035937_ooi_r_ls9-S23 r exptime 104.0 propid 2014B-0404 seeing 1.18 MJD 58070.166 object DECaLS_18159_r
   c4d_180726_100029_ooi_z_ls9.fits.fz c4d_180726_100029_ooi_z_ls9-S23 z exptime 126.0 propid 2014B-0404 seeing 1.29 MJD 58325.417 object DECaLS_18159_z
   c4d_160722_094408_ooi_z_ls9.fits.fz c4d_160722_094408_ooi_z_ls9-N29 z exptime 80.0 propid 2016A-0190 seeing 0.97 MJD 57591.404 object DECaLS_2266_z
   c4d_170917_074129_ooi_r_ls9.fits.fz c4d_170917_074129_ooi_r_ls9-N29 r exptime 65.0 propid 2014B-0404 seeing 1.14 MJD 58013.320 object DECaLS_2266_r
   c4d_171111_035201_ooi_g_ls9.fits.fz c4d_171111_035201_ooi_g_ls9-N29 g exptime 80.0 propid 2014B-0404 seeing 1.02 MJD 58068.161 object DECaLS_2266_g
   c4d_160722_094748_ooi_z_ls9.fits.fz c4d_160722_094748_ooi_z_ls9-S28 z exptime 80.0 propid 2016A-0190 seeing 0.95 MJD 57591.407 object DECaLS_2287_z
   c4d_170917_074302_ooi_r_ls9.fits.fz c4d_170917_074302_ooi_r_ls9-S28 r exptime 64.0 propid 2014B-0404 seeing 1.09 MJD 58013.322 object DECaLS_2287_r
   c4d_171111_035012_ooi_g_ls9.fits.fz c4d_171111_035012_ooi_g_ls9-S28 g exptime 80.0 propid 2014B-0404 seeing 1.09 MJD 58068.160 object DECaLS_2287_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527501-r-20171113T035937_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524a76-g-20170920T074823_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T100029_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T041704_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95316b1-z-20181016T023352_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T094158_oi[N29,noinherit][2046,4094][real]: DECaLS_
Swapping in SKY_JOHN values for 1 splinesky cells; 1771.879 -> 1770.863
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526dbd-g-20171111T035201_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523d7d-r-20170917T074129_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523d7d-r-20170917T074302_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524507-r-20170921T064704_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526dbd-g-20171111T035012_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952630f-g-20171025T053734_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T094540_oi[S28,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 125.61 s, CPU: 3.02 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 177 MB, VmData: 210 MB, maxrss: 0.455608 MB
Stage tims finished: 2020-06-04T14:20:58.087130
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T094158_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527501-r-20171113T035937_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523d7d-r-20170917T074129_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524507-r-20170921T064704_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524a76-g-20170920T074823_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526dbd-g-20171111T035201_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T041704_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523d7d-r-20170917T074302_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952630f-g-20171025T053734_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.223 s worker CPU, 750.708 s worker Wall, Wall: 125.611 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95316b1-z-20181016T023352_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526dbd-g-20171111T035012_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955edcd-z-20180726T100029_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T094540_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-04T14:20:58.118426
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04554.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04427.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/reference-custom-029783p14689.fits
Stage refs : Wall: 7.47 s, CPU: 1.82 s, VmPeak: 1026 MB, VmSize: 1009 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.455608 MB
Stage refs finished: 2020-06-04T14:21:05.592890
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.476 s, Cores in use: 0.24, Total efficiency (on 8 cores): 3.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T14:21:05.594618
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/outlier-mask-custom-029783p14689.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/outliers-pre-custom-029783p14689.jpg
Image c4d_171025_053734_ooi_g_ls9-S23 g : masking 274 positive outlier pixels and 0 negative outlier pixels
Image c4d_170920_074823_ooi_g_ls9-S22 g : masking 1475 positive outlier pixels and 0 negative outlier pixels
Image c4d_170921_064704_ooi_r_ls9-S22 r : masking 619 positive outlier pixels and 0 negative outlier pixels
Image c4d_171113_035937_ooi_r_ls9-S23 r : masking 432 positive outlier pixels and 0 negative outlier pixels
Image c4d_181016_023352_ooi_z_ls9-S22 z : masking 552 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/outlier-mask-custom-029783p14689.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/outliers-post-custom-029783p14689.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/outliers-masked-pos-custom-029783p14689.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/outliers-masked-neg-custom-029783p14689.jpg
Stage outliers : Wall: 1.68 s, CPU: 1.41 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 208 MB, VmData: 239 MB, maxrss: 0.455608 MB
Stage outliers finished: 2020-06-04T14:21:07.278892
Resources for stage outliers : 1.003 s worker CPU, 1.003 s worker Wall, Wall: 1.686 s, Cores in use: 1.43, Total efficiency (on 8 cores): 17.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T14:21:07.281056
Stage halos : Wall: 11.44 s, CPU: 0.63 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 208 MB, VmData: 239 MB, maxrss: 0.455608 MB
Stage halos finished: 2020-06-04T14:21:18.725901
Resources for stage halos : 0.548 s worker CPU, 49.007 s worker Wall, Wall: 11.446 s, Cores in use: 0.10, Total efficiency (on 8 cores): 1.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T14:21:18.728235
PSF sigmas in coadd pixels: ['2.89', '2.08', '1.66', '1.76']
Using average PSF sigma 2.098981614227585
Gaussian PSF norm 0.13439602798888148 vs pixelized 0.10958018
average tim pixel scale / coadd scale: 1.0011561493965164
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73', '3.06', '1.91', '1.85', '1.77']
Using average PSF sigma 2.0615803043195067
Gaussian PSF norm 0.13683424855331694 vs pixelized 0.11216152
average tim pixel scale / coadd scale: 1.0012133150958662
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.94', '2.09', '1.58', '1.55']
Using average PSF sigma 1.7896670843529157
Gaussian PSF norm 0.15762417169105744 vs pixelized 0.1307051
average tim pixel scale / coadd scale: 1.001223757483584
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.455608 MB
Stage fit_on_coadds finished: 2020-06-04T14:21:18.943827
Resources for stage fit_on_coadds : 0.296 s worker CPU, 0.298 s worker Wall, Wall: 0.217 s, Cores in use: 2.30, Total efficiency (on 8 cores): 28.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T14:21:18.946880
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 29 potential peaks
Of 29 potential peaks: 5 in veto map, 4 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 30 potential peaks
Of 30 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 7 kept
SED r : 7 new peaks
Found 23 potential peaks
Of 23 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 32 potential peaks
Of 32 potential peaks: 29 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 35 potential peaks
Of 35 potential peaks: 32 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 30 new sources
Median coadd sky for g : -6.454572e-05
Median coadd sky for r : -1.2480412e-05
Median coadd sky for z : 0.00021803005
Stage srcs : Wall: 0.63 s, CPU: 0.59 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.455608 MB
Stage srcs finished: 2020-06-04T14:21:19.578828
Resources for stage srcs : 0.089 s worker CPU, 0.090 s worker Wall, Wall: 0.633 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/PGC3127650-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T14:21:19.590949
Blob 1 of 17, id: 8, sources: 7, size: 101x163, npix 10298, brick X: 78,179, Y: 66,229, one pixel: 153 66
Blob 2 of 17, id: 7, sources: 4, size: 49x68, npix 1813, brick X: 181,230, Y: 58,126, one pixel: 217 58
Blob 3 of 17, id: 13, sources: 4, size: 43x75, npix 1474, brick X: 2,45, Y: 161,236, one pixel: 32 161
Blob 4 of 17, id: 2, sources: 1, size: 39x39, npix 1046, brick X: 132,171, Y: 0,39, one pixel: 154 0
Blob 5 of 17, id: 14, sources: 2, size: 42x40, npix 990, brick X: 163,205, Y: 194,234, one pixel: 190 194
Blob 6 of 17, id: 3, sources: 2, size: 28x51, npix 837, brick X: 93,121, Y: 17,68, one pixel: 108 17
Blob 7 of 17, id: 16, sources: 1, size: 35x28, npix 568, brick X: 186,221, Y: 225,253, one pixel: 208 225
Blob 8 of 17, id: 5, sources: 1, size: 27x27, npix 438, brick X: 64,91, Y: 37,64, one pixel: 78 37
Blob 9 of 17, id: 4, sources: 2, size: 22x32, npix 435, brick X: 19,41, Y: 27,59, one pixel: 28 27
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 0.90 s, CPU: 0.89 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14832 MB
Blob 10 of 17, id: 9, sources: 1, size: 25x26, npix 398, brick X: 37,62, Y: 73,99, one pixel: 48 73
Blob 6 finished, total: Wall: 1.33 s, CPU: 1.32 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146236 MB
Blob 11 of 17, id: 12, sources: 1, size: 24x23, npix 341, brick X: 179,203, Y: 154,177, one pixel: 189 154
Blob 7 finished, total: Wall: 1.69 s, CPU: 1.68 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB
Blob 12 of 17, id: 11, sources: 1, size: 24x23, npix 339, brick X: 224,248, Y: 125,148, one pixel: 233 125
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14816 MB
Blob 13 of 17, id: 6, sources: 1, size: 22x23, npix 315, brick X: 175,197, Y: 56,79, one pixel: 184 56
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 2.39 s, CPU: 2.36 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149444 MB
Blob 14 of 17, id: 10, sources: 1, size: 23x22, npix 304, brick X: 14,37, Y: 97,119, one pixel: 24 97
Blob 3 finished, total: Wall: 2.38 s, CPU: 2.38 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147136 MB
Blob 15 of 17, id: 0, sources: 1, size: 23x15, npix 251, brick X: 23,46, Y: 0,15, one pixel: 24 0
Blob 11 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB
Blob 16 of 17, id: 1, sources: 1, size: 22x17, npix 245, brick X: 101,123, Y: 0,17, one pixel: 106 0
Blob 9 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14832 MB
Blob 17 of 17, id: 15, sources: 1, size: 20x20, npix 220, brick X: 235,255, Y: 215,235, one pixel: 244 215
Blob 13 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149444 MB
Blob 5 finished, total: Wall: 2.87 s, CPU: 2.87 s, VmPeak: 947 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147712 MB
Blob 12 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14816 MB
Blob 17 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149444 MB
Blob 15 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148088 MB
Blob 14 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147136 MB
Blob 16 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14832 MB
Blob 2 finished, total: Wall: 4.57 s, CPU: 4.52 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148944 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.16806, ee1=-0.156988, ee2=-0.178475
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 7.81 s, CPU: 7.72 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150464 MB
Old catalog: 36
New catalog: 36
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/blobs-custom-029783p14689.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/metrics/cus/all-models-custom-029783p14689.fits
Stage fitblobs : Wall: 12.16 s, CPU: 1.90 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.455608 MB
Stage fitblobs finished: 2020-06-04T14:21:31.750806
Resources for stage fitblobs : 31.407 s worker CPU, 51.624 s worker Wall, Wall: 12.161 s, Cores in use: 2.74, Total efficiency (on 8 cores): 34.2 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T14:21:31.753015
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/tmp-legacysurvey-custom-029783p14689-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/tmp-legacysurvey-custom-029783p14689-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/tmp-legacysurvey-custom-029783p14689-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/tmp-legacysurvey-custom-029783p14689-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-resid.jpg
Stage coadds : Wall: 3.43 s, CPU: 0.87 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.455608 MB
Stage coadds finished: 2020-06-04T14:21:35.183724
Resources for stage coadds : 3.892 s worker CPU, 9.556 s worker Wall, Wall: 3.432 s, Cores in use: 1.39, Total efficiency (on 8 cores): 17.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T14:21:35.185647
Cut to 1 unWISE tiles
Reading WISE tile 0297p151 band 3
Reading WISE tile 0297p151 band 2
Reading WISE tile 0297p151 band 1
Reading WISE tile 0297p151 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204804 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 948 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.191284 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210576 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 947 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210212 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/tmp-legacysurvey-custom-029783p14689-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/tmp-legacysurvey-custom-029783p14689-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.15 s, CPU: 0.75 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.455608 MB
Stage wise_forced finished: 2020-06-04T14:21:40.334643
Resources for stage wise_forced : 3.318 s worker CPU, 4.497 s worker Wall, Wall: 5.150 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T14:21:40.336672
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/coadd/cus/custom-029783p14689/legacysurvey-custom-029783p14689-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/tractor-i/cus/tractor-custom-029783p14689.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/tractor/cus/tractor-custom-029783p14689.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC3127650/tractor/cus/brick-custom-029783p14689.sha256sum
Stage writecat : Wall: 2.90 s, CPU: 2.10 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.455608 MB
Stage writecat finished: 2020-06-04T14:21:43.232739
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.897 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 %
Stage writecat finished
All done: 46.779 s worker CPU, 866.786 s worker Wall, Wall: 170.769 s, Cores in use: 0.35, Total efficiency (on 8 cores): 4.4 %
Finished galaxy PGC3127650 in 2.900 minutes.