Started working on galaxy PGC1944028 at Thu Jun 4 22:37:30 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.79199450000002 31.372306899999995 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T22:37:31.455218 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '166.79199450000002', '31.372306899999995', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 166.79199450000002 31.372306899999995 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 166.79199450000002 31.372306899999995 Starting process 4333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4334 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4335 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4336 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T22:37:36.363513 Keeping 9 CCDs: c4d_180128_074405_ooi_g_ls9.fits.fz c4d_180128_074405_ooi_g_ls9-S4 g exptime 189.0 propid 2014B-0404 seeing 1.39 MJD 58146.322 object DECaLS_1935_g c4d_170306_040230_ooi_z_ls9.fits.fz c4d_170306_040230_ooi_z_ls9-S4 z exptime 151.0 propid 2014B-0404 seeing 1.14 MJD 57818.166 object DECaLS_1935_z c4d_170327_031742_ooi_r_ls9.fits.fz c4d_170327_031742_ooi_r_ls9-S4 r exptime 69.0 propid 2014B-0404 seeing 1.11 MJD 57839.136 object DECaLS_1935_r c4d_170306_044858_ooi_r_ls9.fits.fz c4d_170306_044858_ooi_r_ls9-S10 r exptime 125.0 propid 2014B-0404 seeing 1.48 MJD 57818.199 object DECaLS_17807_r c4d_160410_020940_ooi_g_ls9.fits.fz c4d_160410_020940_ooi_g_ls9-S10 g exptime 168.0 propid 2014B-0404 seeing 1.14 MJD 57488.088 object DECaLS_17807_g c4d_160226_053433_ooi_z_ls9.fits.fz c4d_160226_053433_ooi_z_ls9-S10 z exptime 185.0 propid 2014B-0404 seeing 1.38 MJD 57444.230 object DECaLS_17807_z c4d_180223_053358_ooi_r_ls9.fits.fz c4d_180223_053358_ooi_r_ls9-S9 r exptime 79.0 propid 2014B-0404 seeing 1.17 MJD 58172.232 object DECaLS_33679_r c4d_170316_041445_ooi_z_ls9.fits.fz c4d_170316_041445_ooi_z_ls9-S9 z exptime 250.0 propid 2014B-0404 seeing 1.17 MJD 57828.173 object DECaLS_33679_z c4d_180222_061313_ooi_g_ls9.fits.fz c4d_180222_061313_ooi_g_ls9-S9 g exptime 200.0 propid 2014B-0404 seeing 1.21 MJD 58171.259 object DECaLS_33679_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9511334-r-20170327T031543_oi[S4,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950fbcc-r-20170306T044602_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95297f5-g-20180128T074405_oi[S4,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T035909_oi[S4,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568910-g-20160410T020602_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bf3b-r-20180223T053358_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9550f89-z-20160226T053038_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T040944_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952c24b-g-20180222T061313_oi[S9,noinherit][2046,4094][real]: DECaLS_3 Stage tims : Wall: 44.93 s, CPU: 4.43 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.454956 MB Stage tims finished: 2020-06-04T22:38:21.290902 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95297f5-g-20180128T074405_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bf3b-r-20180223T053358_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950fbcc-r-20170306T044602_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9550f89-z-20160226T053038_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170306T035909_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T040944_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9511334-r-20170327T031543_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568910-g-20160410T020602_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952c24b-g-20180222T061313_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Resources for stage tims : 3.931 s worker CPU, 122.951 s worker Wall, Wall: 44.929 s, Cores in use: 0.19, Total efficiency (on 4 cores): 4.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-04T22:38:22.289053 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02939.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03067.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02811.fits Matched 27 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/reference-custom-166791p31372.fits Stage refs : Wall: 7.23 s, CPU: 5.21 s, VmPeak: 1026 MB, VmSize: 1005 MB, VmRSS: 185 MB, VmData: 217 MB, maxrss: 0.454956 MB Stage refs finished: 2020-06-04T22:38:29.514990 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.227 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T22:38:29.516356 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/outlier-mask-custom-166791p31372.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/outliers-pre-custom-166791p31372.jpg Image c4d_180128_074405_ooi_g_ls9-S4 g : masking 331 positive outlier pixels and 0 negative outlier pixels Image c4d_180223_053358_ooi_r_ls9-S9 r : masking 71 positive outlier pixels and 0 negative outlier pixels Image c4d_160226_053433_ooi_z_ls9-S10 z : masking 2308 positive outlier pixels and 1332 negative outlier pixels Image c4d_170316_041445_ooi_z_ls9-S9 z : masking 93 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/outlier-mask-custom-166791p31372.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/outliers-post-custom-166791p31372.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/outliers-masked-pos-custom-166791p31372.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/outliers-masked-neg-custom-166791p31372.jpg Stage outliers : Wall: 5.24 s, CPU: 4.91 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage outliers finished: 2020-06-04T22:38:34.752464 Resources for stage outliers : 0.882 s worker CPU, 0.886 s worker Wall, Wall: 5.237 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T22:38:34.754309 Stage halos : Wall: 5.03 s, CPU: 5.03 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 197 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage halos finished: 2020-06-04T22:38:39.782642 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.029 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T22:38:39.784420 PSF sigmas in coadd pixels: ['2.26', '1.86', '1.97'] Using average PSF sigma 2.0311094595442136 Gaussian PSF norm 0.1388870454264838 vs pixelized 0.109199904 average tim pixel scale / coadd scale: 1.001394956322913 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.81', '2.40', '1.89'] Using average PSF sigma 2.0332584343362563 Gaussian PSF norm 0.1387402540720143 vs pixelized 0.119028196 average tim pixel scale / coadd scale: 1.0013821595241776 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '2.25', '1.91'] Using average PSF sigma 2.0030945875015536 Gaussian PSF norm 0.14082949129513306 vs pixelized 0.1207236 average tim pixel scale / coadd scale: 1.001322474455077 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.18 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 198 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage fit_on_coadds finished: 2020-06-04T22:38:39.997917 Resources for stage fit_on_coadds : 0.201 s worker CPU, 0.203 s worker Wall, Wall: 0.215 s, Cores in use: 1.76, Total efficiency (on 4 cores): 44.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T22:38:40.000735 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 11 potential peaks Of 11 potential peaks: 4 in veto map, 1 cut by saddle test, 0 cut by aper test, 6 kept SED z : 6 new peaks Found 23 potential peaks Of 23 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 17 potential peaks Of 17 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 32 potential peaks Of 32 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 33 potential peaks Of 33 potential peaks: 26 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED Red : 4 new peaks Adding 23 new sources Median coadd sky for g : -6.761712e-06 Median coadd sky for r : 8.2955936e-05 Median coadd sky for z : 0.00032297592 Stage srcs : Wall: 4.79 s, CPU: 4.75 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage srcs finished: 2020-06-04T22:38:44.787382 Resources for stage srcs : 0.105 s worker CPU, 0.115 s worker Wall, Wall: 4.787 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/PGC1944028-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T22:38:44.798605 Blob 1 of 17, id: 7, sources: 8, size: 125x161, npix 11312, brick X: 62,187, Y: 57,218, one pixel: 160 57 Blob 2 of 17, id: 9, sources: 1, size: 26x25, npix 425, brick X: 222,248, Y: 88,113, one pixel: 232 88 Blob 3 of 17, id: 13, sources: 1, size: 23x26, npix 383, brick X: 227,250, Y: 193,219, one pixel: 238 193 Blob 4 of 17, id: 11, sources: 1, size: 22x23, npix 313, brick X: 50,72, Y: 177,200, one pixel: 60 177 Blob 5 of 17, id: 2, sources: 1, size: 22x22, npix 302, brick X: 208,230, Y: 4,26, one pixel: 217 4 Blob 4 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 6 of 17, id: 14, sources: 1, size: 21x22, npix 291, brick X: 68,89, Y: 223,245, one pixel: 77 223 Blob 5 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 7 of 17, id: 16, sources: 1, size: 21x20, npix 283, brick X: 211,232, Y: 237,257, one pixel: 220 237 Blob 2 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14618 MB Blob 8 of 17, id: 3, sources: 1, size: 21x22, npix 282, brick X: 205,226, Y: 29,51, one pixel: 214 29 Blob 6 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 9 of 17, id: 10, sources: 1, size: 17x23, npix 276, brick X: 240,257, Y: 129,152, one pixel: 249 129 Blob 3 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146128 MB Blob 10 of 17, id: 1, sources: 1, size: 20x21, npix 249, brick X: 37,57, Y: 4,25, one pixel: 46 4 Blob 7 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14618 MB Blob 11 of 17, id: 4, sources: 1, size: 21x20, npix 249, brick X: 108,129, Y: 37,57, one pixel: 116 37 Blob 8 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 12 of 17, id: 5, sources: 1, size: 21x20, npix 230, brick X: 127,148, Y: 51,71, one pixel: 136 51 Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 13 of 17, id: 8, sources: 1, size: 19x19, npix 190, brick X: 84,103, Y: 81,100, one pixel: 92 81 Blob 10 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14618 MB Blob 14 of 17, id: 15, sources: 1, size: 18x18, npix 171, brick X: 124,142, Y: 236,254, one pixel: 132 236 Blob 13 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14618 MB Blob 15 of 17, id: 0, sources: 1, size: 18x15, npix 162, brick X: 71,89, Y: 0,15, one pixel: 77 0 Blob 14 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14618 MB Blob 16 of 17, id: 12, sources: 1, size: 18x17, npix 162, brick X: 175,193, Y: 180,197, one pixel: 183 180 Blob 12 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 17 of 17, id: 6, sources: 1, size: 17x17, npix 145, brick X: 42,59, Y: 54,71, one pixel: 50 54 Blob 9 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146128 MB Blob 16 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146072 MB Blob 17 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146128 MB Blob 15 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14618 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.43962, ee1=0.203351, ee2=0.386493 Measuring 4 iterative sources Blob 1 finished, total: Wall: 8.72 s, CPU: 8.71 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149512 MB Old catalog: 24 New catalog: 22 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/blobs-custom-166791p31372.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/metrics/cus/all-models-custom-166791p31372.fits Stage fitblobs : Wall: 13.76 s, CPU: 4.63 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 199 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage fitblobs finished: 2020-06-04T22:38:58.558558 Resources for stage fitblobs : 14.034 s worker CPU, 14.060 s worker Wall, Wall: 13.761 s, Cores in use: 1.36, Total efficiency (on 4 cores): 33.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T22:38:58.560526 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/tmp-legacysurvey-custom-166791p31372-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/tmp-legacysurvey-custom-166791p31372-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/tmp-legacysurvey-custom-166791p31372-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/tmp-legacysurvey-custom-166791p31372-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-resid.jpg Stage coadds : Wall: 10.25 s, CPU: 7.21 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage coadds finished: 2020-06-04T22:39:08.806995 Resources for stage coadds : 2.089 s worker CPU, 2.245 s worker Wall, Wall: 10.247 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.7 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T22:39:08.808292 Cut to 2 unWISE tiles Reading WISE tile 1658p318 band 1 Reading WISE tile 1658p318 band 3 Reading WISE tile 1658p318 band 2 Reading WISE tile 1658p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1676p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1676p318 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1676p318 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/165/1658p318/unwise-1658p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1676p318 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.18958 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 959 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209968 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 963 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.205984 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1676p318/unwise-1676p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209948 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/tmp-legacysurvey-custom-166791p31372-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/tmp-legacysurvey-custom-166791p31372-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 16.75 s, CPU: 9.86 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage wise_forced finished: 2020-06-04T22:39:25.557082 Resources for stage wise_forced : 7.145 s worker CPU, 14.488 s worker Wall, Wall: 16.750 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.4 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T22:39:25.558765 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/coadd/cus/custom-166791p31372/legacysurvey-custom-166791p31372-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/tractor-i/cus/tractor-custom-166791p31372.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/tractor/cus/tractor-custom-166791p31372.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/166/PGC1944028/tractor/cus/brick-custom-166791p31372.sha256sum Stage writecat : Wall: 7.74 s, CPU: 6.50 s, VmPeak: 1147 MB, VmSize: 1019 MB, VmRSS: 202 MB, VmData: 228 MB, maxrss: 0.454956 MB Stage writecat finished: 2020-06-04T22:39:33.302842 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.745 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.0 % Stage writecat finished All done: 28.388 s worker CPU, 154.950 s worker Wall, Wall: 117.103 s, Cores in use: 0.69, Total efficiency (on 4 cores): 17.3 % Finished galaxy PGC1944028 in 2.081 minutes.