Started working on galaxy PGC1946210 at Sat Jun 6 18:49:23 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.85255 31.4164 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T18:49:37.005722 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.85255', '31.4164', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.85255 31.4164 --width 263 --height 263 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.85255 31.4164 Starting process 4803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 4805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 4806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T18:49:37.950759 Keeping 10 CCDs: c4d_181101_034523_ooi_g_ls9.fits.fz c4d_181101_034523_ooi_g_ls9-S4 g exptime 179.0 propid 2014B-0404 seeing 2.01 MJD 58423.157 object DECaLS_20805_g c4d_181101_041427_ooi_r_ls9.fits.fz c4d_181101_041427_ooi_r_ls9-S4 r exptime 146.0 propid 2014B-0404 seeing 1.56 MJD 58423.177 object DECaLS_20805_r c4d_181002_060458_ooi_z_ls9.fits.fz c4d_181002_060458_ooi_z_ls9-S4 z exptime 93.0 propid 2014B-0404 seeing 1.08 MJD 58393.253 object DECaLS_20805_z c4d_181102_051956_ooi_z_ls9.fits.fz c4d_181102_051956_ooi_z_ls9-S12 z exptime 81.0 propid 2014B-0404 seeing 0.93 MJD 58424.222 object DECaLS_4933_z c4d_181102_041339_ooi_r_ls9.fits.fz c4d_181102_041339_ooi_r_ls9-S12 r exptime 80.0 propid 2014B-0404 seeing 1.09 MJD 58424.176 object DECaLS_4933_r c4d_181105_051141_ooi_z_ls9.fits.fz c4d_181105_051141_ooi_z_ls9-S12 z exptime 146.0 propid 2014B-0404 seeing 1.01 MJD 58427.216 object DECaLS_4933_z c4d_181103_035825_ooi_g_ls9.fits.fz c4d_181103_035825_ooi_g_ls9-S12 g exptime 149.0 propid 2014B-0404 seeing 1.42 MJD 58425.166 object DECaLS_4933_g c4d_181017_052143_ooi_z_ls9.fits.fz c4d_181017_052143_ooi_z_ls9-S4 z exptime 213.0 propid 2014B-0404 seeing 1.76 MJD 58408.223 object DECaLS_36677_z c4d_181103_045318_ooi_g_ls9.fits.fz c4d_181103_045318_ooi_g_ls9-S4 g exptime 195.0 propid 2014B-0404 seeing 1.61 MJD 58425.204 object DECaLS_36677_g c4d_181104_043241_ooi_r_ls9.fits.fz c4d_181104_043241_ooi_r_ls9-S4 r exptime 81.0 propid 2014B-0404 seeing 1.36 MJD 58426.189 object DECaLS_36677_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181101T034523_oi[S4,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060458_oi[S4,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T051956_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181101T041427_oi[S4,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T035825_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T041339_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532159-z-20181017T052143_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T051141_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T045318_oi[S4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T043241_oi[S4,noinherit][2046,4094][real]: DECaLS_3 Stage tims : Wall: 197.33 s, CPU: 1.34 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.45652 MB Stage tims finished: 2020-06-06T18:52:55.276975 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181101T041427_oi[S4,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532159-z-20181017T052143_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060458_oi[S4,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T051141_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181101T034523_oi[S4,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T041339_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T043241_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T051956_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T035825_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T045318_oi[S4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Resources for stage tims : 3.922 s worker CPU, 627.229 s worker Wall, Wall: 197.328 s, Cores in use: 0.03, Total efficiency (on 4 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T18:52:55.299003 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03018.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02891.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02890.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/reference-custom-029852p31416.fits Stage refs : Wall: 7.79 s, CPU: 5.85 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.45652 MB Stage refs finished: 2020-06-06T18:53:03.089316 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.791 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.8 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T18:53:03.090641 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/outlier-mask-custom-029852p31416.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/outliers-pre-custom-029852p31416.jpg Image c4d_181103_035825_ooi_g_ls9-S12 g : masking 166 positive outlier pixels and 0 negative outlier pixels Image c4d_181101_034523_ooi_g_ls9-S4 g : masking 4620 positive outlier pixels and 170 negative outlier pixels Image c4d_181105_051141_ooi_z_ls9-S12 z : masking 96 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_052143_ooi_z_ls9-S4 z : masking 587 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_060458_ooi_z_ls9-S4 z : masking 161 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/outlier-mask-custom-029852p31416.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/outliers-post-custom-029852p31416.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/outliers-masked-pos-custom-029852p31416.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/outliers-masked-neg-custom-029852p31416.jpg Stage outliers : Wall: 2.40 s, CPU: 2.12 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage outliers finished: 2020-06-06T18:53:05.490488 Resources for stage outliers : 1.010 s worker CPU, 1.020 s worker Wall, Wall: 2.401 s, Cores in use: 1.30, Total efficiency (on 4 cores): 32.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T18:53:05.492074 Stage halos : Wall: 2.44 s, CPU: 1.46 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage halos finished: 2020-06-06T18:53:07.935702 Resources for stage halos : 0.351 s worker CPU, 3.460 s worker Wall, Wall: 2.445 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.5 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-06T18:53:07.937422 PSF sigmas in coadd pixels: ['3.26', '2.31', '2.62'] Using average PSF sigma 2.7298975958621448 Gaussian PSF norm 0.10333530173493126 vs pixelized 0.09581567 average tim pixel scale / coadd scale: 1.0014105524213714 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.54', '1.77', '2.22'] Using average PSF sigma 2.17454446196447 Gaussian PSF norm 0.1297259249962797 vs pixelized 0.1107618 average tim pixel scale / coadd scale: 1.0014160510458279 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.76', '1.51', '1.65', '2.86'] Using average PSF sigma 1.9436342669484672 Gaussian PSF norm 0.14513779499101492 vs pixelized 0.11937469 average tim pixel scale / coadd scale: 1.0014191835955184 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage fit_on_coadds finished: 2020-06-06T18:53:08.135157 Resources for stage fit_on_coadds : 0.228 s worker CPU, 0.231 s worker Wall, Wall: 0.199 s, Cores in use: 2.06, Total efficiency (on 4 cores): 51.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-06T18:53:08.137926 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 37 potential peaks Of 37 potential peaks: 5 in veto map, 9 cut by saddle test, 0 cut by aper test, 23 kept SED z : 23 new peaks Found 34 potential peaks Of 34 potential peaks: 26 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 31 potential peaks Of 31 potential peaks: 24 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 44 potential peaks Of 44 potential peaks: 32 in veto map, 8 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 46 potential peaks Of 46 potential peaks: 36 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 30 new sources Median coadd sky for g : 7.321048e-06 Median coadd sky for r : 3.424841e-05 Median coadd sky for z : 0.00029460102 Stage srcs : Wall: 1.89 s, CPU: 1.84 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage srcs finished: 2020-06-06T18:53:10.027662 Resources for stage srcs : 0.117 s worker CPU, 0.117 s worker Wall, Wall: 1.890 s, Cores in use: 1.04, Total efficiency (on 4 cores): 25.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/PGC1946210-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T18:53:10.038691 Blob 1 of 12, id: 8, sources: 14, size: 251x178, npix 18839, brick X: 5,256, Y: 85,263, one pixel: 128 85 Blob 2 of 12, id: 4, sources: 6, size: 81x170, npix 7748, brick X: 182,263, Y: 34,204, one pixel: 230 34 Blob 3 of 12, id: 0, sources: 2, size: 50x26, npix 841, brick X: 84,134, Y: 0,26, one pixel: 89 0 Blob 4 of 12, id: 7, sources: 2, size: 34x41, npix 815, brick X: 153,187, Y: 53,94, one pixel: 163 53 Blob 5 of 12, id: 3, sources: 1, size: 32x34, npix 754, brick X: 72,104, Y: 29,63, one pixel: 84 29 Blob 4 finished, total: Wall: 1.95 s, CPU: 1.95 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146828 MB Blob 6 of 12, id: 6, sources: 2, size: 35x37, npix 722, brick X: 88,123, Y: 50,87, one pixel: 107 50 Blob 5 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146828 MB Blob 7 of 12, id: 9, sources: 2, size: 40x25, npix 597, brick X: 0,40, Y: 88,113, one pixel: 6 88 Blob 3 finished, total: Wall: 3.31 s, CPU: 3.30 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149632 MB Blob 8 of 12, id: 2, sources: 1, size: 22x27, npix 436, brick X: 241,263, Y: 8,35, one pixel: 253 8 Blob 6 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146828 MB Blob 9 of 12, id: 11, sources: 1, size: 23x25, npix 330, brick X: 32,55, Y: 191,216, one pixel: 43 191 Blob 2 finished, total: Wall: 4.46 s, CPU: 4.46 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148864 MB Blob 10 of 12, id: 1, sources: 1, size: 23x17, npix 252, brick X: 224,247, Y: 0,17, one pixel: 230 0 Blob 7 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149632 MB Blob 11 of 12, id: 10, sources: 1, size: 16x20, npix 209, brick X: 0,16, Y: 161,181, one pixel: 5 161 Blob 9 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148864 MB Blob 12 of 12, id: 5, sources: 1, size: 19x19, npix 208, brick X: 119,138, Y: 38,57, one pixel: 127 38 Blob 10 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149632 MB Blob 11 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148864 MB Blob 8 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146828 MB Blob 12 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149632 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.44717, ee1=-0.516922, ee2=-0.373413 Measuring 10 iterative sources Blob 1 finished, total: Wall: 21.70 s, CPU: 21.70 s, VmPeak: 962 MB, VmSize: 722 MB, VmRSS: 153 MB, VmData: 185 MB, maxrss: 0.157116 MB Old catalog: 36 New catalog: 42 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/blobs-custom-029852p31416.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/metrics/cus/all-models-custom-029852p31416.fits Stage fitblobs : Wall: 23.39 s, CPU: 1.70 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage fitblobs finished: 2020-06-06T18:53:33.425905 Resources for stage fitblobs : 38.226 s worker CPU, 38.295 s worker Wall, Wall: 23.389 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T18:53:33.428194 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/tmp-legacysurvey-custom-029852p31416-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/tmp-legacysurvey-custom-029852p31416-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/tmp-legacysurvey-custom-029852p31416-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/tmp-legacysurvey-custom-029852p31416-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-resid.jpg Stage coadds : Wall: 5.16 s, CPU: 4.31 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage coadds finished: 2020-06-06T18:53:38.591710 Resources for stage coadds : 2.831 s worker CPU, 2.911 s worker Wall, Wall: 5.165 s, Cores in use: 1.38, Total efficiency (on 4 cores): 34.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T18:53:38.593448 Cut to 1 unWISE tiles Reading WISE tile 0300p318 band 1 Reading WISE tile 0300p318 band 2 Reading WISE tile 0300p318 band 3 Reading WISE tile 0300p318 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.215072 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205616 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 799 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.190028 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210636 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/tmp-legacysurvey-custom-029852p31416-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/tmp-legacysurvey-custom-029852p31416-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.34 s, CPU: 2.41 s, VmPeak: 1029 MB, VmSize: 1029 MB, VmRSS: 218 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage wise_forced finished: 2020-06-06T18:53:46.929672 Resources for stage wise_forced : 3.661 s worker CPU, 12.691 s worker Wall, Wall: 8.337 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T18:53:46.931374 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/coadd/cus/custom-029852p31416/legacysurvey-custom-029852p31416-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/tractor-i/cus/tractor-custom-029852p31416.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/tractor/cus/tractor-custom-029852p31416.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1946210/tractor/cus/brick-custom-029852p31416.sha256sum Stage writecat : Wall: 2.42 s, CPU: 2.28 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 220 MB, VmData: 245 MB, maxrss: 0.45652 MB Stage writecat finished: 2020-06-06T18:53:49.354037 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.424 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 % Stage writecat finished All done: 50.347 s worker CPU, 685.956 s worker Wall, Wall: 251.408 s, Cores in use: 0.29, Total efficiency (on 4 cores): 7.3 % Finished galaxy PGC1946210 in 4.441 minutes.