Started working on galaxy PGC1503648 at Thu Jun 4 19:33:25 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.7875085 16.22125 --width 325 --height 325 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T19:33:26.220400 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.7875085', '16.22125', '--width', '325', '--height', '325', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.7875085 16.22125 --width 325 --height 325 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.7875085 16.22125 Starting process 55037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 55038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 55039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 55040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 55041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 55042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 55043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 55044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T19:33:33.033359 Keeping 10 CCDs: c4d_170110_080824_ooi_g_ls9.fits.fz c4d_170110_080824_ooi_g_ls9-S8 g exptime 56.0 propid 2014B-0404 seeing 1.25 MJD 57763.338 object DECaLS_3314_g c4d_190206_063713_ooi_g_ls9.fits.fz c4d_190206_063713_ooi_g_ls9-S8 g exptime 148.0 propid 2014B-0404 seeing 1.45 MJD 58520.276 object DECaLS_3314_g c4d_160110_084544_ooi_z_ls9.fits.fz c4d_160110_084544_ooi_z_ls9-S8 z exptime 88.0 propid 2014B-0404 seeing 1.00 MJD 57397.363 object DECaLS_3314_z c4d_180128_071945_ooi_r_ls9.fits.fz c4d_180128_071945_ooi_r_ls9-S8 r exptime 52.0 propid 2014B-0404 seeing 1.09 MJD 58146.305 object DECaLS_3314_r c4d_170514_005225_ooi_z_ls9.fits.fz c4d_170514_005225_ooi_z_ls9-S12 z exptime 148.0 propid 2014B-0404 seeing 1.45 MJD 57887.034 object DECaLS_35057_z c4d_180317_043449_ooi_g_ls9.fits.fz c4d_180317_043449_ooi_g_ls9-S12 g exptime 155.0 propid 2014B-0404 seeing 1.29 MJD 58194.191 object DECaLS_35057_g c4d_180317_043326_ooi_r_ls9.fits.fz c4d_180317_043326_ooi_r_ls9-S12 r exptime 54.0 propid 2014B-0404 seeing 1.11 MJD 58194.190 object DECaLS_35057_r c4d_160228_052030_ooi_z_ls9.fits.fz c4d_160228_052030_ooi_z_ls9-S13 z exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 57446.221 object DECaLS_19185_z c4d_170422_010456_ooi_g_ls9.fits.fz c4d_170422_010456_ooi_g_ls9-S13 g exptime 97.0 propid 2014B-0404 seeing 1.32 MJD 57865.043 object DECaLS_19185_g c4d_170422_002608_ooi_r_ls9.fits.fz c4d_170422_002608_ooi_r_ls9-S13 r exptime 75.0 propid 2014B-0404 seeing 1.19 MJD 57865.017 object DECaLS_19185_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da1d-r-20180317T043326_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952946a-r-20180128T071945_oi[S8,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160110T084324_oi[S8,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952dda8-g-20180317T043449_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T063713_oi[S8,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95164f7-z-20170514T004906_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170422T002405_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517d11-g-20170422T010230_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9557998-g-20170110T080638_oi[S8,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160228T051817_oi[S13,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 50.12 s, CPU: 5.13 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 177 MB, VmData: 210 MB, maxrss: 0.448368 MB Stage tims finished: 2020-06-04T19:34:23.151071 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da1d-r-20180317T043326_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160110T084324_oi[S8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539fed-g-20190206T063713_oi[S8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95164f7-z-20170514T004906_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952dda8-g-20180317T043449_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95176d0-r-20170422T002405_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952946a-r-20180128T071945_oi[S8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517d11-g-20170422T010230_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9557998-g-20170110T080638_oi[S8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95503fa-z-20160228T051817_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.336 s worker CPU, 202.964 s worker Wall, Wall: 50.119 s, Cores in use: 0.21, Total efficiency (on 8 cores): 2.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-04T19:34:23.271756 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04347.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04476.fits Matched 12 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/reference-custom-167787p16221.fits Stage refs : Wall: 5.93 s, CPU: 4.15 s, VmPeak: 1026 MB, VmSize: 1007 MB, VmRSS: 190 MB, VmData: 222 MB, maxrss: 0.448368 MB Stage refs finished: 2020-06-04T19:34:29.203963 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.933 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.7 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T19:34:29.205689 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/outlier-mask-custom-167787p16221.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/outliers-pre-custom-167787p16221.jpg Image c4d_170110_080824_ooi_g_ls9-S8 g : masking 0 positive outlier pixels and 66 negative outlier pixels Image c4d_190206_063713_ooi_g_ls9-S8 g : masking 907 positive outlier pixels and 0 negative outlier pixels Image c4d_180317_043449_ooi_g_ls9-S12 g : masking 1118 positive outlier pixels and 0 negative outlier pixels Image c4d_170422_010456_ooi_g_ls9-S13 g : masking 629 positive outlier pixels and 0 negative outlier pixels Image c4d_160228_052030_ooi_z_ls9-S13 z : masking 0 positive outlier pixels and 134 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/outlier-mask-custom-167787p16221.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/outliers-post-custom-167787p16221.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/outliers-masked-pos-custom-167787p16221.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/outliers-masked-neg-custom-167787p16221.jpg Stage outliers : Wall: 6.38 s, CPU: 4.57 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.448368 MB Stage outliers finished: 2020-06-04T19:34:35.584186 Resources for stage outliers : 0.973 s worker CPU, 0.988 s worker Wall, Wall: 6.380 s, Cores in use: 0.87, Total efficiency (on 8 cores): 10.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T19:34:35.586417 Stage halos : Wall: 3.51 s, CPU: 2.91 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.448368 MB Stage halos finished: 2020-06-04T19:34:39.098900 Resources for stage halos : 0.170 s worker CPU, 2.627 s worker Wall, Wall: 3.514 s, Cores in use: 0.88, Total efficiency (on 8 cores): 11.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T19:34:39.101011 PSF sigmas in coadd pixels: ['2.03', '2.35', '2.10', '2.14'] Using average PSF sigma 2.155152718333559 Gaussian PSF norm 0.13089317957569332 vs pixelized 0.10253742 average tim pixel scale / coadd scale: 1.0011664968079936 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.77', '1.81', '1.93'] Using average PSF sigma 1.834987026619409 Gaussian PSF norm 0.15373121863078265 vs pixelized 0.13739273 average tim pixel scale / coadd scale: 1.0011782438693326 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.63', '2.36', '1.63'] Using average PSF sigma 1.8723402952230754 Gaussian PSF norm 0.15066427427406762 vs pixelized 0.1390198 average tim pixel scale / coadd scale: 1.0011113272759466 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.46 s, CPU: 0.20 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.448368 MB Stage fit_on_coadds finished: 2020-06-04T19:34:39.563516 Resources for stage fit_on_coadds : 0.261 s worker CPU, 0.261 s worker Wall, Wall: 0.464 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T19:34:39.566421 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 30 potential peaks Of 30 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 32 potential peaks Of 32 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 24 potential peaks Of 24 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 39 potential peaks Of 39 potential peaks: 29 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 45 potential peaks Of 45 potential peaks: 37 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 34 new sources Median coadd sky for g : 4.1241845e-05 Median coadd sky for r : 6.706379e-05 Median coadd sky for z : 0.00012941177 Stage srcs : Wall: 2.11 s, CPU: 2.07 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.448368 MB Stage srcs finished: 2020-06-04T19:34:41.680876 Resources for stage srcs : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 2.115 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/PGC1503648-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T19:34:41.694820 Blob 1 of 27, id: 8, sources: 5, size: 113x160, npix 10243, brick X: 109,222, Y: 83,243, one pixel: 174 83 Blob 2 of 27, id: 6, sources: 2, size: 67x64, npix 2757, brick X: 212,279, Y: 73,137, one pixel: 249 73 Blob 3 of 27, id: 9, sources: 3, size: 66x42, npix 1652, brick X: 6,72, Y: 93,135, one pixel: 51 93 Blob 4 of 27, id: 4, sources: 1, size: 32x43, npix 1064, brick X: 293,325, Y: 51,94, one pixel: 309 51 Blob 5 of 27, id: 20, sources: 1, size: 33x35, npix 769, brick X: 213,246, Y: 236,271, one pixel: 228 236 Blob 6 of 27, id: 2, sources: 2, size: 42x27, npix 626, brick X: 38,80, Y: 26,53, one pixel: 50 26 Blob 7 of 27, id: 3, sources: 2, size: 30x33, npix 610, brick X: 0,30, Y: 32,65, one pixel: 8 32 Blob 8 of 27, id: 13, sources: 1, size: 26x32, npix 588, brick X: 221,247, Y: 155,187, one pixel: 230 155 Blob 9 of 27, id: 10, sources: 1, size: 29x30, npix 576, brick X: 296,325, Y: 107,137, one pixel: 309 107 Blob 4 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.140928 MB Blob 10 of 27, id: 19, sources: 1, size: 27x31, npix 508, brick X: 69,96, Y: 235,266, one pixel: 80 235 Blob 9 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142572 MB Blob 11 of 27, id: 16, sources: 1, size: 29x29, npix 455, brick X: 264,293, Y: 209,238, one pixel: 281 209 Blob 6 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 12 of 27, id: 14, sources: 1, size: 25x26, npix 422, brick X: 288,313, Y: 170,196, one pixel: 299 170 Blob 5 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14636 MB Blob 13 of 27, id: 1, sources: 1, size: 25x25, npix 404, brick X: 198,223, Y: 10,35, one pixel: 208 10 Measuring 1 iterative sources Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142572 MB Blob 14 of 27, id: 24, sources: 1, size: 22x27, npix 383, brick X: 76,98, Y: 287,314, one pixel: 86 287 Measuring 1 iterative sources Blob 12 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148164 MB Blob 15 of 27, id: 5, sources: 1, size: 25x24, npix 373, brick X: 55,80, Y: 65,89, one pixel: 64 65 Blob 11 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 16 of 27, id: 18, sources: 1, size: 23x24, npix 330, brick X: 136,159, Y: 230,254, one pixel: 147 230 Blob 13 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142572 MB Blob 17 of 27, id: 11, sources: 1, size: 22x22, npix 291, brick X: 298,320, Y: 138,160, one pixel: 307 138 Blob 8 finished, total: Wall: 2.42 s, CPU: 2.39 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148992 MB Blob 18 of 27, id: 26, sources: 1, size: 24x17, npix 281, brick X: 207,231, Y: 308,325, one pixel: 218 308 Blob 17 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148992 MB Blob 19 of 27, id: 23, sources: 1, size: 22x21, npix 271, brick X: 291,313, Y: 286,307, one pixel: 302 286 Blob 15 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 20 of 27, id: 22, sources: 1, size: 20x21, npix 258, brick X: 255,275, Y: 271,292, one pixel: 264 271 Measuring 2 iterative sources Blob 3 finished, total: Wall: 2.89 s, CPU: 2.88 s, VmPeak: 956 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144264 MB Blob 21 of 27, id: 0, sources: 1, size: 21x19, npix 256, brick X: 123,144, Y: 0,19, one pixel: 129 0 Blob 19 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 22 of 27, id: 17, sources: 1, size: 21x21, npix 251, brick X: 294,315, Y: 222,243, one pixel: 303 222 Blob 7 finished, total: Wall: 3.06 s, CPU: 3.04 s, VmPeak: 962 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15028 MB Blob 23 of 27, id: 25, sources: 1, size: 21x18, npix 246, brick X: 232,253, Y: 307,325, one pixel: 241 307 Blob 14 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148164 MB Blob 24 of 27, id: 21, sources: 1, size: 20x21, npix 240, brick X: 26,46, Y: 246,267, one pixel: 35 246 Blob 20 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 956 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144492 MB Blob 25 of 27, id: 7, sources: 1, size: 14x23, npix 212, brick X: 0,14, Y: 79,102, one pixel: 4 79 Blob 16 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142572 MB Blob 26 of 27, id: 15, sources: 1, size: 20x19, npix 208, brick X: 118,138, Y: 190,209, one pixel: 127 190 Blob 24 finished, total: Wall: 0.10 s, CPU: 0.10 s, VmPeak: 956 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144492 MB Blob 27 of 27, id: 12, sources: 1, size: 20x19, npix 200, brick X: 64,84, Y: 150,169, one pixel: 73 150 Blob 22 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 962 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15028 MB Blob 23 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148164 MB Blob 27 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15028 MB Blob 18 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148992 MB Blob 26 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 956 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144492 MB Blob 21 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147936 MB Blob 25 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142572 MB Blob 2 finished, total: Wall: 4.69 s, CPU: 4.69 s, VmPeak: 956 MB, VmSize: 715 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145076 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.572106, ee1=0.365249, ee2=-0.14441 Measuring 1 iterative sources Blob 1 finished, total: Wall: 9.04 s, CPU: 9.03 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151656 MB Old catalog: 38 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/blobs-custom-167787p16221.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/metrics/cus/all-models-custom-167787p16221.fits Stage fitblobs : Wall: 11.16 s, CPU: 2.18 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.448368 MB Stage fitblobs finished: 2020-06-04T19:34:52.851633 Resources for stage fitblobs : 36.080 s worker CPU, 36.234 s worker Wall, Wall: 11.158 s, Cores in use: 3.43, Total efficiency (on 8 cores): 42.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T19:34:52.853647 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/tmp-legacysurvey-custom-167787p16221-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/tmp-legacysurvey-custom-167787p16221-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/tmp-legacysurvey-custom-167787p16221-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/tmp-legacysurvey-custom-167787p16221-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-resid.jpg Stage coadds : Wall: 3.71 s, CPU: 2.98 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.448368 MB Stage coadds finished: 2020-06-04T19:34:56.560730 Resources for stage coadds : 3.938 s worker CPU, 4.385 s worker Wall, Wall: 3.708 s, Cores in use: 1.87, Total efficiency (on 8 cores): 23.3 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T19:34:56.562413 Cut to 1 unWISE tiles Reading WISE tile 1682p166 band 3 Reading WISE tile 1682p166 band 2 Reading WISE tile 1682p166 band 1 Reading WISE tile 1682p166 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 958 MB, VmSize: 798 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.1916 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.20798 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210512 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/168/1682p166/unwise-1682p166-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 931 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.20682 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/tmp-legacysurvey-custom-167787p16221-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/tmp-legacysurvey-custom-167787p16221-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.07 s, CPU: 5.06 s, VmPeak: 1026 MB, VmSize: 1016 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.448368 MB Stage wise_forced finished: 2020-06-04T19:35:04.629477 Resources for stage wise_forced : 3.153 s worker CPU, 6.696 s worker Wall, Wall: 8.068 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T19:35:04.631522 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/coadd/cus/custom-167787p16221/legacysurvey-custom-167787p16221-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/tractor-i/cus/tractor-custom-167787p16221.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/tractor/cus/tractor-custom-167787p16221.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1503648/tractor/cus/brick-custom-167787p16221.sha256sum Stage writecat : Wall: 14.10 s, CPU: 4.60 s, VmPeak: 1149 MB, VmSize: 1021 MB, VmRSS: 214 MB, VmData: 238 MB, maxrss: 0.448368 MB Stage writecat finished: 2020-06-04T19:35:18.733308 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.103 s, Cores in use: 0.33, Total efficiency (on 8 cores): 4.1 % Stage writecat finished All done: 50.044 s worker CPU, 254.289 s worker Wall, Wall: 105.706 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.9 % Finished galaxy PGC1503648 in 1.893 minutes.