Started working on galaxy DR8-0292p145-482 at Sat Jun 6 19:50:39 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.376055895059633 14.402008599828152 --width 271 --height 271 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T19:50:39.906664 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.376055895059633', '14.402008599828152', '--width', '271', '--height', '271', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.376055895059633 14.402008599828152 --width 271 --height 271 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.376055895059633 14.402008599828152 Starting process 49413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 49414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 49415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 49416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T19:50:40.188611 Keeping 10 CCDs: c4d_181005_041704_ooi_r_ls9.fits.fz c4d_181005_041704_ooi_r_ls9-S9 r exptime 70.0 propid 2014B-0404 seeing 1.05 MJD 58396.179 object DECaLS_34031_r c4d_170920_074823_ooi_g_ls9.fits.fz c4d_170920_074823_ooi_g_ls9-S9 g exptime 200.0 propid 2014B-0404 seeing 1.72 MJD 58016.325 object DECaLS_34031_g c4d_171025_053734_ooi_g_ls9.fits.fz c4d_171025_053734_ooi_g_ls9-S10 g exptime 143.0 propid 2014B-0404 seeing 1.27 MJD 58051.234 object DECaLS_18159_g c4d_180726_100029_ooi_z_ls9.fits.fz c4d_180726_100029_ooi_z_ls9-S10 z exptime 126.0 propid 2014B-0404 seeing 1.32 MJD 58325.417 object DECaLS_18159_z c4d_171113_035937_ooi_r_ls9.fits.fz c4d_171113_035937_ooi_r_ls9-S10 r exptime 104.0 propid 2014B-0404 seeing 1.20 MJD 58070.166 object DECaLS_18159_r c4d_170921_064704_ooi_r_ls9.fits.fz c4d_170921_064704_ooi_r_ls9-S9 r exptime 156.0 propid 2014B-0404 seeing 1.72 MJD 58017.283 object DECaLS_34031_r c4d_181016_023352_ooi_z_ls9.fits.fz c4d_181016_023352_ooi_z_ls9-S9 z exptime 146.0 propid 2014B-0404 seeing 1.18 MJD 58407.107 object DECaLS_34031_z c4d_160722_094748_ooi_z_ls9.fits.fz c4d_160722_094748_ooi_z_ls9-S17 z exptime 80.0 propid 2016A-0190 seeing 0.95 MJD 57591.407 object DECaLS_2287_z c4d_171111_035012_ooi_g_ls9.fits.fz c4d_171111_035012_ooi_g_ls9-S17 g exptime 80.0 propid 2014B-0404 seeing 1.00 MJD 58068.160 object DECaLS_2287_g c4d_170917_074302_ooi_r_ls9.fits.fz c4d_170917_074302_ooi_r_ls9-S17 r exptime 64.0 propid 2014B-0404 seeing 1.10 MJD 58013.322 object DECaLS_2287_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170920T074823_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955edcd-z-20180726T100029_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T041704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952630f-g-20171025T053734_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T023352_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160722T094540_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527501-r-20171113T035937_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524507-r-20170921T064704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170917T074302_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9526dbd-g-20171111T035012_oi[S17,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 127.14 s, CPU: 0.74 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.454544 MB Stage tims finished: 2020-06-06T19:52:47.325878 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524a76-g-20170920T074823_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9527501-r-20171113T035937_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955edcd-z-20180726T100029_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524507-r-20170921T064704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953651d-r-20181005T041704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95316b1-z-20181016T023352_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9526dbd-g-20171111T035012_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952630f-g-20171025T053734_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b7a0-z-20160722T094540_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523d7d-r-20170917T074302_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 3.590 s worker CPU, 410.992 s worker Wall, Wall: 127.138 s, Cores in use: 0.03, Total efficiency (on 4 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T19:52:47.347586 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04554.fits Matched 10 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/reference-custom-029376p14402.fits Stage refs : Wall: 2.47 s, CPU: 1.20 s, VmPeak: 1026 MB, VmSize: 1008 MB, VmRSS: 190 MB, VmData: 222 MB, maxrss: 0.454544 MB Stage refs finished: 2020-06-06T19:52:49.820344 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.474 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T19:52:49.821827 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/outlier-mask-custom-029376p14402.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/outliers-pre-custom-029376p14402.jpg Image c4d_171111_035012_ooi_g_ls9-S17 g : masking 129 positive outlier pixels and 0 negative outlier pixels Image c4d_170921_064704_ooi_r_ls9-S9 r : masking 115 positive outlier pixels and 0 negative outlier pixels Image c4d_171113_035937_ooi_r_ls9-S10 r : masking 127 positive outlier pixels and 0 negative outlier pixels Image c4d_180726_100029_ooi_z_ls9-S10 z : masking 260 positive outlier pixels and 0 negative outlier pixels Image c4d_181016_023352_ooi_z_ls9-S9 z : masking 576 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/outlier-mask-custom-029376p14402.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/outliers-post-custom-029376p14402.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/outliers-masked-pos-custom-029376p14402.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/outliers-masked-neg-custom-029376p14402.jpg Stage outliers : Wall: 1.38 s, CPU: 0.60 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage outliers finished: 2020-06-06T19:52:51.201444 Resources for stage outliers : 0.991 s worker CPU, 0.993 s worker Wall, Wall: 1.381 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T19:52:51.203180 Stage halos : Wall: 0.96 s, CPU: 0.23 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage halos finished: 2020-06-06T19:52:52.164820 Resources for stage halos : 0.306 s worker CPU, 2.223 s worker Wall, Wall: 0.963 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.9 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-06T19:52:52.166784 PSF sigmas in coadd pixels: ['2.79', '2.06', '1.63'] Using average PSF sigma 2.1629052477329047 Gaussian PSF norm 0.13042401745040003 vs pixelized 0.104415506 average tim pixel scale / coadd scale: 1.0011658136455612 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.71', '1.95', '2.80', '1.79'] Using average PSF sigma 2.0615923837960817 Gaussian PSF norm 0.1368334468011796 vs pixelized 0.10879719 average tim pixel scale / coadd scale: 1.001208036416388 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.14', '1.92', '1.55'] Using average PSF sigma 1.8688357364057502 Gaussian PSF norm 0.1509468094378475 vs pixelized 0.12806518 average tim pixel scale / coadd scale: 1.0012242656897838 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 206 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage fit_on_coadds finished: 2020-06-06T19:52:52.365955 Resources for stage fit_on_coadds : 0.206 s worker CPU, 0.206 s worker Wall, Wall: 0.200 s, Cores in use: 1.97, Total efficiency (on 4 cores): 49.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-06T19:52:52.368496 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 17 potential peaks Of 17 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 11 kept SED z : 11 new peaks Found 17 potential peaks Of 17 potential peaks: 12 in veto map, 0 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 26 potential peaks Of 26 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 23 potential peaks Of 23 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 20 new sources Median coadd sky for g : -8.22399e-05 Median coadd sky for r : -8.619763e-05 Median coadd sky for z : -9.716681e-05 Stage srcs : Wall: 0.43 s, CPU: 0.39 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage srcs finished: 2020-06-06T19:52:52.802419 Resources for stage srcs : 0.114 s worker CPU, 0.122 s worker Wall, Wall: 0.435 s, Cores in use: 1.16, Total efficiency (on 4 cores): 29.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/DR8-0292p145-482-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T19:52:52.836827 Blob 1 of 18, id: 6, sources: 3, size: 93x89, npix 4677, brick X: 79,172, Y: 99,188, one pixel: 143 99 Blob 2 of 18, id: 9, sources: 2, size: 36x49, npix 1231, brick X: 173,209, Y: 132,181, one pixel: 189 132 Blob 3 of 18, id: 8, sources: 1, size: 30x30, npix 610, brick X: 19,49, Y: 111,141, one pixel: 32 111 Blob 4 of 18, id: 11, sources: 1, size: 25x31, npix 476, brick X: 211,236, Y: 182,213, one pixel: 225 182 Blob 5 of 18, id: 12, sources: 1, size: 26x26, npix 449, brick X: 4,30, Y: 190,216, one pixel: 15 190 Blob 3 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1467 MB Blob 6 of 18, id: 0, sources: 1, size: 26x25, npix 426, brick X: 163,189, Y: 16,41, one pixel: 173 16 Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146704 MB Blob 7 of 18, id: 13, sources: 1, size: 26x25, npix 414, brick X: 242,268, Y: 210,235, one pixel: 252 210 Blob 6 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148536 MB Blob 8 of 18, id: 14, sources: 1, size: 24x23, npix 339, brick X: 34,58, Y: 224,247, one pixel: 45 224 Blob 5 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1467 MB Blob 9 of 18, id: 15, sources: 1, size: 23x23, npix 318, brick X: 195,218, Y: 238,261, one pixel: 205 238 Blob 2 finished, total: Wall: 2.16 s, CPU: 2.16 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14892 MB Blob 10 of 18, id: 17, sources: 1, size: 24x19, npix 306, brick X: 30,54, Y: 252,271, one pixel: 40 252 Blob 7 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148536 MB Blob 11 of 18, id: 5, sources: 1, size: 23x22, npix 304, brick X: 241,264, Y: 86,108, one pixel: 251 86 Blob 8 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1467 MB Blob 12 of 18, id: 2, sources: 1, size: 22x22, npix 300, brick X: 93,115, Y: 30,52, one pixel: 102 30 Blob 9 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14892 MB Blob 13 of 18, id: 3, sources: 1, size: 22x22, npix 281, brick X: 220,242, Y: 44,66, one pixel: 229 44 Blob 11 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1467 MB Blob 14 of 18, id: 1, sources: 1, size: 22x21, npix 272, brick X: 120,142, Y: 21,42, one pixel: 129 21 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.170592, ee1=0.259735, ee2=0.106187 Measuring 1 iterative sources Blob 1 finished, total: Wall: 2.83 s, CPU: 2.82 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149576 MB Blob 15 of 18, id: 10, sources: 1, size: 20x22, npix 250, brick X: 40,60, Y: 178,200, one pixel: 49 178 Blob 10 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148536 MB Blob 16 of 18, id: 16, sources: 1, size: 20x21, npix 238, brick X: 144,164, Y: 242,263, one pixel: 153 242 Blob 14 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149576 MB Blob 17 of 18, id: 4, sources: 1, size: 19x19, npix 190, brick X: 87,106, Y: 64,83, one pixel: 96 64 Blob 13 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1467 MB Blob 18 of 18, id: 7, sources: 1, size: 18x19, npix 189, brick X: 77,95, Y: 109,128, one pixel: 86 109 Blob 15 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148536 MB Blob 12 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14892 MB Blob 18 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148536 MB Blob 16 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149576 MB Blob 17 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1467 MB Old catalog: 24 New catalog: 20 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/blobs-custom-029376p14402.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/metrics/cus/all-models-custom-029376p14402.fits Stage fitblobs : Wall: 4.37 s, CPU: 0.30 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage fitblobs finished: 2020-06-06T19:52:57.207995 Resources for stage fitblobs : 14.605 s worker CPU, 14.636 s worker Wall, Wall: 4.372 s, Cores in use: 3.41, Total efficiency (on 4 cores): 85.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T19:52:57.209442 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/tmp-legacysurvey-custom-029376p14402-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/tmp-legacysurvey-custom-029376p14402-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/tmp-legacysurvey-custom-029376p14402-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/tmp-legacysurvey-custom-029376p14402-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-resid.jpg Stage coadds : Wall: 1.17 s, CPU: 0.54 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage coadds finished: 2020-06-06T19:52:58.382580 Resources for stage coadds : 1.954 s worker CPU, 2.059 s worker Wall, Wall: 1.174 s, Cores in use: 2.13, Total efficiency (on 4 cores): 53.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T19:52:58.383965 Cut to 2 unWISE tiles Reading WISE tile 0294p136 band 1 Reading WISE tile 0294p136 band 3 Reading WISE tile 0294p136 band 2 Reading WISE tile 0294p136 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0297p151 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0297p151 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0297p151 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0294p136/unwise-0294p136-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0297p151 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 800 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.189152 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20574 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209824 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297p151/unwise-0297p151-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 958 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.205012 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/tmp-legacysurvey-custom-029376p14402-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/tmp-legacysurvey-custom-029376p14402-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.71 s, CPU: 0.35 s, VmPeak: 1026 MB, VmSize: 1018 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage wise_forced finished: 2020-06-06T19:53:05.095269 Resources for stage wise_forced : 6.440 s worker CPU, 16.306 s worker Wall, Wall: 6.712 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T19:53:05.096840 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/coadd/cus/custom-029376p14402/legacysurvey-custom-029376p14402-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/tractor-i/cus/tractor-custom-029376p14402.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/tractor/cus/tractor-custom-029376p14402.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/DR8-0292p145-482/tractor/cus/brick-custom-029376p14402.sha256sum Stage writecat : Wall: 1.61 s, CPU: 0.33 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.454544 MB Stage writecat finished: 2020-06-06T19:53:06.707398 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.612 s, Cores in use: 0.21, Total efficiency (on 4 cores): 5.2 % Stage writecat finished All done: 28.208 s worker CPU, 447.539 s worker Wall, Wall: 146.528 s, Cores in use: 0.23, Total efficiency (on 4 cores): 5.6 % Finished galaxy DR8-0292p145-482 in 2.464 minutes.