Started working on galaxy PGC1616680 at Sun Jun 7 06:21:16 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.405327 20.1094997 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T06:21:16.851806 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '228.405327', '20.1094997', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.405327 20.1094997 --width 239 --height 239 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 228.405327 20.1094997 Starting process 12048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 12049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 12050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 12051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T06:21:19.270322 Keeping 11 CCDs: c4d_170723_003244_ooi_r_ls9.fits.fz c4d_170723_003244_ooi_r_ls9-S10 r exptime 125.0 propid 2014B-0404 seeing 2.14 MJD 57957.021 object DECaLS_31919_r c4d_180316_090311_ooi_g_ls9.fits.fz c4d_180316_090311_ooi_g_ls9-S10 g exptime 142.0 propid 2014B-0404 seeing 1.26 MJD 58193.377 object DECaLS_31919_g c4d_180517_033250_ooi_r_ls9.fits.fz c4d_180517_033250_ooi_r_ls9-S10 r exptime 42.0 propid 2014B-0404 seeing 1.14 MJD 58255.148 object DECaLS_31919_r c4d_180809_231430_ooi_z_ls9.fits.fz c4d_180809_231430_ooi_z_ls9-S10 z exptime 120.0 propid 2014B-0404 seeing 0.97 MJD 58339.968 object DECaLS_31919_z c4d_170514_060030_ooi_z_ls9.fits.fz c4d_170514_060030_ooi_z_ls9-S10 z exptime 250.0 propid 2014B-0404 seeing 1.69 MJD 57887.247 object DECaLS_31919_z c4d_160802_232451_ooi_z_ls9.fits.fz c4d_160802_232451_ooi_z_ls9-S11 z exptime 80.0 propid 2014B-0404 seeing 1.15 MJD 57602.974 object DECaLS_16047_z c4d_160609_023445_ooi_g_ls9.fits.fz c4d_160609_023445_ooi_g_ls9-S11 g exptime 92.0 propid 2014B-0404 seeing 1.74 MJD 57548.106 object DECaLS_16047_g c4d_160609_023245_ooi_r_ls9.fits.fz c4d_160609_023245_ooi_r_ls9-S11 r exptime 54.0 propid 2014B-0404 seeing 1.40 MJD 57548.105 object DECaLS_16047_r c4d_170327_090233_ooi_r_ls9.fits.fz c4d_170327_090233_ooi_r_ls9-S12 r exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 57839.376 object DECaLS_175_r c4d_170328_083053_ooi_g_ls9.fits.fz c4d_170328_083053_ooi_g_ls9-S12 g exptime 175.0 propid 2014B-0404 seeing 1.44 MJD 57840.352 object DECaLS_175_g c4d_150409_064945_ooi_z_ls9.fits.fz c4d_150409_064945_ooi_z_ls9-S12 z exptime 80.0 propid 2014B-0404 seeing 0.91 MJD 57121.283 object DECaLS_175_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180517T033250_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952dda8-g-20180316T090311_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170723T002946_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f18d-z-20180809T231430_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160802T232241_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566081-g-20160609T023223_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95164f7-z-20170514T055527_oi[S10,noinherit][2046,4094][real]: DECaLS_ Swapping in SKY_JOHN values for 1 splinesky cells; 9109.944 -> 9107.335 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T023101_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95120a3-r-20170327T090103_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951364f-g-20170328T082707_oi[S12,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T064736_oi[S12,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 89.90 s, CPU: 3.66 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.454936 MB Stage tims finished: 2020-06-07T06:22:49.171071 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f18d-z-20180809T231430_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T023101_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e8b1-r-20170723T002946_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566081-g-20160609T023223_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951364f-g-20170328T082707_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560631-r-20180517T033250_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95164f7-z-20170514T055527_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T064736_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952dda8-g-20180316T090311_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160802T232241_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95120a3-r-20170327T090103_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.053 s worker CPU, 325.637 s worker Wall, Wall: 89.902 s, Cores in use: 0.09, Total efficiency (on 4 cores): 2.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T06:22:49.256807 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04113.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03985.fits Matched 10 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/reference-custom-228405p20109.fits Stage refs : Wall: 5.91 s, CPU: 5.67 s, VmPeak: 1026 MB, VmSize: 1013 MB, VmRSS: 193 MB, VmData: 226 MB, maxrss: 0.454936 MB Stage refs finished: 2020-06-07T06:22:55.171125 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.915 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T06:22:55.172615 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/outlier-mask-custom-228405p20109.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/outliers-pre-custom-228405p20109.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/outlier-mask-custom-228405p20109.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/outliers-post-custom-228405p20109.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/outliers-masked-pos-custom-228405p20109.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/outliers-masked-neg-custom-228405p20109.jpg Stage outliers : Wall: 5.30 s, CPU: 5.06 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.454936 MB Stage outliers finished: 2020-06-07T06:23:00.472255 Resources for stage outliers : 0.813 s worker CPU, 0.818 s worker Wall, Wall: 5.301 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T06:23:00.473896 Stage halos : Wall: 9.86 s, CPU: 5.00 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.454936 MB Stage halos finished: 2020-06-07T06:23:10.335029 Resources for stage halos : 0.187 s worker CPU, 12.588 s worker Wall, Wall: 9.862 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.2 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T06:23:10.336930 PSF sigmas in coadd pixels: ['2.05', '2.83', '2.35'] Using average PSF sigma 2.4086645435345453 Gaussian PSF norm 0.11711667883811001 vs pixelized 0.10338635 average tim pixel scale / coadd scale: 1.0012177006654328 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.48', '1.86', '2.27', '1.40'] Using average PSF sigma 2.2519566598967016 Gaussian PSF norm 0.12526652790325815 vs pixelized 0.09565617 average tim pixel scale / coadd scale: 1.0012002383671588 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.58', '2.74', '1.87', '1.48'] Using average PSF sigma 1.9166662945276929 Gaussian PSF norm 0.14717991993665872 vs pixelized 0.11992287 average tim pixel scale / coadd scale: 1.001125082168337 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.17 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 208 MB, VmData: 238 MB, maxrss: 0.454936 MB Stage fit_on_coadds finished: 2020-06-07T06:23:10.527932 Resources for stage fit_on_coadds : 0.151 s worker CPU, 0.152 s worker Wall, Wall: 0.192 s, Cores in use: 1.67, Total efficiency (on 4 cores): 41.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T06:23:10.530577 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 9 potential peaks Of 9 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 9 potential peaks Of 9 potential peaks: 8 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 12 potential peaks Of 12 potential peaks: 8 in veto map, 0 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 16 potential peaks Of 16 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 17 potential peaks Of 17 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 16 new sources Median coadd sky for g : -5.4595606e-05 Median coadd sky for r : -6.647916e-05 Median coadd sky for z : 3.4599878e-05 Stage srcs : Wall: 4.33 s, CPU: 4.29 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.454936 MB Stage srcs finished: 2020-06-07T06:23:14.858945 Resources for stage srcs : 0.087 s worker CPU, 0.089 s worker Wall, Wall: 4.329 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/PGC1616680-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T06:23:14.910549 Blob 1 of 14, id: 2, sources: 4, size: 124x108, npix 7334, brick X: 65,189, Y: 61,169, one pixel: 94 61 Blob 2 of 14, id: 8, sources: 1, size: 36x36, npix 878, brick X: 17,53, Y: 163,199, one pixel: 29 163 Blob 3 of 14, id: 5, sources: 1, size: 28x26, npix 461, brick X: 8,36, Y: 123,149, one pixel: 19 123 Blob 4 of 14, id: 4, sources: 1, size: 26x25, npix 447, brick X: 213,239, Y: 106,131, one pixel: 222 106 Blob 5 of 14, id: 1, sources: 1, size: 25x27, npix 439, brick X: 145,170, Y: 30,57, one pixel: 158 30 Blob 3 finished, total: Wall: 1.07 s, CPU: 0.70 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14512 MB Blob 6 of 14, id: 13, sources: 1, size: 27x19, npix 369, brick X: 145,172, Y: 220,239, one pixel: 157 220 Blob 4 finished, total: Wall: 1.47 s, CPU: 1.07 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145124 MB Blob 7 of 14, id: 6, sources: 1, size: 22x25, npix 357, brick X: 193,215, Y: 125,150, one pixel: 203 125 Blob 5 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14512 MB Blob 8 of 14, id: 9, sources: 1, size: 25x22, npix 338, brick X: 155,180, Y: 179,201, one pixel: 165 179 Blob 2 finished, total: Wall: 1.81 s, CPU: 1.49 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147352 MB Blob 9 of 14, id: 3, sources: 1, size: 23x23, npix 315, brick X: 169,192, Y: 61,84, one pixel: 178 61 Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145124 MB Blob 10 of 14, id: 7, sources: 1, size: 19x24, npix 303, brick X: 220,239, Y: 155,179, one pixel: 230 155 Blob 7 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14512 MB Blob 11 of 14, id: 12, sources: 1, size: 21x22, npix 281, brick X: 209,230, Y: 217,239, one pixel: 218 217 Blob 8 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147352 MB Blob 12 of 14, id: 10, sources: 1, size: 20x20, npix 256, brick X: 108,128, Y: 183,203, one pixel: 116 183 Blob 9 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145124 MB Blob 13 of 14, id: 0, sources: 1, size: 20x20, npix 219, brick X: 18,38, Y: 2,22, one pixel: 28 2 Blob 12 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145124 MB Blob 14 of 14, id: 11, sources: 1, size: 17x17, npix 145, brick X: 190,207, Y: 212,229, one pixel: 198 212 Blob 11 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147352 MB Blob 14 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147352 MB Blob 10 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14512 MB Blob 13 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145124 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.24032, ee1=-0.208045, ee2=-0.655433 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.02 s, CPU: 5.02 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147928 MB Old catalog: 19 New catalog: 17 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/blobs-custom-228405p20109.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/metrics/cus/all-models-custom-228405p20109.fits Stage fitblobs : Wall: 7.83 s, CPU: 2.81 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.454936 MB Stage fitblobs finished: 2020-06-07T06:23:22.742322 Resources for stage fitblobs : 14.546 s worker CPU, 15.788 s worker Wall, Wall: 7.833 s, Cores in use: 2.22, Total efficiency (on 4 cores): 55.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T06:23:22.744034 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/tmp-legacysurvey-custom-228405p20109-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/tmp-legacysurvey-custom-228405p20109-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/tmp-legacysurvey-custom-228405p20109-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/tmp-legacysurvey-custom-228405p20109-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-resid.jpg Stage coadds : Wall: 3.82 s, CPU: 3.14 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.454936 MB Stage coadds finished: 2020-06-07T06:23:26.564868 Resources for stage coadds : 2.192 s worker CPU, 2.277 s worker Wall, Wall: 3.822 s, Cores in use: 1.39, Total efficiency (on 4 cores): 34.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T06:23:26.566234 Cut to 1 unWISE tiles Reading WISE tile 2288p196 band 1 Reading WISE tile 2288p196 band 2 Reading WISE tile 2288p196 band 3 Reading WISE tile 2288p196 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 963 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206164 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 961 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.191012 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210108 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/228/2288p196/unwise-2288p196-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 952 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.205084 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/tmp-legacysurvey-custom-228405p20109-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/tmp-legacysurvey-custom-228405p20109-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.80 s, CPU: 2.37 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.454936 MB Stage wise_forced finished: 2020-06-07T06:23:34.363370 Resources for stage wise_forced : 3.311 s worker CPU, 10.429 s worker Wall, Wall: 7.798 s, Cores in use: 0.73, Total efficiency (on 4 cores): 18.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T06:23:34.364957 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/coadd/cus/custom-228405p20109/legacysurvey-custom-228405p20109-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/tractor-i/cus/tractor-custom-228405p20109.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/tractor/cus/tractor-custom-228405p20109.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/PGC1616680/tractor/cus/brick-custom-228405p20109.sha256sum Stage writecat : Wall: 2.96 s, CPU: 2.81 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 209 MB, VmData: 234 MB, maxrss: 0.454936 MB Stage writecat finished: 2020-06-07T06:23:37.329793 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.966 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 % Stage writecat finished All done: 25.342 s worker CPU, 367.778 s worker Wall, Wall: 138.064 s, Cores in use: 0.44, Total efficiency (on 4 cores): 10.9 % Finished galaxy PGC1616680 in 2.369 minutes.