Started working on galaxy PGC2001820 at Sun Jun 7 13:16:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.054583 32.5453889 --width 369 --height 369 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T13:16:02.116400 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '32.054583', '32.5453889', '--width', '369', '--height', '369', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.054583 32.5453889 --width 369 --height 369 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 32.054583 32.5453889 Starting process 22022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 22023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 22024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 22025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T13:16:08.594969 Keeping 6 CCDs: c4d_181103_040322_ooi_g_ls9.fits.fz c4d_181103_040322_ooi_g_ls9-N10 g exptime 200.0 propid 2014B-0404 seeing 1.43 MJD 58425.169 object DECaLS_4977_g c4d_181002_055652_ooi_z_ls9.fits.fz c4d_181002_055652_ooi_z_ls9-N10 z exptime 84.0 propid 2014B-0404 seeing 1.17 MJD 58393.248 object DECaLS_4977_z c4d_181103_040130_ooi_r_ls9.fits.fz c4d_181103_040130_ooi_r_ls9-N10 r exptime 82.0 propid 2014B-0404 seeing 1.35 MJD 58425.168 object DECaLS_4977_r c4d_181103_042223_ooi_g_ls9.fits.fz c4d_181103_042223_ooi_g_ls9-N19 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58425.182 object DECaLS_36699_g c4d_181110_030958_ooi_r_ls9.fits.fz c4d_181110_030958_ooi_r_ls9-N19 r exptime 130.0 propid 2014B-0404 seeing 1.79 MJD 58432.132 object DECaLS_36699_r c4d_181104_050350_ooi_z_ls9.fits.fz c4d_181104_050350_ooi_z_ls9-N19 z exptime 93.0 propid 2014B-0404 seeing 1.36 MJD 58426.211 object DECaLS_36699_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T040322_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T055652_oi[N10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030958_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181104T050350_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T042223_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T040130_oi[N10,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 114.96 s, CPU: 6.76 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.454952 MB Stage tims finished: 2020-06-07T13:18:03.554808 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T040322_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953829b-r-20181110T030958_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T055652_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181104T050350_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T042223_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 2.857 s worker CPU, 290.381 s worker Wall, Wall: 114.961 s, Cores in use: 0.08, Total efficiency (on 4 cores): 2.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181103T040130_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-07T13:18:03.573343 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02891.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02763.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/reference-custom-032054p32545.fits Stage refs : Wall: 9.38 s, CPU: 9.09 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.454952 MB Stage refs finished: 2020-06-07T13:18:12.952003 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.380 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T13:18:12.953249 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/outlier-mask-custom-032054p32545.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/outliers-pre-custom-032054p32545.jpg Image c4d_181103_040322_ooi_g_ls9-N10 g : masking 169 positive outlier pixels and 0 negative outlier pixels Image c4d_181103_042223_ooi_g_ls9-N19 g : masking 722 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_030958_ooi_r_ls9-N19 r : masking 199 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/outlier-mask-custom-032054p32545.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/outliers-post-custom-032054p32545.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/outliers-masked-pos-custom-032054p32545.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/outliers-masked-neg-custom-032054p32545.jpg Stage outliers : Wall: 6.97 s, CPU: 6.54 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.454952 MB Stage outliers finished: 2020-06-07T13:18:19.918955 Resources for stage outliers : 1.042 s worker CPU, 1.069 s worker Wall, Wall: 6.967 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T13:18:19.920477 Stage halos : Wall: 7.29 s, CPU: 5.21 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.454952 MB Stage halos finished: 2020-06-07T13:18:27.213376 Resources for stage halos : 0.350 s worker CPU, 6.640 s worker Wall, Wall: 7.294 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.1 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T13:18:27.215064 PSF sigmas in coadd pixels: ['2.32', '2.69'] Using average PSF sigma 2.5057963974058737 Gaussian PSF norm 0.11257690052787882 vs pixelized 0.1022547 average tim pixel scale / coadd scale: 1.0014464267803256 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.19', '2.91'] Using average PSF sigma 2.5522146491122695 Gaussian PSF norm 0.11052941486406659 vs pixelized 0.094030306 average tim pixel scale / coadd scale: 1.0014682713156666 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.91', '2.22'] Using average PSF sigma 2.0604214178747857 Gaussian PSF norm 0.13691121113701285 vs pixelized 0.118783616 average tim pixel scale / coadd scale: 1.0014642223285668 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.20 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.454952 MB Stage fit_on_coadds finished: 2020-06-07T13:18:27.460278 Resources for stage fit_on_coadds : 0.247 s worker CPU, 0.271 s worker Wall, Wall: 0.246 s, Cores in use: 1.83, Total efficiency (on 4 cores): 45.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T13:18:27.462322 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 5 in veto map, 2 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 63 potential peaks Of 63 potential peaks: 50 in veto map, 8 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 70 potential peaks Of 70 potential peaks: 53 in veto map, 8 cut by saddle test, 0 cut by aper test, 9 kept SED g : 9 new peaks Found 89 potential peaks Of 89 potential peaks: 70 in veto map, 11 cut by saddle test, 1 cut by aper test, 7 kept SED Flat : 7 new peaks Found 97 potential peaks Of 97 potential peaks: 85 in veto map, 11 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 38 new sources Median coadd sky for g : 0.00012373936 Median coadd sky for r : 0.00018021704 Median coadd sky for z : 0.00038078602 Stage srcs : Wall: 8.04 s, CPU: 7.97 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.454952 MB Stage srcs finished: 2020-06-07T13:18:35.506742 Resources for stage srcs : 0.199 s worker CPU, 0.200 s worker Wall, Wall: 8.045 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/PGC2001820-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T13:18:41.410503 Blob 1 of 23, id: 6, sources: 16, size: 211x235, npix 29342, brick X: 96,307, Y: 67,302, one pixel: 151 67 Blob 2 of 23, id: 4, sources: 1, size: 41x41, npix 1206, brick X: 22,63, Y: 22,63, one pixel: 38 22 Blob 3 of 23, id: 17, sources: 1, size: 35x36, npix 860, brick X: 329,364, Y: 299,335, one pixel: 344 299 Blob 4 of 23, id: 3, sources: 2, size: 38x41, npix 833, brick X: 323,361, Y: 16,57, one pixel: 345 16 Blob 5 of 23, id: 16, sources: 1, size: 38x34, npix 818, brick X: 135,173, Y: 297,331, one pixel: 148 297 Blob 2 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149136 MB Blob 6 of 23, id: 12, sources: 2, size: 41x36, npix 784, brick X: 21,62, Y: 234,270, one pixel: 31 234 Blob 4 finished, total: Wall: 1.83 s, CPU: 1.45 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148108 MB Blob 7 of 23, id: 18, sources: 1, size: 34x32, npix 729, brick X: 100,134, Y: 303,335, one pixel: 114 303 Blob 3 finished, total: Wall: 2.23 s, CPU: 1.84 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Blob 8 of 23, id: 8, sources: 2, size: 30x41, npix 690, brick X: 28,58, Y: 111,152, one pixel: 43 111 Blob 6 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 9 of 23, id: 10, sources: 1, size: 29x30, npix 577, brick X: 20,49, Y: 155,185, one pixel: 31 155 Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151268 MB Blob 10 of 23, id: 20, sources: 1, size: 30x29, npix 474, brick X: 194,224, Y: 322,351, one pixel: 212 322 Blob 7 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Blob 11 of 23, id: 5, sources: 1, size: 25x26, npix 433, brick X: 203,228, Y: 37,63, one pixel: 214 37 Blob 9 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151268 MB Blob 12 of 23, id: 19, sources: 1, size: 26x28, npix 422, brick X: 9,35, Y: 319,347, one pixel: 21 319 Measuring 1 iterative sources Blob 8 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 13 of 23, id: 11, sources: 1, size: 26x25, npix 393, brick X: 91,117, Y: 203,228, one pixel: 102 203 Blob 11 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151268 MB Blob 14 of 23, id: 14, sources: 1, size: 23x24, npix 337, brick X: 182,205, Y: 284,308, one pixel: 193 284 Blob 10 finished, total: Wall: 1.72 s, CPU: 1.72 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Blob 15 of 23, id: 1, sources: 1, size: 25x19, npix 335, brick X: 298,323, Y: 0,19, one pixel: 303 0 Blob 14 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Blob 16 of 23, id: 21, sources: 1, size: 20x24, npix 309, brick X: 303,323, Y: 334,358, one pixel: 312 334 Blob 12 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 17 of 23, id: 15, sources: 1, size: 22x22, npix 303, brick X: 12,34, Y: 285,307, one pixel: 21 285 Blob 16 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 18 of 23, id: 0, sources: 1, size: 23x19, npix 286, brick X: 255,278, Y: 0,19, one pixel: 261 0 Blob 15 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Blob 19 of 23, id: 7, sources: 1, size: 22x21, npix 280, brick X: 343,365, Y: 99,120, one pixel: 352 99 Blob 13 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151268 MB Blob 20 of 23, id: 13, sources: 1, size: 21x22, npix 271, brick X: 86,107, Y: 241,263, one pixel: 95 241 Blob 17 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 21 of 23, id: 2, sources: 1, size: 21x22, npix 260, brick X: 226,247, Y: 15,37, one pixel: 236 15 Blob 18 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Blob 22 of 23, id: 22, sources: 1, size: 20x16, npix 209, brick X: 79,99, Y: 353,369, one pixel: 87 353 Blob 19 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151268 MB Blob 23 of 23, id: 9, sources: 1, size: 19x19, npix 199, brick X: 72,91, Y: 114,133, one pixel: 81 114 Blob 20 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 23 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150024 MB Blob 22 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 960 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151268 MB Blob 21 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 942 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.15076 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.64466, ee1=0.290219, ee2=-0.329688 Measuring 4 iterative sources Blob 1 finished, total: Wall: 16.09 s, CPU: 15.66 s, VmPeak: 963 MB, VmSize: 709 MB, VmRSS: 141 MB, VmData: 172 MB, maxrss: 0.1704 MB Old catalog: 46 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/blobs-custom-032054p32545.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/metrics/cus/all-models-custom-032054p32545.fits Stage fitblobs : Wall: 25.36 s, CPU: 9.04 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 227 MB, VmData: 254 MB, maxrss: 0.454952 MB Stage fitblobs finished: 2020-06-07T13:19:06.767202 Resources for stage fitblobs : 35.284 s worker CPU, 36.532 s worker Wall, Wall: 25.358 s, Cores in use: 1.75, Total efficiency (on 4 cores): 43.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T13:19:06.769211 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/tmp-legacysurvey-custom-032054p32545-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/tmp-legacysurvey-custom-032054p32545-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/tmp-legacysurvey-custom-032054p32545-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/tmp-legacysurvey-custom-032054p32545-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-resid.jpg Stage coadds : Wall: 9.22 s, CPU: 7.57 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.454952 MB Stage coadds finished: 2020-06-07T13:19:15.987174 Resources for stage coadds : 3.077 s worker CPU, 3.188 s worker Wall, Wall: 9.219 s, Cores in use: 1.16, Total efficiency (on 4 cores): 28.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T13:19:15.988894 Cut to 2 unWISE tiles Reading WISE tile 0317p318 band 3 Reading WISE tile 0317p318 band 1 Reading WISE tile 0317p318 band 2 Reading WISE tile 0317p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0323p333 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0323p333 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0323p333 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 963 MB, VmSize: 804 MB, VmRSS: 158 MB, VmData: 182 MB, maxrss: 0.201288 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 942 MB, VmSize: 794 MB, VmRSS: 150 MB, VmData: 172 MB, maxrss: 0.21242 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 960 MB, VmSize: 797 MB, VmRSS: 153 MB, VmData: 176 MB, maxrss: 0.212168 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0317p318/unwise-0317p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0323p333 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/032/0323p333/unwise-0323p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 942 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 172 MB, maxrss: 0.21174 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/tmp-legacysurvey-custom-032054p32545-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/tmp-legacysurvey-custom-032054p32545-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 13.77 s, CPU: 6.31 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.454952 MB Stage wise_forced finished: 2020-06-07T13:19:29.757218 Resources for stage wise_forced : 7.472 s worker CPU, 16.683 s worker Wall, Wall: 13.770 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T13:19:29.759140 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/coadd/cus/custom-032054p32545/legacysurvey-custom-032054p32545-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/tractor-i/cus/tractor-custom-032054p32545.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/tractor/cus/tractor-custom-032054p32545.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC2001820/tractor/cus/brick-custom-032054p32545.sha256sum Stage writecat : Wall: 11.11 s, CPU: 5.84 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 232 MB, VmData: 257 MB, maxrss: 0.454952 MB Stage writecat finished: 2020-06-07T13:19:40.870814 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.113 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.1 % Stage writecat finished All done: 50.530 s worker CPU, 354.965 s worker Wall, Wall: 212.280 s, Cores in use: 0.54, Total efficiency (on 4 cores): 13.6 % Finished galaxy PGC2001820 in 3.666 minutes.