Started working on galaxy PGC2109409 at Sun Jun 7 16:54:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.638541 37.783287 --width 329 --height 329 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T16:54:48.593923 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '282.638541', '37.783287', '--width', '329', '--height', '329', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 282.638541 37.783287 --width 329 --height 329 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 282.638541 37.783287 Starting process 3327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 3328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 3329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 3330 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T16:54:49.119607 Keeping 6 CCDs: k4m_160508_111814_ooi_zd_ls9.fits.fz k4m_160508_111814_ooi_zd_ls9-CCD4 z exptime 134.103 propid 2016A-0453 seeing 1.22 MJD 57516.471 object MzLS_592549_z k4m_160505_113017_ooi_zd_ls9.fits.fz k4m_160505_113017_ooi_zd_ls9-CCD3 z exptime 85.104 propid 2016A-0453 seeing 1.07 MJD 57513.479 object MzLS_594530_z ksb_160602_093042_ooi_g_ls9.fits.fz ksb_160602_093042_ooi_g_ls9-CCD4 g exptime 165.0 propid BASS seeing 1.16 MJD 57541.396 object 61402 ksb_160514_103127_ooi_r_ls9.fits.fz ksb_160514_103127_ooi_r_ls9-CCD4 r exptime 66.2 propid BASS seeing 1.04 MJD 57522.439 object 61402 ksb_180516_092302_ooi_g_ls9.fits.fz ksb_180516_092302_ooi_g_ls9-CCD1 g exptime 103.959 propid NOTBASS seeing 1.49 MJD 58254.391 object 61403 ksb_180518_082959_ooi_r_ls9.fits.fz ksb_180518_082959_ooi_r_ls9-CCD1 r exptime 183.504 propid NOTBASS seeing 1.88 MJD 58256.354 object 61403 mosaic get_fwhm: self.fwhm = 4.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1588 1922 and amp range 0 2047 and image y 1681 2013 and amp range 0 2021 Range in image: x 0 335 , y 0 333 (with image size 335 x 333) dzp 0.005139143 -> scaling image by 1.0047445456970268 Faked up EXPNUM 75220172 Faked up EXPNUM 75220172 Faked up EXPNUM 75220172 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3555 3748 and amp range 2016 4031 and image y 1676 1868 and amp range 0 2047 Range in image: x 0 194 , y 0 193 (with image size 194 x 193) dzp 0.0047082007 -> scaling image by 1.0043458289369953 mosaic get_fwhm: self.fwhm = 4.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 453 789 and amp range 0 2005 and image y 722 1057 and amp range 0 2039 Range in image: x 0 337 , y 0 336 (with image size 337 x 336) dzp -0.005856539 -> scaling image by 0.9946204500110131 Faked up EXPNUM 75410150 Faked up EXPNUM 75410150 Faked up EXPNUM 75410150 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3556 3750 and amp range 2016 4031 and image y 1642 1834 and amp range 0 2047 Range in image: x 0 195 , y 0 193 (with image size 195 x 193) dzp 0.010226944 -> scaling image by 1.0094638657706572 Faked up EXPNUM 82540151 Faked up EXPNUM 82540151 Faked up EXPNUM 82540151 90prime get_fwhm: self.fwhm = 3.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3729 3922 and amp range 2016 4031 and image y 2116 2309 and amp range 2048 4095 Range in image: x 0 194 , y 0 194 (with image size 194 x 194) dzp 0.016257986 -> scaling image by 1.01508683329102 Faked up EXPNUM 82560154 Faked up EXPNUM 82560154 Faked up EXPNUM 82560154 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3717 3909 and amp range 2016 4031 and image y 2125 2318 and amp range 2048 4095 Range in image: x 0 193 , y 0 194 (with image size 193 x 194) dzp 0.015744466 -> scaling image by 1.0146068417155982 Stage tims : Wall: 4.94 s, CPU: 0.93 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.566512 MB Stage tims finished: 2020-06-07T16:54:54.054590 Resources for stage tims : 2.739 s worker CPU, 10.764 s worker Wall, Wall: 4.936 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T16:54:54.070636 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02468.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02340.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02469.fits Matched 0 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/reference-custom-282638p37783.fits Stage refs : Wall: 11.70 s, CPU: 10.95 s, VmPeak: 1074 MB, VmSize: 1068 MB, VmRSS: 301 MB, VmData: 331 MB, maxrss: 0.566512 MB Stage refs finished: 2020-06-07T16:55:05.771638 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.702 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T16:55:05.773110 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/outlier-mask-custom-282638p37783.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/outliers-pre-custom-282638p37783.jpg Image ksb_180516_092302_ooi_g_ls9-CCD1 g : masking 81 positive outlier pixels and 0 negative outlier pixels Image ksb_180518_082959_ooi_r_ls9-CCD1 r : masking 1527 positive outlier pixels and 0 negative outlier pixels Image k4m_160508_111814_ooi_zd_ls9-CCD4 z : masking 154 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/outlier-mask-custom-282638p37783.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/outliers-post-custom-282638p37783.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/outliers-masked-pos-custom-282638p37783.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/outliers-masked-neg-custom-282638p37783.jpg Stage outliers : Wall: 1.05 s, CPU: 0.67 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 315 MB, VmData: 344 MB, maxrss: 0.566512 MB Stage outliers finished: 2020-06-07T16:55:06.818472 Resources for stage outliers : 0.832 s worker CPU, 0.837 s worker Wall, Wall: 1.046 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T16:55:06.820073 Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 315 MB, VmData: 344 MB, maxrss: 0.566512 MB Stage halos finished: 2020-06-07T16:55:07.115735 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.297 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.4 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T16:55:07.117369 PSF sigmas in coadd pixels: ['1.88', '2.42'] Using average PSF sigma 2.1495429332213476 Gaussian PSF norm 0.13123477899142277 vs pixelized 0.10924701 average tim pixel scale / coadd scale: 1.7299421352888849 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '3.06'] Using average PSF sigma 2.3704317973874707 Gaussian PSF norm 0.11900565630480656 vs pixelized 0.08746414 average tim pixel scale / coadd scale: 1.729966629161464 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.98', '1.73'] Using average PSF sigma 1.8553316787423246 Gaussian PSF norm 0.15204547790888906 vs pixelized 0.12513824 average tim pixel scale / coadd scale: 0.9909166609210793 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.17 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 318 MB, VmData: 345 MB, maxrss: 0.566512 MB Stage fit_on_coadds finished: 2020-06-07T16:55:07.320121 Resources for stage fit_on_coadds : 0.152 s worker CPU, 0.153 s worker Wall, Wall: 0.204 s, Cores in use: 1.60, Total efficiency (on 4 cores): 40.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T16:55:07.322355 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 75 potential peaks Of 75 potential peaks: 25 in veto map, 13 cut by saddle test, 0 cut by aper test, 37 kept SED z : 37 new peaks Found 38 potential peaks Of 38 potential peaks: 36 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 40 potential peaks Of 40 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 57 potential peaks Of 57 potential peaks: 49 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 67 potential peaks Of 67 potential peaks: 58 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 43 new sources Median coadd sky for g : -5.7164525e-05 Median coadd sky for r : -0.0004044135 Median coadd sky for z : -0.00017710213 Stage srcs : Wall: 0.77 s, CPU: 0.70 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 318 MB, VmData: 345 MB, maxrss: 0.566512 MB Stage srcs finished: 2020-06-07T16:55:08.096084 Resources for stage srcs : 0.161 s worker CPU, 0.177 s worker Wall, Wall: 0.775 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/PGC2109409-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T16:55:08.116840 Blob 1 of 18, id: 7, sources: 24, size: 202x244, npix 25170, brick X: 49,251, Y: 85,329, one pixel: 110 85 Blob 2 of 18, id: 4, sources: 9, size: 93x106, npix 5032, brick X: 200,293, Y: 32,138, one pixel: 223 32 Blob 3 of 18, id: 12, sources: 5, size: 99x81, npix 3727, brick X: 230,329, Y: 158,239, one pixel: 241 158 Blob 4 of 18, id: 13, sources: 5, size: 85x69, npix 2883, brick X: 0,85, Y: 203,272, one pixel: 56 203 Blob 5 of 18, id: 0, sources: 3, size: 68x43, npix 1923, brick X: 119,187, Y: 0,43, one pixel: 128 0 Blob 4 finished, total: Wall: 2.95 s, CPU: 2.95 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141076 MB Blob 6 of 18, id: 1, sources: 1, size: 54x39, npix 1480, brick X: 273,327, Y: 0,39, one pixel: 289 0 Measuring 2 iterative sources Blob 5 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141076 MB Blob 7 of 18, id: 15, sources: 1, size: 43x44, npix 1365, brick X: 225,268, Y: 246,290, one pixel: 240 246 Measuring 2 iterative sources Blob 3 finished, total: Wall: 5.46 s, CPU: 5.46 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143324 MB Blob 8 of 18, id: 16, sources: 3, size: 52x40, npix 1343, brick X: 228,280, Y: 289,329, one pixel: 260 289 Blob 7 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143664 MB Blob 9 of 18, id: 5, sources: 3, size: 32x36, npix 621, brick X: 296,328, Y: 43,79, one pixel: 304 43 Blob 6 finished, total: Wall: 2.47 s, CPU: 2.47 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143216 MB Blob 10 of 18, id: 17, sources: 5, size: 31x28, npix 607, brick X: 0,31, Y: 301,329, one pixel: 3 301 Blob 9 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143216 MB Blob 11 of 18, id: 14, sources: 1, size: 28x29, npix 544, brick X: 92,120, Y: 214,243, one pixel: 107 214 Measuring 4 iterative sources Blob 8 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143664 MB Blob 12 of 18, id: 10, sources: 1, size: 28x27, npix 463, brick X: 17,45, Y: 141,168, one pixel: 29 141 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.65187, 37.81767), pm (-3.9, -7.7), parallax 0.373 with NanoMaggies: g=13, r=12.1, z=11.7 Reset brightness to NanoMaggies: g=13, r=12.1, z=11.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.65946, 37.80674), pm (-0.6, 0.3), parallax 0.781 with NanoMaggies: g=14.1, r=13.7, z=13.6 Reset brightness to NanoMaggies: g=14.1, r=13.7, z=13.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (282.66873, 37.80795), pm (-1.0, -7.4), parallax 0.139 with NanoMaggies: g=14.7, r=14, z=13.7 Reset brightness to NanoMaggies: g=14.7, r=14, z=13.7 Blob 10 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143216 MB Blob 13 of 18, id: 6, sources: 1, size: 26x25, npix 423, brick X: 113,139, Y: 46,71, one pixel: 124 46 Blob 12 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143528 MB Blob 14 of 18, id: 2, sources: 2, size: 31x20, npix 404, brick X: 0,31, Y: 6,26, one pixel: 5 6 Blob 2 finished, total: Wall: 9.18 s, CPU: 9.18 s, VmPeak: 801 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144192 MB Blob 15 of 18, id: 3, sources: 1, size: 25x25, npix 370, brick X: 59,84, Y: 31,56, one pixel: 69 31 Blob 14 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 801 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144192 MB Blob 16 of 18, id: 11, sources: 1, size: 21x21, npix 277, brick X: 290,311, Y: 146,167, one pixel: 300 146 Blob 17 of 18, id: 9, sources: 1, size: 21x22, npix 267, brick X: 266,287, Y: 117,139, one pixel: 274 117 Blob 13 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143528 MB Blob 18 of 18, id: 8, sources: 1, size: 21x20, npix 240, brick X: 42,63, Y: 104,124, one pixel: 51 104 Blob 11 finished, total: Wall: 2.02 s, CPU: 2.02 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144096 MB Blob 16 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143528 MB Blob 15 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 801 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144192 MB Blob 17 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144096 MB Blob 18 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 814 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143528 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.63621, ee1=0.230486, ee2=0.186999 Measuring 8 iterative sources Blob 1 finished, total: Wall: 30.76 s, CPU: 30.75 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 158 MB, VmData: 190 MB, maxrss: 0.161532 MB Old catalog: 82 New catalog: 80 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/blobs-custom-282638p37783.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/metrics/cus/all-models-custom-282638p37783.fits Stage fitblobs : Wall: 31.37 s, CPU: 0.59 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 319 MB, VmData: 345 MB, maxrss: 0.566512 MB Stage fitblobs finished: 2020-06-07T16:55:39.484817 Resources for stage fitblobs : 61.421 s worker CPU, 61.492 s worker Wall, Wall: 31.369 s, Cores in use: 1.98, Total efficiency (on 4 cores): 49.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T16:55:39.486955 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/tmp-legacysurvey-custom-282638p37783-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/tmp-legacysurvey-custom-282638p37783-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/tmp-legacysurvey-custom-282638p37783-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/tmp-legacysurvey-custom-282638p37783-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-resid.jpg Stage coadds : Wall: 2.01 s, CPU: 0.83 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 320 MB, VmData: 346 MB, maxrss: 0.566512 MB Stage coadds finished: 2020-06-07T16:55:41.494876 Resources for stage coadds : 3.481 s worker CPU, 3.563 s worker Wall, Wall: 2.009 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T16:55:41.496549 Cut to 1 unWISE tiles Reading WISE tile 2823p378 band 2 Reading WISE tile 2823p378 band 1 Reading WISE tile 2823p378 band 3 Reading WISE tile 2823p378 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.60 s, CPU: 1.06 s, VmPeak: 1068 MB, VmSize: 1004 MB, VmRSS: 159 MB, VmData: 194 MB, maxrss: 0.203836 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.55 s, CPU: 0.88 s, VmPeak: 1061 MB, VmSize: 997 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.21346 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.35 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.212944 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/282/2823p378/unwise-2823p378-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.22 s, CPU: 0.39 s, VmPeak: 1060 MB, VmSize: 996 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.212496 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/tmp-legacysurvey-custom-282638p37783-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/tmp-legacysurvey-custom-282638p37783-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.41 s, CPU: 0.67 s, VmPeak: 1077 MB, VmSize: 1077 MB, VmRSS: 320 MB, VmData: 346 MB, maxrss: 0.566512 MB Stage wise_forced finished: 2020-06-07T16:55:44.906484 Resources for stage wise_forced : 7.089 s worker CPU, 8.701 s worker Wall, Wall: 3.411 s, Cores in use: 2.28, Total efficiency (on 4 cores): 56.9 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T16:55:44.908313 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/coadd/cus/custom-282638p37783/legacysurvey-custom-282638p37783-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/tractor-i/cus/tractor-custom-282638p37783.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/tractor/cus/tractor-custom-282638p37783.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/282/PGC2109409/tractor/cus/brick-custom-282638p37783.sha256sum Stage writecat : Wall: 1.11 s, CPU: 0.77 s, VmPeak: 1210 MB, VmSize: 1082 MB, VmRSS: 322 MB, VmData: 346 MB, maxrss: 0.566512 MB Stage writecat finished: 2020-06-07T16:55:46.020679 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.113 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.4 % Stage writecat finished All done: 75.876 s worker CPU, 85.689 s worker Wall, Wall: 56.908 s, Cores in use: 1.63, Total efficiency (on 4 cores): 40.6 % Finished galaxy PGC2109409 in 0.993 minutes.