Started working on galaxy PGC2110403 at Sun Jun  7 18:03:01 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 193.071822 37.8215845 --width 243 --height 243 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T18:03:02.729804
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '193.071822', '37.8215845', '--width', '243', '--height', '243', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 193.071822 37.8215845 --width 243 --height 243 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 193.071822 37.8215845
Starting process 28162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 28164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 28166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T18:03:03.143793
Keeping 10 CCDs:
   k4m_160414_071052_ooi_zd_ls9.fits.fz k4m_160414_071052_ooi_zd_ls9-CCD2 z exptime 101.103 propid 2016A-0453 seeing 1.10 MJD 57492.299 object MzLS_592426_z
   k4m_160214_105119_ooi_zd_ls9.fits.fz k4m_160214_105119_ooi_zd_ls9-CCD3 z exptime 80.106 propid 2016A-0453 seeing 1.22 MJD 57432.452 object MzLS_594407_z
   k4m_160203_114133_ooi_zd_ls9.fits.fz k4m_160203_114133_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.20 MJD 57421.487 object MzLS_593418_z
   ksb_160211_103246_ooi_g_ls9.fits.fz ksb_160211_103246_ooi_g_ls9-CCD2 g exptime 80.4 propid 2015A-0801 seeing 1.44 MJD 57429.439 object 11642
   ksb_160510_044711_ooi_r_ls9.fits.fz ksb_160510_044711_ooi_r_ls9-CCD2 r exptime 108.8 propid BASS seeing 1.77 MJD 57518.199 object 11642
   ksb_160209_111853_ooi_r_ls9.fits.fz ksb_160209_111853_ooi_r_ls9-CCD2 r exptime 121.0 propid 2015A-0801 seeing 1.61 MJD 57427.471 object 11642
   ksb_160512_044319_ooi_r_ls9.fits.fz ksb_160512_044319_ooi_r_ls9-CCD3 r exptime 242.0 propid BASS seeing 2.00 MJD 57520.197 object 11653
   ksb_170327_075524_ooi_g_ls9.fits.fz ksb_170327_075524_ooi_g_ls9-CCD3 g exptime 67.983 propid BASS seeing 1.28 MJD 57839.330 object 11653
   ksb_160216_101949_ooi_r_ls9.fits.fz ksb_160216_101949_ooi_r_ls9-CCD2 r exptime 79.5 propid 2015A-0801 seeing 1.32 MJD 57434.430 object 11641
   ksb_170625_045358_ooi_g_ls9.fits.fz ksb_170625_045358_ooi_g_ls9-CCD2 g exptime 237.978 propid BASS seeing 1.46 MJD 57929.204 object 11641
mosaic get_fwhm: self.fwhm = 4.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3722 3965 and amp range 2006 4053 and image y 2959 3203 and amp range 2040 4078
Range in image: x 0 244 , y 0 245 (with image size 244 x 245)
dzp -0.006092005 -> scaling image by 0.9944047680378836
mosaic get_fwhm: self.fwhm = 4.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1038 1285 and amp range 0 2005 and image y 1455 1703 and amp range 0 2039
Range in image: x 0 248 , y 0 249 (with image size 248 x 249)
dzp -0.005856539 -> scaling image by 0.9946204500110131
Faked up EXPNUM 74290229
Faked up EXPNUM 74290229
Faked up EXPNUM 74290229
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3272 3414 and amp range 2016 4031 and image y 3791 3933 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp 0.0026774607 -> scaling image by 1.002469075566243
mosaic get_fwhm: self.fwhm = 4.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2183 2432 and amp range 2048 4095 and image y 880 1130 and amp range 0 2039
Range in image: x 0 250 , y 0 251 (with image size 250 x 251)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
Faked up EXPNUM 75180064
Faked up EXPNUM 75180064
Faked up EXPNUM 75180064
90prime get_fwhm: self.fwhm = 3.91
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3240 3383 and amp range 2016 4031 and image y 3786 3927 and amp range 2048 4095
Range in image: x 0 144 , y 0 142 (with image size 144 x 142)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
Faked up EXPNUM 74270203
Faked up EXPNUM 74270203
Faked up EXPNUM 74270203
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3243 3386 and amp range 2016 4031 and image y 3785 3927 and amp range 2048 4095
Range in image: x 0 144 , y 0 143 (with image size 144 x 143)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
Faked up EXPNUM 78390158
Faked up EXPNUM 78390158
Faked up EXPNUM 78390158
90prime get_fwhm: self.fwhm = 2.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3474 3615 and amp range 2016 4031 and image y 3389 3530 and amp range 2048 4095
Range in image: x 0 142 , y 0 142 (with image size 142 x 142)
dzp -0.02530836 -> scaling image by 0.9769597156943128
Faked up EXPNUM 79290035
Faked up EXPNUM 79290035
Faked up EXPNUM 79290035
90prime get_fwhm: self.fwhm = 3.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1252 1394 and amp range 0 2015 and image y 1786 1928 and amp range 0 2047
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp 0.0003063402 -> scaling image by 1.0002821895558327
Faked up EXPNUM 75200055
Faked up EXPNUM 75200055
Faked up EXPNUM 75200055
90prime get_fwhm: self.fwhm = 4.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3485 3626 and amp range 2016 4031 and image y 3391 3533 and amp range 2048 4095
Range in image: x 0 142 , y 0 143 (with image size 142 x 143)
dzp -0.0005558773 -> scaling image by 0.99948814914245
Faked up EXPNUM 74340164
Faked up EXPNUM 74340164
Faked up EXPNUM 74340164
90prime get_fwhm: self.fwhm = 2.91
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1242 1384 and amp range 0 2015 and image y 1790 1933 and amp range 0 2047
Range in image: x 0 143 , y 0 144 (with image size 143 x 144)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Stage tims : Wall: 6.95 s, CPU: 0.92 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566536 MB
Stage tims finished: 2020-06-07T18:03:10.090694
Resources for stage tims : 3.464 s worker CPU, 18.624 s worker Wall, Wall: 6.948 s, Cores in use: 0.63, Total efficiency (on 4 cores): 15.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T18:03:10.164053
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02308.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02437.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/reference-custom-193071p37821.fits
Stage refs : Wall: 1.89 s, CPU: 1.08 s, VmPeak: 972 MB, VmSize: 951 MB, VmRSS: 181 MB, VmData: 214 MB, maxrss: 0.566536 MB
Stage refs finished: 2020-06-07T18:03:12.051448
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.888 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T18:03:12.052894
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/outlier-mask-custom-193071p37821.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/outliers-pre-custom-193071p37821.jpg
Image ksb_160216_101949_ooi_r_ls9-CCD2 r : masking 87 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/outlier-mask-custom-193071p37821.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/outliers-post-custom-193071p37821.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/outliers-masked-pos-custom-193071p37821.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/outliers-masked-neg-custom-193071p37821.jpg
Stage outliers : Wall: 0.89 s, CPU: 0.67 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 193 MB, VmData: 224 MB, maxrss: 0.566536 MB
Stage outliers finished: 2020-06-07T18:03:12.940779
Resources for stage outliers : 0.717 s worker CPU, 0.733 s worker Wall, Wall: 0.889 s, Cores in use: 1.56, Total efficiency (on 4 cores): 38.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T18:03:12.942598
Stage halos : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 193 MB, VmData: 224 MB, maxrss: 0.566536 MB
Stage halos finished: 2020-06-07T18:03:13.181231
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.240 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.3 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T18:03:13.183377
PSF sigmas in coadd pixels: ['2.33', '2.08', '2.38']
Using average PSF sigma 2.2643814749527205
Gaussian PSF norm 0.12457918195067737 vs pixelized 0.10340375
average tim pixel scale / coadd scale: 1.72957552700012
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.88', '2.61', '3.24', '2.14']
Using average PSF sigma 2.7195726052641866
Gaussian PSF norm 0.10372761926923246 vs pixelized 0.08956119
average tim pixel scale / coadd scale: 1.729675901890199
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.78', '1.98', '1.95']
Using average PSF sigma 1.9045426649305945
Gaussian PSF norm 0.1481168140615838 vs pixelized 0.12325232
average tim pixel scale / coadd scale: 0.9909233092579223
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.18 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 196 MB, VmData: 225 MB, maxrss: 0.566536 MB
Stage fit_on_coadds finished: 2020-06-07T18:03:13.427073
Resources for stage fit_on_coadds : 0.173 s worker CPU, 0.176 s worker Wall, Wall: 0.245 s, Cores in use: 1.44, Total efficiency (on 4 cores): 36.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T18:03:13.429976
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 4 in veto map, 5 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 28 potential peaks
Of 28 potential peaks: 21 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 35 potential peaks
Of 35 potential peaks: 24 in veto map, 6 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 38 potential peaks
Of 38 potential peaks: 31 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 25 new sources
Median coadd sky for g : 0.00018709686
Median coadd sky for r : 0.00041438642
Median coadd sky for z : -0.00017158338
Stage srcs : Wall: 0.49 s, CPU: 0.45 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 196 MB, VmData: 225 MB, maxrss: 0.566536 MB
Stage srcs finished: 2020-06-07T18:03:13.918991
Resources for stage srcs : 0.097 s worker CPU, 0.107 s worker Wall, Wall: 0.490 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/PGC2110403-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T18:03:13.930990
Blob 1 of 11, id: 5, sources: 12, size: 204x144, npix 16787, brick X: 0,204, Y: 71,215, one pixel: 140 71
Blob 2 of 11, id: 7, sources: 2, size: 39x51, npix 977, brick X: 204,243, Y: 149,200, one pixel: 230 149
Blob 3 of 11, id: 0, sources: 2, size: 52x30, npix 928, brick X: 38,90, Y: 0,30, one pixel: 43 0
Blob 4 of 11, id: 1, sources: 2, size: 41x32, npix 853, brick X: 136,177, Y: 0,32, one pixel: 145 0
Blob 5 of 11, id: 10, sources: 1, size: 42x21, npix 663, brick X: 95,137, Y: 222,243, one pixel: 109 222
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14204 MB
Blob 6 of 11, id: 9, sources: 2, size: 41x25, npix 619, brick X: 10,51, Y: 199,224, one pixel: 20 199
Blob 4 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1419 MB
Blob 7 of 11, id: 3, sources: 2, size: 29x36, npix 602, brick X: 39,68, Y: 25,61, one pixel: 51 25
Blob 3 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142132 MB
Blob 8 of 11, id: 8, sources: 1, size: 23x26, npix 404, brick X: 218,241, Y: 194,220, one pixel: 228 194
Blob 7 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142132 MB
Blob 9 of 11, id: 2, sources: 1, size: 21x21, npix 268, brick X: 206,227, Y: 18,39, one pixel: 216 18
Blob 10 of 11, id: 6, sources: 1, size: 21x20, npix 248, brick X: 31,52, Y: 100,120, one pixel: 40 100
Blob 6 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1419 MB
Blob 11 of 11, id: 4, sources: 1, size: 18x18, npix 180, brick X: 173,191, Y: 49,67, one pixel: 181 49
Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1419 MB
Blob 10 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1419 MB
Measuring 1 iterative sources
Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1419 MB
Blob 8 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142132 MB
Blob 5 finished, total: Wall: 2.04 s, CPU: 2.04 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142472 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.349244, ee1=-0.127351, ee2=0.0992608
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 11.96 s, CPU: 11.96 s, VmPeak: 803 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144836 MB
Old catalog: 29
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/blobs-custom-193071p37821.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/metrics/cus/all-models-custom-193071p37821.fits
Stage fitblobs : Wall: 12.34 s, CPU: 0.34 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 196 MB, VmData: 225 MB, maxrss: 0.566536 MB
Stage fitblobs finished: 2020-06-07T18:03:26.266495
Resources for stage fitblobs : 20.626 s worker CPU, 20.648 s worker Wall, Wall: 12.337 s, Cores in use: 1.70, Total efficiency (on 4 cores): 42.5 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T18:03:26.268678
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/tmp-legacysurvey-custom-193071p37821-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/tmp-legacysurvey-custom-193071p37821-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/tmp-legacysurvey-custom-193071p37821-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/tmp-legacysurvey-custom-193071p37821-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-resid.jpg
Stage coadds : Wall: 1.64 s, CPU: 0.79 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 197 MB, VmData: 225 MB, maxrss: 0.566536 MB
Stage coadds finished: 2020-06-07T18:03:27.903733
Resources for stage coadds : 2.230 s worker CPU, 2.488 s worker Wall, Wall: 1.636 s, Cores in use: 1.85, Total efficiency (on 4 cores): 46.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T18:03:27.905321
Cut to 1 unWISE tiles
Reading WISE tile 1932p378 band 2
Reading WISE tile 1932p378 band 1
Reading WISE tile 1932p378 band 4
Reading WISE tile 1932p378 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 803 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187972 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208512 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209548 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/193/1932p378/unwise-1932p378-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209088 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/tmp-legacysurvey-custom-193071p37821-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/tmp-legacysurvey-custom-193071p37821-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.55 s, CPU: 0.45 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 198 MB, VmData: 225 MB, maxrss: 0.566536 MB
Stage wise_forced finished: 2020-06-07T18:03:30.451308
Resources for stage wise_forced : 4.841 s worker CPU, 6.428 s worker Wall, Wall: 2.547 s, Cores in use: 2.08, Total efficiency (on 4 cores): 52.0 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T18:03:30.453262
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/coadd/cus/custom-193071p37821/legacysurvey-custom-193071p37821-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/tractor-i/cus/tractor-custom-193071p37821.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/tractor/cus/tractor-custom-193071p37821.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2110403/tractor/cus/brick-custom-193071p37821.sha256sum
Stage writecat : Wall: 1.09 s, CPU: 0.56 s, VmPeak: 1093 MB, VmSize: 965 MB, VmRSS: 200 MB, VmData: 225 MB, maxrss: 0.566536 MB
Stage writecat finished: 2020-06-07T18:03:31.541597
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.089 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.8 %
Stage writecat finished
All done: 32.149 s worker CPU, 49.206 s worker Wall, Wall: 28.403 s, Cores in use: 1.33, Total efficiency (on 4 cores): 33.3 %
Finished galaxy PGC2110403 in 0.512 minutes.