Started working on galaxy PGC2783200 at Sun Jun  7 18:58:32 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 222.727125 80.4949167 --width 337 --height 337 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T18:58:33.606145
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '222.727125', '80.4949167', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 222.727125 80.4949167 --width 337 --height 337 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 222.727125 80.4949167
Starting process 17815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 17818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 17822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 17826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T18:58:34.230997
Keeping 15 CCDs:
   k4m_180113_102947_ooi_zd_ls9.fits.fz k4m_180113_102947_ooi_zd_ls9-CCD2 z exptime 163.103 propid 2016A-0453 seeing 1.52 MJD 58131.437 object MzLS_730968_z
   k4m_180204_083342_ooi_zd_ls9.fits.fz k4m_180204_083342_ooi_zd_ls9-CCD2 z exptime 105.104 propid 2016A-0453 seeing 1.31 MJD 58153.357 object MzLS_730968_z
   k4m_180120_084647_ooi_zd_ls9.fits.fz k4m_180120_084647_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 1.16 MJD 58138.366 object MzLS_731396_z
   k4m_180105_094746_ooi_zd_ls9.fits.fz k4m_180105_094746_ooi_zd_ls9-CCD4 z exptime 200.104 propid 2016A-0453 seeing 1.31 MJD 58123.408 object MzLS_731183_z
   ksb_190128_124032_ooi_r_ls9.fits.fz ksb_190128_124032_ooi_r_ls9-CCD1 r exptime 150.42 propid NOTBASS seeing 1.35 MJD 58511.528 object 
   ksb_180703_042032_ooi_g_ls9.fits.fz ksb_180703_042032_ooi_g_ls9-CCD1 g exptime 104.64 propid NOTBASS seeing 1.43 MJD 58302.181 object 52311
   ksb_180610_065839_ooi_g_ls9.fits.fz ksb_180610_065839_ooi_g_ls9-CCD1 g exptime 164.52 propid NOTBASS seeing 1.64 MJD 58279.291 object 52311
   ksb_180618_064238_ooi_g_ls9.fits.fz ksb_180618_064238_ooi_g_ls9-CCD4 g exptime 145.8 propid NOTBASS seeing 1.47 MJD 58287.280 object 52833
   ksb_190212_121014_ooi_r_ls9.fits.fz ksb_190212_121014_ooi_r_ls9-CCD4 r exptime 127.641 propid NOTBASS seeing 1.90 MJD 58526.507 object 
   ksb_190212_120143_ooi_r_ls9.fits.fz ksb_190212_120143_ooi_r_ls9-CCD3 r exptime 129.222 propid NOTBASS seeing 1.74 MJD 58526.501 object 
   ksb_180607_075645_ooi_g_ls9.fits.fz ksb_180607_075645_ooi_g_ls9-CCD3 g exptime 233.07 propid NOTBASS seeing 1.89 MJD 58276.331 object 52312
   ksb_190212_114505_ooi_r_ls9.fits.fz ksb_190212_114505_ooi_r_ls9-CCD2 r exptime 158.441 propid NOTBASS seeing 1.89 MJD 58526.490 object 
   ksb_190212_100232_ooi_g_ls9.fits.fz ksb_190212_100232_ooi_g_ls9-CCD2 g exptime 187.044 propid NOTBASS seeing 2.63 MJD 58526.418 object 
   ksb_180610_065441_ooi_g_ls9.fits.fz ksb_180610_065441_ooi_g_ls9-CCD2 g exptime 200.25 propid NOTBASS seeing 1.54 MJD 58279.288 object 52821
   ksb_190212_115147_ooi_r_ls9.fits.fz ksb_190212_115147_ooi_r_ls9-CCD2 r exptime 158.441 propid NOTBASS seeing 1.59 MJD 58526.494 object 
mosaic get_fwhm: self.fwhm = 4.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1795 2140 and amp range 0 2005 and image y 1080 1431 and amp range 0 2039
Range in image: x 0 211 , y 0 352 (with image size 346 x 352)
dzp 0.009508088 -> scaling image by 1.0087957299815176
Found overlap: image x 1795 2140 and amp range 2006 4053 and image y 1080 1431 and amp range 0 2039
Range in image: x 211 346 , y 0 352 (with image size 346 x 352)
dzp 0.0061123776 -> scaling image by 1.005645584425507
mosaic get_fwhm: self.fwhm = 5.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2943 3293 and amp range 2048 4095 and image y 1940 2283 and amp range 0 2039
Range in image: x 0 351 , y 0 100 (with image size 351 x 344)
dzp -0.012875672 -> scaling image by 0.9882111074411305
Found overlap: image x 2943 3293 and amp range 2048 4095 and image y 1940 2283 and amp range 2040 4078
Range in image: x 0 351 , y 100 344 (with image size 351 x 344)
dzp -0.036442947 -> scaling image by 0.9669918668439786
mosaic get_fwhm: self.fwhm = 5.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2929 3279 and amp range 2048 4095 and image y 1967 2309 and amp range 0 2039
Range in image: x 0 351 , y 0 73 (with image size 351 x 343)
dzp -0.012875672 -> scaling image by 0.9882111074411305
Found overlap: image x 2929 3279 and amp range 2048 4095 and image y 1967 2309 and amp range 2040 4078
Range in image: x 0 351 , y 73 343 (with image size 351 x 343)
dzp -0.036442947 -> scaling image by 0.9669918668439786
mosaic get_fwhm: self.fwhm = 5.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 360 708 and amp range 0 2047 and image y 2452 2801 and amp range 2022 4060
Range in image: x 0 349 , y 0 350 (with image size 349 x 350)
dzp -0.016192675 -> scaling image by 0.9851966584456431
Faked up EXPNUM 85110274
Faked up EXPNUM 85110274
Faked up EXPNUM 85110274
90prime get_fwhm: self.fwhm = 2.97
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 39 242 and amp range 0 2015 and image y 2722 2923 and amp range 2048 4095
Range in image: x 0 204 , y 0 202 (with image size 204 x 202)
dzp -0.041756857 -> scaling image by 0.9622706886580858
Faked up EXPNUM 83020061
Faked up EXPNUM 83020061
Faked up EXPNUM 83020061
90prime get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 37 241 and amp range 0 2015 and image y 2744 2945 and amp range 2048 4095
Range in image: x 0 205 , y 0 202 (with image size 205 x 202)
dzp -0.031697065 -> scaling image by 0.9712279547101786
Faked up EXPNUM 82790074
Faked up EXPNUM 82790074
Faked up EXPNUM 82790074
90prime get_fwhm: self.fwhm = 3.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 48 252 and amp range 0 2015 and image y 2748 2950 and amp range 2048 4095
Range in image: x 0 205 , y 0 203 (with image size 205 x 203)
dzp -0.031697065 -> scaling image by 0.9712279547101786
Faked up EXPNUM 82870089
Faked up EXPNUM 82870089
Faked up EXPNUM 82870089
90prime get_fwhm: self.fwhm = 3.25
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1851 2051 and amp range 0 2015 and image y 3980 4080 and amp range 2048 4095
Range in image: x 0 165 , y 0 101 (with image size 201 x 101)
dzp 0.027550658 -> scaling image by 1.0256997821704772
Found overlap: image x 1851 2051 and amp range 2016 4031 and image y 3980 4080 and amp range 2048 4095
Range in image: x 165 201 , y 0 101 (with image size 201 x 101)
dzp 0.016666532 -> scaling image by 1.0154688660729452
Faked up EXPNUM 85260246
Faked up EXPNUM 85260246
Faked up EXPNUM 85260246
90prime get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2111 2308 and amp range 2016 4031 and image y 44 240 and amp range 0 2047
Range in image: x 0 198 , y 0 197 (with image size 198 x 197)
dzp 0.0010388457 -> scaling image by 1.0009572701813714
Faked up EXPNUM 85260249
Faked up EXPNUM 85260249
Faked up EXPNUM 85260249
90prime get_fwhm: self.fwhm = 4.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1848 2047 and amp range 0 2015 and image y 3986 4080 and amp range 2048 4095
Range in image: x 0 168 , y 0 95 (with image size 200 x 95)
dzp 0.030668205 -> scaling image by 1.028649174410522
Found overlap: image x 1848 2047 and amp range 2016 4031 and image y 3986 4080 and amp range 2048 4095
Range in image: x 168 200 , y 0 95 (with image size 200 x 95)
dzp 0.026738029 -> scaling image by 1.0249323749670936
Faked up EXPNUM 82760092
Faked up EXPNUM 82760092
Faked up EXPNUM 82760092
90prime get_fwhm: self.fwhm = 4.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2106 2303 and amp range 2016 4031 and image y 78 275 and amp range 0 2047
Range in image: x 0 198 , y 0 198 (with image size 198 x 198)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Faked up EXPNUM 85260241
Faked up EXPNUM 85260241
Faked up EXPNUM 85260241
90prime get_fwhm: self.fwhm = 4.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1730 1937 and amp range 0 2015 and image y 433 642 and amp range 0 2047
Range in image: x 0 208 , y 0 210 (with image size 208 x 210)
dzp 0.0012875209 -> scaling image by 1.001186553937296
Faked up EXPNUM 85260211
Faked up EXPNUM 85260211
Faked up EXPNUM 85260211
90prime get_fwhm: self.fwhm = 5.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1765 1972 and amp range 0 2015 and image y 436 644 and amp range 0 2047
Range in image: x 0 208 , y 0 209 (with image size 208 x 209)
dzp -0.0048344317 -> scaling image by 0.995557222329094
Faked up EXPNUM 82790073
Faked up EXPNUM 82790073
Faked up EXPNUM 82790073
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3802 4006 and amp range 2016 4031 and image y 2402 2606 and amp range 2048 4095
Range in image: x 0 205 , y 0 205 (with image size 205 x 205)
dzp 0.013237011 -> scaling image by 1.012266359574015
Faked up EXPNUM 85260243
Faked up EXPNUM 85260243
Faked up EXPNUM 85260243
90prime get_fwhm: self.fwhm = 3.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3804 4007 and amp range 2016 4031 and image y 2407 2610 and amp range 2048 4095
Range in image: x 0 204 , y 0 204 (with image size 204 x 204)
dzp 0.019437728 -> scaling image by 1.018064025437786
Stage tims : Wall: 9.64 s, CPU: 1.08 s, VmPeak: 943 MB, VmSize: 943 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.566568 MB
Stage tims finished: 2020-06-07T18:58:43.870747
Resources for stage tims : 4.553 s worker CPU, 23.321 s worker Wall, Wall: 9.641 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T18:58:43.902156
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00074.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00101.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/reference-custom-222727p80494.fits
Stage refs : Wall: 2.85 s, CPU: 2.33 s, VmPeak: 973 MB, VmSize: 964 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.566568 MB
Stage refs finished: 2020-06-07T18:58:46.755426
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.854 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T18:58:46.757004
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/outlier-mask-custom-222727p80494.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/outliers-pre-custom-222727p80494.jpg
Image ksb_180610_065839_ooi_g_ls9-CCD1 g : masking 411 positive outlier pixels and 0 negative outlier pixels
Image ksb_180703_042032_ooi_g_ls9-CCD1 g : masking 0 positive outlier pixels and 95 negative outlier pixels
Image ksb_190128_124032_ooi_r_ls9-CCD1 r : masking 75 positive outlier pixels and 0 negative outlier pixels
Image k4m_180113_102947_ooi_zd_ls9-CCD2 z : masking 1170 positive outlier pixels and 0 negative outlier pixels
Image k4m_180120_084647_ooi_zd_ls9-CCD1 z : masking 1331 positive outlier pixels and 269 negative outlier pixels
Image k4m_180204_083342_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 255 negative outlier pixels
Image k4m_180105_094746_ooi_zd_ls9-CCD4 z : masking 1093 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/outlier-mask-custom-222727p80494.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/outliers-post-custom-222727p80494.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/outliers-masked-pos-custom-222727p80494.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/outliers-masked-neg-custom-222727p80494.jpg
Stage outliers : Wall: 1.74 s, CPU: 1.17 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.566568 MB
Stage outliers finished: 2020-06-07T18:58:48.500464
Resources for stage outliers : 2.514 s worker CPU, 2.641 s worker Wall, Wall: 1.745 s, Cores in use: 2.11, Total efficiency (on 4 cores): 52.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T18:58:48.502452
Stage halos : Wall: 0.31 s, CPU: 0.30 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.566568 MB
Stage halos finished: 2020-06-07T18:58:48.817524
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.316 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T18:58:48.819599
PSF sigmas in coadd pixels: ['2.32', '2.66', '2.39', '3.07', '4.27', '2.50']
Using average PSF sigma 2.866887285949692
Gaussian PSF norm 0.09839758722165136 vs pixelized 0.08097376
average tim pixel scale / coadd scale: 1.7303391692996422
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.19', '3.09', '2.82', '3.07', '2.59']
Using average PSF sigma 2.7509410357871267
Gaussian PSF norm 0.10254483396921024 vs pixelized 0.08667912
average tim pixel scale / coadd scale: 1.7312475487248586
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.47', '2.12', '1.88', '2.12']
Using average PSF sigma 2.1467259582813902
Gaussian PSF norm 0.1314069877832546 vs pixelized 0.10839143
average tim pixel scale / coadd scale: 0.9911230093006841
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.49 s, CPU: 0.42 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.566568 MB
Stage fit_on_coadds finished: 2020-06-07T18:58:49.304878
Resources for stage fit_on_coadds : 0.566 s worker CPU, 0.603 s worker Wall, Wall: 0.486 s, Cores in use: 2.04, Total efficiency (on 4 cores): 50.9 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T18:58:49.308297
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 37 potential peaks
Of 37 potential peaks: 10 in veto map, 4 cut by saddle test, 0 cut by aper test, 23 kept
SED z : 23 new peaks
Found 74 potential peaks
Of 74 potential peaks: 68 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 84 potential peaks
Of 84 potential peaks: 77 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 90 potential peaks
Of 90 potential peaks: 81 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 120 potential peaks
Of 120 potential peaks: 110 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 26 new sources
Median coadd sky for g : 0.0003915794
Median coadd sky for r : 0.00065531756
Median coadd sky for z : 0.00012752661
Stage srcs : Wall: 0.81 s, CPU: 0.73 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.566568 MB
Stage srcs finished: 2020-06-07T18:58:50.116657
Resources for stage srcs : 0.198 s worker CPU, 0.199 s worker Wall, Wall: 0.809 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/PGC2783200-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T18:58:50.133523
Blob 1 of 11, id: 3, sources: 16, size: 314x327, npix 57754, brick X: 7,321, Y: 10,337, one pixel: 223 10
Blob 2 of 11, id: 0, sources: 3, size: 101x51, npix 2591, brick X: 104,205, Y: 0,51, one pixel: 108 0
Blob 3 of 11, id: 9, sources: 2, size: 69x53, npix 2181, brick X: 59,128, Y: 284,337, one pixel: 75 284
Blob 4 of 11, id: 5, sources: 2, size: 45x58, npix 1646, brick X: 278,323, Y: 38,96, one pixel: 300 38
Blob 5 of 11, id: 1, sources: 3, size: 75x34, npix 1602, brick X: 241,316, Y: 0,34, one pixel: 245 0
Blob 4 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143424 MB
Blob 6 of 11, id: 4, sources: 1, size: 44x37, npix 987, brick X: 80,124, Y: 31,68, one pixel: 93 31
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 2.02 s, CPU: 2.02 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14348 MB
Blob 7 of 11, id: 2, sources: 1, size: 39x26, npix 740, brick X: 52,91, Y: 7,33, one pixel: 62 7
Measuring 2 iterative sources
Blob 6 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143784 MB
Blob 8 of 11, id: 8, sources: 1, size: 27x30, npix 516, brick X: 305,332, Y: 231,261, one pixel: 316 231
Blob 2 finished, total: Wall: 3.11 s, CPU: 3.11 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144488 MB
Blob 9 of 11, id: 6, sources: 1, size: 27x27, npix 484, brick X: 4,31, Y: 219,246, one pixel: 15 219
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143784 MB
Blob 10 of 11, id: 10, sources: 1, size: 26x20, npix 355, brick X: 5,31, Y: 317,337, one pixel: 15 317
Blob 11 of 11, id: 7, sources: 1, size: 28x25, npix 349, brick X: 46,74, Y: 220,245, one pixel: 65 220
Blob 5 finished, total: Wall: 2.33 s, CPU: 2.33 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143836 MB
Blob 8 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144488 MB
Blob 9 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143784 MB
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144488 MB
Blob 10 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143836 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.953346, ee1=0.248752, ee2=-0.0438909
Measuring 19 iterative sources
Blob 1 finished, total: Wall: 33.27 s, CPU: 33.27 s, VmPeak: 805 MB, VmSize: 726 MB, VmRSS: 159 MB, VmData: 191 MB, maxrss: 0.198872 MB
Old catalog: 36
New catalog: 48
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/blobs-custom-222727p80494.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/metrics/cus/all-models-custom-222727p80494.fits
Stage fitblobs : Wall: 33.74 s, CPU: 0.42 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.566568 MB
Stage fitblobs finished: 2020-06-07T18:59:23.874032
Resources for stage fitblobs : 44.982 s worker CPU, 45.030 s worker Wall, Wall: 33.742 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T18:59:23.876372
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/tmp-legacysurvey-custom-222727p80494-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/tmp-legacysurvey-custom-222727p80494-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/tmp-legacysurvey-custom-222727p80494-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/tmp-legacysurvey-custom-222727p80494-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-resid.jpg
Stage coadds : Wall: 1.86 s, CPU: 0.80 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.566568 MB
Stage coadds finished: 2020-06-07T18:59:25.731750
Resources for stage coadds : 3.040 s worker CPU, 3.205 s worker Wall, Wall: 1.857 s, Cores in use: 2.07, Total efficiency (on 4 cores): 51.7 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T18:59:25.733650
Cut to 1 unWISE tiles
Reading WISE tile 2260p802 band 1
Reading WISE tile 2260p802 band 2
Reading WISE tile 2260p802 band 3
Reading WISE tile 2260p802 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.18 s, CPU: 0.18 s, VmPeak: 807 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.188864 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 809 MB, VmSize: 807 MB, VmRSS: 164 MB, VmData: 188 MB, maxrss: 0.228628 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 805 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209688 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/226/2260p802/unwise-2260p802-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 806 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209728 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/tmp-legacysurvey-custom-222727p80494-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/tmp-legacysurvey-custom-222727p80494-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.99 s, CPU: 0.72 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 234 MB, VmData: 260 MB, maxrss: 0.566568 MB
Stage wise_forced finished: 2020-06-07T18:59:28.724607
Resources for stage wise_forced : 5.972 s worker CPU, 7.353 s worker Wall, Wall: 2.992 s, Cores in use: 2.24, Total efficiency (on 4 cores): 55.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T18:59:28.726717
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/coadd/cus/custom-222727p80494/legacysurvey-custom-222727p80494-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/tractor-i/cus/tractor-custom-222727p80494.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/tractor/cus/tractor-custom-222727p80494.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/PGC2783200/tractor/cus/brick-custom-222727p80494.sha256sum
Stage writecat : Wall: 1.21 s, CPU: 0.68 s, VmPeak: 1106 MB, VmSize: 978 MB, VmRSS: 236 MB, VmData: 260 MB, maxrss: 0.566568 MB
Stage writecat finished: 2020-06-07T18:59:29.934758
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.209 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.2 %
Stage writecat finished
All done: 61.827 s worker CPU, 82.355 s worker Wall, Wall: 55.709 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.7 %
Finished galaxy PGC2783200 in 0.965 minutes.