Started working on galaxy PGC2303904 at Sun Jun  7 17:35:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 104.13499949999999 47.7594722 --width 511 --height 511 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:35:59.329274
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '104.13499949999999', '47.7594722', '--width', '511', '--height', '511', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 104.13499949999999 47.7594722 --width 511 --height 511 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 104.13499949999999 47.7594722
Starting process 24826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB
Starting process 24827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB
Starting process 24828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057528 MB
Starting process 24829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057404 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:36:04.246593
Keeping 17 CCDs:
   k4m_160226_032046_ooi_zd_ls9.fits.fz k4m_160226_032046_ooi_zd_ls9-CCD3 z exptime 80.103 propid 2016A-0453 seeing 0.89 MJD 57444.139 object MzLS_640227_z
   k4m_170316_034553_ooi_zd_ls9.fits.fz k4m_170316_034553_ooi_zd_ls9-CCD2 z exptime 120.103 propid 2016A-0453 seeing 1.03 MJD 57828.157 object MzLS_639381_z
   k4m_170222_052643_ooi_zd_ls9.fits.fz k4m_170222_052643_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 0.93 MJD 57806.227 object MzLS_641071_z
   k4m_170322_045137_ooi_zd_ls9.fits.fz k4m_170322_045137_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.91 MJD 57834.203 object MzLS_641071_z
   k4m_170126_044158_ooi_zd_ls9.fits.fz k4m_170126_044158_ooi_zd_ls9-CCD3 z exptime 82.105 propid 2016A-0453 seeing 1.40 MJD 57779.196 object MzLS_641070_z
   ksb_170214_030655_ooi_r_ls9.fits.fz ksb_170214_030655_ooi_r_ls9-CCD4 r exptime 126.375 propid BASS seeing 1.46 MJD 57798.130 object 23733
   ksb_180310_031911_ooi_g_ls9.fits.fz ksb_180310_031911_ooi_g_ls9-CCD4 g exptime 58.96 propid BASS seeing 1.56 MJD 58187.138 object 23733
   ksb_180313_040225_ooi_g_ls9.fits.fz ksb_180313_040225_ooi_g_ls9-CCD4 g exptime 250.0 propid BASS seeing 1.70 MJD 58190.168 object 23733
   ksb_170131_050358_ooi_g_ls9.fits.fz ksb_170131_050358_ooi_g_ls9-CCD4 g exptime 140.4 propid BASS seeing 1.54 MJD 57784.211 object 23731
   ksb_170301_031354_ooi_r_ls9.fits.fz ksb_170301_031354_ooi_r_ls9-CCD4 r exptime 135.642 propid BASS seeing 1.78 MJD 57813.135 object 23731
   ksb_160207_034130_ooi_r_ls9.fits.fz ksb_160207_034130_ooi_r_ls9-CCD3 r exptime 186.4 propid 2015A-0801 seeing 1.66 MJD 57425.154 object 22512
   ksb_180221_043657_ooi_g_ls9.fits.fz ksb_180221_043657_ooi_g_ls9-CCD3 g exptime 250.0 propid BASS seeing 2.22 MJD 58170.192 object 22512
   ksb_160204_032635_ooi_r_ls9.fits.fz ksb_160204_032635_ooi_r_ls9-CCD2 r exptime 137.0 propid 2015A-0801 seeing 1.68 MJD 57422.143 object 23722
   ksb_160206_040240_ooi_g_ls9.fits.fz ksb_160206_040240_ooi_g_ls9-CCD2 g exptime 230.1 propid 2015A-0801 seeing 1.94 MJD 57424.169 object 23722
   ksb_170214_030655_ooi_r_ls9.fits.fz ksb_170214_030655_ooi_r_ls9-CCD3 r exptime 126.375 propid BASS seeing 1.47 MJD 57798.130 object 23733
   ksb_180310_031911_ooi_g_ls9.fits.fz ksb_180310_031911_ooi_g_ls9-CCD3 g exptime 58.96 propid BASS seeing 1.62 MJD 58187.138 object 23733
   ksb_180313_040225_ooi_g_ls9.fits.fz ksb_180313_040225_ooi_g_ls9-CCD3 g exptime 250.0 propid BASS seeing 1.75 MJD 58190.168 object 23733
mosaic get_fwhm: self.fwhm = 3.51
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 428 957 and amp range 0 2005 and image y 7 256 and amp range 0 2039
Range in image: x 0 530 , y 0 250 (with image size 530 x 250)
dzp 0.007397243 -> scaling image by 1.006836374469654
mosaic get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 453 982 and amp range 0 2005 and image y 7 302 and amp range 0 2039
Range in image: x 0 530 , y 0 296 (with image size 530 x 296)
dzp 0.007397243 -> scaling image by 1.006836374469654
mosaic get_fwhm: self.fwhm = 3.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1578 2094 and amp range 0 2047 and image y 3393 3906 and amp range 2040 4078
Range in image: x 0 470 , y 0 514 (with image size 517 x 514)
dzp 0.015739892 -> scaling image by 1.0146025667655956
Found overlap: image x 1578 2094 and amp range 2048 4095 and image y 3393 3906 and amp range 2040 4078
Range in image: x 470 517 , y 0 514 (with image size 517 x 514)
dzp -0.032976374 -> scaling image by 0.9700842429001929
mosaic get_fwhm: self.fwhm = 3.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3162 3675 and amp range 2006 4053 and image y 1125 1639 and amp range 0 2039
Range in image: x 0 514 , y 0 515 (with image size 514 x 515)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
mosaic get_fwhm: self.fwhm = 5.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 415 948 and amp range 0 2005 and image y 3495 4033 and amp range 2040 4078
Range in image: x 0 534 , y 0 539 (with image size 534 x 539)
dzp 0.012956044 -> scaling image by 1.012004439021001
Faked up EXPNUM 77840090
Faked up EXPNUM 77840090
Faked up EXPNUM 77840090
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1748 2045 and amp range 0 2015 and image y 2829 3127 and amp range 2048 4095
Range in image: x 0 268 , y 0 299 (with image size 298 x 299)
dzp 0.019393893 -> scaling image by 1.0180229229717446
Found overlap: image x 1748 2045 and amp range 2016 4031 and image y 2829 3127 and amp range 2048 4095
Range in image: x 268 298 , y 0 299 (with image size 298 x 299)
dzp -0.0030897402 -> scaling image by 0.9971582894587289
Faked up EXPNUM 77980050
Faked up EXPNUM 77980050
Faked up EXPNUM 77980050
Faked up EXPNUM 81900050
Faked up EXPNUM 81900050
Faked up EXPNUM 81900050
90prime get_fwhm: self.fwhm = 3.75
Faked up EXPNUM 74250044
Faked up EXPNUM 74250044
Faked up EXPNUM 74250044
90prime get_fwhm: self.fwhm = 3.67
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 235 and amp range 0 2015 and image y 818 1114 and amp range 0 2047
Range in image: x 0 221 , y 0 297 (with image size 221 x 297)
dzp -0.024507914 -> scaling image by 0.9776802328037623
Faked up EXPNUM 81870050
Faked up EXPNUM 81870050
Faked up EXPNUM 81870050
90prime get_fwhm: self.fwhm = 3.43
Faked up EXPNUM 78130045
Faked up EXPNUM 78130045
Faked up EXPNUM 78130045
90prime get_fwhm: self.fwhm = 3.93
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1692 1989 and amp range 0 2015 and image y 2761 3060 and amp range 2048 4095
Range in image: x 0 298 , y 0 300 (with image size 298 x 300)
dzp 0.01103811 -> scaling image by 1.0102183288830229
Faked up EXPNUM 81700099
Faked up EXPNUM 81700099
Faked up EXPNUM 81700099
90prime get_fwhm: self.fwhm = 4.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 15 228 and amp range 0 2015 and image y 789 1085 and amp range 0 2047
Range in image: x 0 214 , y 0 297 (with image size 214 x 297)
dzp -0.03692675 -> scaling image by 0.9665610717922232
Faked up EXPNUM 74220052
Faked up EXPNUM 74220052
Faked up EXPNUM 74220052
90prime get_fwhm: self.fwhm = 3.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3671 3971 and amp range 2016 4031 and image y 1194 1496 and amp range 0 2047
Range in image: x 0 301 , y 0 303 (with image size 301 x 303)
dzp -0.012503507 -> scaling image by 0.9885499019198392
Faked up EXPNUM 77980050
Faked up EXPNUM 77980050
Faked up EXPNUM 77980050
90prime get_fwhm: self.fwhm = 3.25
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3882 4016 and amp range 2016 4031 and image y 777 1072 and amp range 0 2047
Range in image: x 0 135 , y 0 296 (with image size 135 x 296)
dzp -0.0023383768 -> scaling image by 0.9978485929508539
Faked up EXPNUM 81900050
Faked up EXPNUM 81900050
Faked up EXPNUM 81900050
90prime get_fwhm: self.fwhm = 3.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3893 4016 and amp range 2016 4031 and image y 762 1057 and amp range 0 2047
Range in image: x 0 124 , y 0 296 (with image size 124 x 296)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Faked up EXPNUM 74240051
Faked up EXPNUM 74240051
Faked up EXPNUM 74240051
90prime get_fwhm: self.fwhm = 4.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3653 3952 and amp range 2016 4031 and image y 1171 1473 and amp range 0 2047
Range in image: x 0 300 , y 0 303 (with image size 300 x 303)
dzp -0.008960029 -> scaling image by 0.9917814665476246
Faked up EXPNUM 81870050
Faked up EXPNUM 81870050
Faked up EXPNUM 81870050
90prime get_fwhm: self.fwhm = 3.57
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3897 4016 and amp range 2016 4031 and image y 769 1064 and amp range 0 2047
Range in image: x 0 120 , y 0 296 (with image size 120 x 296)
dzp -0.0012233759 -> scaling image by 0.9988738637196966
Stage tims : Wall: 7.34 s, CPU: 1.82 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 186 MB, VmData: 219 MB, maxrss: 0.566556 MB
Stage tims finished: 2020-06-07T17:36:11.586859
Resources for stage tims : 5.161 s worker CPU, 18.224 s worker Wall, Wall: 7.341 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:36:12.082332
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01544.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01657.fits
Matched 9 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/reference-custom-104134p47759.fits
Stage refs : Wall: 5.25 s, CPU: 4.62 s, VmPeak: 994 MB, VmSize: 989 MB, VmRSS: 234 MB, VmData: 265 MB, maxrss: 0.566556 MB
Stage refs finished: 2020-06-07T17:36:17.330462
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.249 s, Cores in use: 0.88, Total efficiency (on 4 cores): 22.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:36:17.332117
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/outlier-mask-custom-104134p47759.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/outliers-pre-custom-104134p47759.jpg
Image ksb_180221_043657_ooi_g_ls9-CCD3 g : masking 4718 positive outlier pixels and 0 negative outlier pixels
Image ksb_170131_050358_ooi_g_ls9-CCD4 g : masking 147 positive outlier pixels and 0 negative outlier pixels
Image ksb_180313_040225_ooi_g_ls9-CCD3 g : masking 490 positive outlier pixels and 0 negative outlier pixels
Image ksb_160206_040240_ooi_g_ls9-CCD2 g : masking 75 positive outlier pixels and 281 negative outlier pixels
Image ksb_170214_030655_ooi_r_ls9-CCD3 r : masking 86 positive outlier pixels and 0 negative outlier pixels
Image ksb_160207_034130_ooi_r_ls9-CCD3 r : masking 5499 positive outlier pixels and 0 negative outlier pixels
Image ksb_160204_032635_ooi_r_ls9-CCD2 r : masking 44 positive outlier pixels and 0 negative outlier pixels
Image ksb_170301_031354_ooi_r_ls9-CCD4 r : masking 0 positive outlier pixels and 163 negative outlier pixels
Image k4m_170322_045137_ooi_zd_ls9-CCD1 z : masking 4549 positive outlier pixels and 201 negative outlier pixels
Image k4m_170222_052643_ooi_zd_ls9-CCD1 z : masking 5573 positive outlier pixels and 203 negative outlier pixels
Image k4m_170316_034553_ooi_zd_ls9-CCD2 z : masking 4365 positive outlier pixels and 764 negative outlier pixels
Image k4m_160226_032046_ooi_zd_ls9-CCD3 z : masking 1567 positive outlier pixels and 208 negative outlier pixels
Image k4m_170126_044158_ooi_zd_ls9-CCD3 z : masking 7334 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/outlier-mask-custom-104134p47759.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/outliers-post-custom-104134p47759.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/outliers-masked-pos-custom-104134p47759.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/outliers-masked-neg-custom-104134p47759.jpg
Stage outliers : Wall: 3.10 s, CPU: 1.82 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 281 MB, VmData: 312 MB, maxrss: 0.566556 MB
Stage outliers finished: 2020-06-07T17:36:20.432808
Resources for stage outliers : 5.647 s worker CPU, 5.914 s worker Wall, Wall: 3.102 s, Cores in use: 2.41, Total efficiency (on 4 cores): 60.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:36:20.434658
Stage halos : Wall: 0.35 s, CPU: 0.34 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 281 MB, VmData: 312 MB, maxrss: 0.566556 MB
Stage halos finished: 2020-06-07T17:36:20.785833
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.352 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:36:20.787758
PSF sigmas in coadd pixels: ['2.50', '3.60', '3.16', '2.63', '2.83']
Using average PSF sigma 2.943991537212276
Gaussian PSF norm 0.09582051721554857 vs pixelized 0.07823644
average tim pixel scale / coadd scale: 1.7304422301844558
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.89', '2.70', '2.73', '2.39']
Using average PSF sigma 2.679729217111094
Gaussian PSF norm 0.10526988696193453 vs pixelized 0.0878324
average tim pixel scale / coadd scale: 1.7300146171567208
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.45', '1.67', '1.51', '1.48', '2.27']
Using average PSF sigma 1.6738704150742563
Gaussian PSF norm 0.1685284531188538 vs pixelized 0.13572665
average tim pixel scale / coadd scale: 0.9908272932774124
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.78 s, CPU: 0.71 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 282 MB, VmData: 312 MB, maxrss: 0.566556 MB
Stage fit_on_coadds finished: 2020-06-07T17:36:21.570633
Resources for stage fit_on_coadds : 1.196 s worker CPU, 1.390 s worker Wall, Wall: 0.784 s, Cores in use: 2.43, Total efficiency (on 4 cores): 60.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:36:21.573961
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 116 potential peaks
Of 116 potential peaks: 25 in veto map, 17 cut by saddle test, 0 cut by aper test, 74 kept
SED z : 74 new peaks
Found 77 potential peaks
Of 77 potential peaks: 69 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 69 potential peaks
Of 69 potential peaks: 57 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 123 potential peaks
Of 123 potential peaks: 101 in veto map, 15 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 166 potential peaks
Of 166 potential peaks: 134 in veto map, 26 cut by saddle test, 0 cut by aper test, 6 kept
SED Red : 6 new peaks
Adding 91 new sources
Median coadd sky for g : 7.667065e-05
Median coadd sky for r : 0.00015045017
Median coadd sky for z : 3.0202154e-05
Stage srcs : Wall: 1.43 s, CPU: 1.26 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 283 MB, VmData: 312 MB, maxrss: 0.566556 MB
Stage srcs finished: 2020-06-07T17:36:23.005178
Resources for stage srcs : 0.507 s worker CPU, 0.507 s worker Wall, Wall: 1.432 s, Cores in use: 1.23, Total efficiency (on 4 cores): 30.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/PGC2303904-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:36:23.031313
Blob 1 of 60, id: 20, sources: 22, size: 319x240, npix 31886, brick X: 0,319, Y: 160,400, one pixel: 249 160
Blob 2 of 60, id: 50, sources: 6, size: 130x81, npix 7320, brick X: 284,414, Y: 430,511, one pixel: 372 430
Blob 3 of 60, id: 7, sources: 2, size: 90x91, npix 5275, brick X: 227,317, Y: 38,129, one pixel: 298 38
Blob 4 of 60, id: 2, sources: 10, size: 90x118, npix 4355, brick X: 380,470, Y: 0,118, one pixel: 450 0
Blob 5 of 60, id: 10, sources: 2, size: 80x90, npix 4199, brick X: 149,229, Y: 70,160, one pixel: 195 70
Blob 3 finished, total: Wall: 1.21 s, CPU: 0.86 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143516 MB
Blob 6 of 60, id: 8, sources: 3, size: 73x61, npix 2376, brick X: 19,92, Y: 52,113, one pixel: 48 52
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143516 MB
Blob 7 of 60, id: 5, sources: 4, size: 65x48, npix 1957, brick X: 318,383, Y: 23,71, one pixel: 364 23
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (104.12851, 47.78041), pm (1.7, -1.8), parallax 0.097 with NanoMaggies: g=19.5, r=18.8, z=18.6
Reset brightness to NanoMaggies: g=19.5, r=18.8, z=18.6
Blob 2 finished, total: Wall: 4.64 s, CPU: 4.43 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144768 MB
Blob 8 of 60, id: 34, sources: 3, size: 61x55, npix 1845, brick X: 443,504, Y: 273,328, one pixel: 465 273
Measuring 2 iterative sources
Measuring 2 iterative sources
Measuring 2 iterative sources
Blob 4 finished, total: Wall: 6.60 s, CPU: 6.26 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145192 MB
Blob 9 of 60, id: 43, sources: 1, size: 50x51, npix 1762, brick X: 449,499, Y: 369,420, one pixel: 467 369
Blob 6 finished, total: Wall: 4.67 s, CPU: 4.67 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 10 of 60, id: 53, sources: 1, size: 41x54, npix 1414, brick X: 225,266, Y: 437,491, one pixel: 245 437
Blob 7 finished, total: Wall: 2.91 s, CPU: 2.91 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 11 of 60, id: 33, sources: 3, size: 55x44, npix 1397, brick X: 388,443, Y: 269,313, one pixel: 430 269
Blob 8 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145472 MB
Blob 12 of 60, id: 58, sources: 2, size: 36x49, npix 1194, brick X: 188,224, Y: 462,511, one pixel: 202 462
Blob 9 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 13 of 60, id: 59, sources: 2, size: 56x36, npix 1180, brick X: 61,117, Y: 475,511, one pixel: 100 475
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 14 of 60, id: 30, sources: 2, size: 44x40, npix 1162, brick X: 125,169, Y: 236,276, one pixel: 137 236
Blob 12 finished, total: Wall: 1.59 s, CPU: 1.59 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 15 of 60, id: 46, sources: 2, size: 38x48, npix 1139, brick X: 34,72, Y: 406,454, one pixel: 48 406
Blob 11 finished, total: Wall: 2.41 s, CPU: 2.41 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145472 MB
Blob 16 of 60, id: 17, sources: 2, size: 40x41, npix 1133, brick X: 71,111, Y: 130,171, one pixel: 88 130
Blob 14 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 17 of 60, id: 3, sources: 1, size: 38x38, npix 977, brick X: 64,102, Y: 8,46, one pixel: 80 8
Measuring 1 iterative sources
Measuring 2 iterative sources
Blob 13 finished, total: Wall: 3.53 s, CPU: 3.53 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 18 of 60, id: 49, sources: 1, size: 30x41, npix 925, brick X: 0,30, Y: 421,462, one pixel: 6 421
Blob 15 finished, total: Wall: 2.22 s, CPU: 2.22 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145472 MB
Blob 19 of 60, id: 42, sources: 1, size: 34x38, npix 906, brick X: 322,356, Y: 368,406, one pixel: 338 368
Blob 16 finished, total: Wall: 1.89 s, CPU: 1.71 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 20 of 60, id: 16, sources: 3, size: 26x47, npix 861, brick X: 485,511, Y: 129,176, one pixel: 503 129
Blob 17 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 21 of 60, id: 9, sources: 1, size: 41x30, npix 819, brick X: 132,173, Y: 58,88, one pixel: 142 58
Blob 18 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145472 MB
Blob 22 of 60, id: 29, sources: 1, size: 38x35, npix 780, brick X: 373,411, Y: 219,254, one pixel: 386 219
Blob 19 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 23 of 60, id: 44, sources: 1, size: 45x30, npix 758, brick X: 231,276, Y: 390,420, one pixel: 244 390
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 22 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 24 of 60, id: 1, sources: 1, size: 36x28, npix 743, brick X: 302,338, Y: 0,28, one pixel: 312 0
Blob 21 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 25 of 60, id: 35, sources: 1, size: 33x32, npix 697, brick X: 357,390, Y: 314,346, one pixel: 370 314
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (104.10695, 47.75197), pm (0.7, -1.2), parallax 0.338 with NanoMaggies: g=17.9, r=17.2, z=17
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.1
Blob 20 finished, total: Wall: 2.23 s, CPU: 2.23 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 26 of 60, id: 47, sources: 1, size: 31x33, npix 673, brick X: 429,460, Y: 409,442, one pixel: 442 409
Measuring 1 iterative sources
Blob 23 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 27 of 60, id: 4, sources: 1, size: 29x31, npix 604, brick X: 228,257, Y: 20,51, one pixel: 242 20
Blob 24 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 28 of 60, id: 28, sources: 2, size: 35x25, npix 567, brick X: 102,137, Y: 210,235, one pixel: 113 210
Blob 27 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 29 of 60, id: 25, sources: 1, size: 30x29, npix 558, brick X: 70,100, Y: 198,227, one pixel: 84 198
Blob 25 finished, total: Wall: 1.99 s, CPU: 1.99 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 30 of 60, id: 48, sources: 1, size: 33x24, npix 533, brick X: 263,296, Y: 419,443, one pixel: 282 419
Measuring 1 iterative sources
Blob 26 finished, total: Wall: 2.07 s, CPU: 2.07 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 31 of 60, id: 11, sources: 1, size: 27x28, npix 506, brick X: 484,511, Y: 99,127, one pixel: 496 99
Blob 28 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 32 of 60, id: 26, sources: 1, size: 30x26, npix 495, brick X: 315,345, Y: 204,230, one pixel: 330 204
Blob 29 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 33 of 60, id: 0, sources: 2, size: 34x24, npix 493, brick X: 144,178, Y: 0,24, one pixel: 166 0
Measuring 1 iterative sources
Blob 30 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 34 of 60, id: 37, sources: 1, size: 27x26, npix 466, brick X: 319,346, Y: 327,353, one pixel: 330 327
Blob 31 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 35 of 60, id: 55, sources: 1, size: 27x26, npix 456, brick X: 162,189, Y: 456,482, one pixel: 173 456
Blob 32 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 36 of 60, id: 40, sources: 1, size: 25x25, npix 401, brick X: 399,424, Y: 357,382, one pixel: 409 357
Blob 33 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 37 of 60, id: 18, sources: 1, size: 24x26, npix 389, brick X: 309,333, Y: 131,157, one pixel: 319 131
Blob 34 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 38 of 60, id: 13, sources: 1, size: 25x24, npix 376, brick X: 393,418, Y: 119,143, one pixel: 403 119
Blob 35 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 39 of 60, id: 51, sources: 1, size: 24x25, npix 365, brick X: 127,151, Y: 434,459, one pixel: 138 434
Blob 36 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 40 of 60, id: 54, sources: 1, size: 20x25, npix 357, brick X: 491,511, Y: 444,469, one pixel: 501 444
Blob 41 of 60, id: 57, sources: 1, size: 24x24, npix 353, brick X: 31,55, Y: 462,486, one pixel: 41 462
Blob 38 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 37 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 42 of 60, id: 21, sources: 1, size: 23x24, npix 328, brick X: 182,205, Y: 164,188, one pixel: 192 164
Blob 43 of 60, id: 23, sources: 1, size: 22x22, npix 303, brick X: 330,352, Y: 177,199, one pixel: 339 177
Blob 39 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 44 of 60, id: 19, sources: 1, size: 23x22, npix 297, brick X: 350,373, Y: 147,169, one pixel: 363 147
Blob 40 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 45 of 60, id: 27, sources: 1, size: 22x22, npix 294, brick X: 32,54, Y: 208,230, one pixel: 41 208
Blob 41 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 46 of 60, id: 36, sources: 1, size: 22x22, npix 291, brick X: 290,312, Y: 327,349, one pixel: 299 327
Blob 43 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 47 of 60, id: 39, sources: 1, size: 21x21, npix 279, brick X: 38,59, Y: 345,366, one pixel: 46 345
Blob 42 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 48 of 60, id: 6, sources: 1, size: 21x20, npix 267, brick X: 490,511, Y: 25,45, one pixel: 499 25
Blob 46 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 49 of 60, id: 38, sources: 1, size: 22x21, npix 259, brick X: 65,87, Y: 339,360, one pixel: 76 339
Blob 47 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 50 of 60, id: 56, sources: 1, size: 21x20, npix 258, brick X: 268,289, Y: 458,478, one pixel: 277 458
Blob 48 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 44 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 51 of 60, id: 52, sources: 1, size: 21x21, npix 240, brick X: 172,193, Y: 434,455, one pixel: 181 434
Blob 52 of 60, id: 14, sources: 1, size: 21x20, npix 229, brick X: 357,378, Y: 120,140, one pixel: 366 120
Blob 45 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 53 of 60, id: 32, sources: 1, size: 19x20, npix 227, brick X: 475,494, Y: 262,282, one pixel: 484 262
Blob 50 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 54 of 60, id: 15, sources: 1, size: 19x20, npix 218, brick X: 293,312, Y: 125,145, one pixel: 302 125
Blob 51 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 55 of 60, id: 24, sources: 1, size: 16x21, npix 213, brick X: 0,16, Y: 193,214, one pixel: 6 193
Blob 52 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 56 of 60, id: 41, sources: 1, size: 20x19, npix 209, brick X: 310,330, Y: 363,382, one pixel: 318 363
Blob 53 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145396 MB
Blob 57 of 60, id: 22, sources: 1, size: 19x19, npix 208, brick X: 120,139, Y: 172,191, one pixel: 128 172
Blob 49 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 58 of 60, id: 12, sources: 1, size: 19x19, npix 199, brick X: 300,319, Y: 109,128, one pixel: 308 109
Blob 56 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145268 MB
Blob 59 of 60, id: 45, sources: 1, size: 18x18, npix 180, brick X: 111,129, Y: 405,423, one pixel: 119 405
Blob 54 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 60 of 60, id: 31, sources: 1, size: 18x18, npix 171, brick X: 450,468, Y: 254,272, one pixel: 458 254
Blob 58 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 55 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145652 MB
Blob 57 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145532 MB
Blob 59 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 810 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145856 MB
Blob 60 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 809 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145652 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.67402, ee1=-0.00387979, ee2=0.417256
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 38.08 s, CPU: 37.99 s, VmPeak: 810 MB, VmSize: 715 MB, VmRSS: 148 MB, VmData: 180 MB, maxrss: 0.175144 MB
Old catalog: 124
New catalog: 129
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/blobs-custom-104134p47759.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/metrics/cus/all-models-custom-104134p47759.fits
Stage fitblobs : Wall: 38.70 s, CPU: 1.10 s, VmPeak: 1001 MB, VmSize: 978 MB, VmRSS: 260 MB, VmData: 289 MB, maxrss: 0.566556 MB
Stage fitblobs finished: 2020-06-07T17:37:01.729864
Resources for stage fitblobs : 105.641 s worker CPU, 106.976 s worker Wall, Wall: 38.700 s, Cores in use: 2.76, Total efficiency (on 4 cores): 69.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:37:01.732153
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/tmp-legacysurvey-custom-104134p47759-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/tmp-legacysurvey-custom-104134p47759-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/tmp-legacysurvey-custom-104134p47759-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/tmp-legacysurvey-custom-104134p47759-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-resid.jpg
Stage coadds : Wall: 2.77 s, CPU: 1.20 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 293 MB, VmData: 321 MB, maxrss: 0.566556 MB
Stage coadds finished: 2020-06-07T17:37:04.504861
Resources for stage coadds : 4.785 s worker CPU, 4.866 s worker Wall, Wall: 2.776 s, Cores in use: 2.16, Total efficiency (on 4 cores): 53.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:37:04.508527
Cut to 1 unWISE tiles
Reading WISE tile 1034p484 band 1
Reading WISE tile 1034p484 band 2
Reading WISE tile 1034p484 band 3
Reading WISE tile 1034p484 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 1.22 s, CPU: 2.36 s, VmPeak: 1069 MB, VmSize: 1005 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.2057 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.46 s, CPU: 0.74 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.210172 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.47 s, CPU: 0.66 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 149 MB, VmData: 191 MB, maxrss: 0.21376 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/103/1034p484/unwise-1034p484-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.63 s, CPU: 0.99 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.213336 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/tmp-legacysurvey-custom-104134p47759-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/tmp-legacysurvey-custom-104134p47759-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.11 s, CPU: 0.95 s, VmPeak: 1008 MB, VmSize: 974 MB, VmRSS: 256 MB, VmData: 287 MB, maxrss: 0.566556 MB
Stage wise_forced finished: 2020-06-07T17:37:08.614776
Resources for stage wise_forced : 9.708 s worker CPU, 10.837 s worker Wall, Wall: 4.108 s, Cores in use: 2.59, Total efficiency (on 4 cores): 64.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:37:08.617151
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/coadd/cus/custom-104134p47759/legacysurvey-custom-104134p47759-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/tractor-i/cus/tractor-custom-104134p47759.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/tractor/cus/tractor-custom-104134p47759.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/104/PGC2303904/tractor/cus/brick-custom-104134p47759.sha256sum
Stage writecat : Wall: 1.99 s, CPU: 1.18 s, VmPeak: 1119 MB, VmSize: 991 MB, VmRSS: 274 MB, VmData: 299 MB, maxrss: 0.566556 MB
Stage writecat finished: 2020-06-07T17:37:10.611928
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.996 s, Cores in use: 0.59, Total efficiency (on 4 cores): 14.8 %
Stage writecat finished
All done: 132.648 s worker CPU, 148.717 s worker Wall, Wall: 66.370 s, Cores in use: 2.23, Total efficiency (on 4 cores): 55.6 %
Finished galaxy PGC2303904 in 1.225 minutes.