Started working on galaxy PGC1502834 at Sun Jun  7 17:50:44 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.7932085 16.1863611 --width 301 --height 301 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:50:45.727731
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.7932085', '16.1863611', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.7932085 16.1863611 --width 301 --height 301 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.7932085 16.1863611
Starting process 33926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 33927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 33928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 33929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:50:46.488497
Keeping 13 CCDs:
   c4d_181017_044520_ooi_z_ls9.fits.fz c4d_181017_044520_ooi_z_ls9-S24 z exptime 93.0 propid 2014B-0404 seeing 1.46 MJD 58408.198 object DECaLS_34030_z
   c4d_181017_065608_ooi_r_ls9.fits.fz c4d_181017_065608_ooi_r_ls9-S24 r exptime 90.0 propid 2014B-0404 seeing 1.52 MJD 58408.289 object DECaLS_34030_r
   c4d_181015_024402_ooi_z_ls9.fits.fz c4d_181015_024402_ooi_z_ls9-S24 z exptime 161.0 propid 2014B-0404 seeing 1.46 MJD 58406.114 object DECaLS_34030_z
   c4d_140812_100120_ooi_z_ls9.fits.fz c4d_140812_100120_ooi_z_ls9-N31 z exptime 129.0 propid 2014B-0404 seeing 1.14 MJD 56881.416 object DECaLS_2265_z
   c4d_171111_033521_ooi_r_ls9.fits.fz c4d_171111_033521_ooi_r_ls9-N31 r exptime 80.0 propid 2014B-0404 seeing 0.92 MJD 58068.150 object DECaLS_2265_r
   c4d_181104_044813_ooi_g_ls9.fits.fz c4d_181104_044813_ooi_g_ls9-S24 g exptime 96.0 propid 2014B-0404 seeing 1.16 MJD 58426.200 object DECaLS_34030_g
   c4d_160812_095556_ooi_r_ls9.fits.fz c4d_160812_095556_ooi_r_ls9-S20 r exptime 65.0 propid 2014B-0404 seeing 1.31 MJD 57612.413 object DECaLS_18138_r
   c4d_160724_092729_ooi_z_ls9.fits.fz c4d_160724_092729_ooi_z_ls9-S20 z exptime 118.0 propid 2016A-0190 seeing 0.96 MJD 57593.392 object DECaLS_18138_z
   c4d_160813_083647_ooi_g_ls9.fits.fz c4d_160813_083647_ooi_g_ls9-S20 g exptime 148.0 propid 2014B-0404 seeing 1.08 MJD 57613.357 object DECaLS_18138_g
   c4d_160812_095259_ooi_g_ls9.fits.fz c4d_160812_095259_ooi_g_ls9-N31 g exptime 173.0 propid 2014B-0404 seeing 1.44 MJD 57612.409 object DECaLS_2265_g
   c4d_160722_094408_ooi_z_ls9.fits.fz c4d_160722_094408_ooi_z_ls9-S21 z exptime 80.0 propid 2016A-0190 seeing 0.91 MJD 57591.404 object DECaLS_2266_z
   c4d_170917_074129_ooi_r_ls9.fits.fz c4d_170917_074129_ooi_r_ls9-S21 r exptime 65.0 propid 2014B-0404 seeing 1.13 MJD 58013.320 object DECaLS_2266_r
   c4d_171111_035201_ooi_g_ls9.fits.fz c4d_171111_035201_ooi_g_ls9-S21 g exptime 80.0 propid 2014B-0404 seeing 1.12 MJD 58068.161 object DECaLS_2266_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b856-z-20140812T095820_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95316b1-z-20181015T024402_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181017T044520_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95376f2-r-20181017T065608_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9565ac1-r-20160812T095401_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T044813_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160724T092438_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95269df-r-20171111T033521_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094908_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160813T083328_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T094158_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526dbd-g-20171111T035201_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523d7d-r-20170917T074129_oi[S21,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 25.04 s, CPU: 0.90 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 180 MB, VmData: 213 MB, maxrss: 0.566564 MB
Stage tims finished: 2020-06-07T17:51:11.523732
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181017T044520_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9565ac1-r-20160812T095401_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160813T083328_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95376f2-r-20181017T065608_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160724T092438_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b7a0-z-20160722T094158_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95316b1-z-20181015T024402_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T044813_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95618a0-g-20160812T094908_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526dbd-g-20171111T035201_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b856-z-20140812T095820_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95269df-r-20171111T033521_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523d7d-r-20170917T074129_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.969 s worker CPU, 85.004 s worker Wall, Wall: 25.037 s, Cores in use: 0.23, Total efficiency (on 4 cores): 5.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:51:11.556267
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04298.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04427.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04426.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/reference-custom-029793p16186.fits
Stage refs : Wall: 1.91 s, CPU: 1.49 s, VmPeak: 1026 MB, VmSize: 1009 MB, VmRSS: 194 MB, VmData: 226 MB, maxrss: 0.566564 MB
Stage refs finished: 2020-06-07T17:51:13.469635
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.914 s, Cores in use: 0.78, Total efficiency (on 4 cores): 19.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:51:13.471097
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/outlier-mask-custom-029793p16186.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/outliers-pre-custom-029793p16186.jpg
Image c4d_181104_044813_ooi_g_ls9-S24 g : masking 0 positive outlier pixels and 100 negative outlier pixels
Image c4d_160812_095259_ooi_g_ls9-N31 g : masking 408 positive outlier pixels and 0 negative outlier pixels
Image c4d_171111_035201_ooi_g_ls9-S21 g : masking 69 positive outlier pixels and 0 negative outlier pixels
Image c4d_160812_095556_ooi_r_ls9-S20 r : masking 210 positive outlier pixels and 0 negative outlier pixels
Image c4d_181017_065608_ooi_r_ls9-S24 r : masking 301 positive outlier pixels and 0 negative outlier pixels
Image c4d_171111_033521_ooi_r_ls9-N31 r : masking 0 positive outlier pixels and 48 negative outlier pixels
Image c4d_181017_044520_ooi_z_ls9-S24 z : masking 106 positive outlier pixels and 66 negative outlier pixels
Image c4d_181015_024402_ooi_z_ls9-S24 z : masking 1273 positive outlier pixels and 0 negative outlier pixels
Image c4d_160722_094408_ooi_z_ls9-S21 z : masking 331 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/outlier-mask-custom-029793p16186.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/outliers-post-custom-029793p16186.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/outliers-masked-pos-custom-029793p16186.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/outliers-masked-neg-custom-029793p16186.jpg
Stage outliers : Wall: 1.59 s, CPU: 0.84 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.566564 MB
Stage outliers finished: 2020-06-07T17:51:15.057453
Resources for stage outliers : 1.890 s worker CPU, 1.951 s worker Wall, Wall: 1.587 s, Cores in use: 1.72, Total efficiency (on 4 cores): 43.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:51:15.059142
Stage halos : Wall: 0.60 s, CPU: 0.24 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.566564 MB
Stage halos finished: 2020-06-07T17:51:15.655289
Resources for stage halos : 0.224 s worker CPU, 1.182 s worker Wall, Wall: 0.597 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:51:15.657207
PSF sigmas in coadd pixels: ['1.89', '1.76', '2.35', '1.82']
Using average PSF sigma 1.952112358375982
Gaussian PSF norm 0.1445074565321439 vs pixelized 0.12561947
average tim pixel scale / coadd scale: 1.0012023878294463
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.46', '1.49', '2.13', '1.84']
Using average PSF sigma 1.9791447997433063
Gaussian PSF norm 0.14253368010792625 vs pixelized 0.11936924
average tim pixel scale / coadd scale: 1.0012382288634036
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.37', '2.38', '1.85', '1.56', '1.48']
Using average PSF sigma 1.9282384248351754
Gaussian PSF norm 0.14629663434800158 vs pixelized 0.11130391
average tim pixel scale / coadd scale: 1.0012231126448978
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.28 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.566564 MB
Stage fit_on_coadds finished: 2020-06-07T17:51:15.966574
Resources for stage fit_on_coadds : 0.357 s worker CPU, 0.391 s worker Wall, Wall: 0.310 s, Cores in use: 2.06, Total efficiency (on 4 cores): 51.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:51:15.969518
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 23 potential peaks
Of 23 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 15 kept
SED z : 15 new peaks
Found 32 potential peaks
Of 32 potential peaks: 23 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 34 potential peaks
Of 34 potential peaks: 26 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 44 potential peaks
Of 44 potential peaks: 36 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 43 potential peaks
Of 43 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 23 new sources
Median coadd sky for g : 1.0020322e-05
Median coadd sky for r : 6.391393e-05
Median coadd sky for z : 0.00010058332
Stage srcs : Wall: 0.62 s, CPU: 0.56 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.566564 MB
Stage srcs finished: 2020-06-07T17:51:16.586477
Resources for stage srcs : 0.156 s worker CPU, 0.165 s worker Wall, Wall: 0.618 s, Cores in use: 1.16, Total efficiency (on 4 cores): 29.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/PGC1502834-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:51:16.601433
Blob 1 of 18, id: 10, sources: 6, size: 215x141, npix 17066, brick X: 77,292, Y: 86,227, one pixel: 147 86
Blob 2 of 18, id: 4, sources: 2, size: 37x51, npix 1264, brick X: 30,67, Y: 18,69, one pixel: 46 18
Blob 3 of 18, id: 15, sources: 1, size: 32x42, npix 918, brick X: 57,89, Y: 215,257, one pixel: 75 215
Blob 4 of 18, id: 11, sources: 1, size: 36x37, npix 898, brick X: 27,63, Y: 115,152, one pixel: 43 115
Blob 5 of 18, id: 2, sources: 1, size: 29x29, npix 526, brick X: 178,207, Y: 11,40, one pixel: 192 11
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148832 MB
Blob 6 of 18, id: 7, sources: 1, size: 27x28, npix 510, brick X: 1,28, Y: 36,64, one pixel: 12 36
Blob 4 finished, total: Wall: 2.02 s, CPU: 2.02 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB
Blob 7 of 18, id: 17, sources: 2, size: 38x24, npix 496, brick X: 58,96, Y: 265,289, one pixel: 85 265
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB
Blob 8 of 18, id: 14, sources: 1, size: 28x27, npix 486, brick X: 227,255, Y: 207,234, one pixel: 238 207
Blob 2 finished, total: Wall: 2.87 s, CPU: 2.86 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14916 MB
Blob 9 of 18, id: 5, sources: 1, size: 28x27, npix 473, brick X: 71,99, Y: 23,50, one pixel: 84 23
Blob 6 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB
Blob 10 of 18, id: 8, sources: 1, size: 28x27, npix 458, brick X: 159,187, Y: 36,63, one pixel: 173 36
Blob 7 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB
Blob 11 of 18, id: 1, sources: 1, size: 28x16, npix 330, brick X: 93,121, Y: 0,16, one pixel: 94 0
Blob 8 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14916 MB
Blob 12 of 18, id: 9, sources: 1, size: 19x25, npix 327, brick X: 282,301, Y: 45,70, one pixel: 293 45
Blob 10 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB
Blob 13 of 18, id: 13, sources: 1, size: 23x23, npix 326, brick X: 269,292, Y: 158,181, one pixel: 279 158
Blob 9 finished, total: Wall: 1.47 s, CPU: 1.47 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149396 MB
Blob 14 of 18, id: 0, sources: 1, size: 26x16, npix 284, brick X: 36,62, Y: 0,16, one pixel: 38 0
Blob 11 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14916 MB
Blob 15 of 18, id: 6, sources: 1, size: 22x21, npix 279, brick X: 127,149, Y: 29,50, one pixel: 136 29
Blob 12 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB
Blob 16 of 18, id: 16, sources: 1, size: 18x23, npix 277, brick X: 283,301, Y: 240,263, one pixel: 292 240
Blob 13 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149396 MB
Blob 17 of 18, id: 3, sources: 1, size: 19x21, npix 219, brick X: 217,236, Y: 13,34, one pixel: 226 13
Blob 15 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB
Blob 18 of 18, id: 12, sources: 1, size: 16x19, npix 190, brick X: 0,16, Y: 118,137, one pixel: 6 118
Blob 14 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14916 MB
Blob 16 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149396 MB
Blob 17 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14946 MB
Blob 18 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14916 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.608726, ee1=-0.203598, ee2=0.0326218
Blob 1 finished, total: Wall: 18.04 s, CPU: 18.03 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149272 MB
Old catalog: 27
New catalog: 27
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/blobs-custom-029793p16186.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/metrics/cus/all-models-custom-029793p16186.fits
Stage fitblobs : Wall: 18.41 s, CPU: 0.39 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.566564 MB
Stage fitblobs finished: 2020-06-07T17:51:35.009541
Resources for stage fitblobs : 37.052 s worker CPU, 37.111 s worker Wall, Wall: 18.409 s, Cores in use: 2.03, Total efficiency (on 4 cores): 50.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:51:35.011271
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/tmp-legacysurvey-custom-029793p16186-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/tmp-legacysurvey-custom-029793p16186-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/tmp-legacysurvey-custom-029793p16186-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/tmp-legacysurvey-custom-029793p16186-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-resid.jpg
Stage coadds : Wall: 1.48 s, CPU: 0.65 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.566564 MB
Stage coadds finished: 2020-06-07T17:51:36.495137
Resources for stage coadds : 2.483 s worker CPU, 2.703 s worker Wall, Wall: 1.485 s, Cores in use: 2.11, Total efficiency (on 4 cores): 52.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:51:36.496745
Cut to 1 unWISE tiles
Reading WISE tile 0298p166 band 2
Reading WISE tile 0298p166 band 1
Reading WISE tile 0298p166 band 3
Reading WISE tile 0298p166 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 961 MB, VmSize: 798 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.191764 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.20716 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 957 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.207076 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0298p166/unwise-0298p166-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 962 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.210732 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/tmp-legacysurvey-custom-029793p16186-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/tmp-legacysurvey-custom-029793p16186-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.58 s, CPU: 0.46 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 217 MB, VmData: 243 MB, maxrss: 0.566564 MB
Stage wise_forced finished: 2020-06-07T17:51:39.080557
Resources for stage wise_forced : 4.789 s worker CPU, 7.008 s worker Wall, Wall: 2.585 s, Cores in use: 2.03, Total efficiency (on 4 cores): 50.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:51:39.082355
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/coadd/cus/custom-029793p16186/legacysurvey-custom-029793p16186-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/tractor-i/cus/tractor-custom-029793p16186.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/tractor/cus/tractor-custom-029793p16186.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1502834/tractor/cus/brick-custom-029793p16186.sha256sum
Stage writecat : Wall: 1.21 s, CPU: 0.56 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 219 MB, VmData: 243 MB, maxrss: 0.566564 MB
Stage writecat finished: 2020-06-07T17:51:40.295257
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.214 s, Cores in use: 0.46, Total efficiency (on 4 cores): 11.6 %
Stage writecat finished
All done: 51.921 s worker CPU, 135.517 s worker Wall, Wall: 53.812 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.1 %
Finished galaxy PGC1502834 in 0.937 minutes.