Started working on galaxy 2MASXJ16254375+2651291 at Sun Jun  7 05:01:52 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 246.4323465 26.858088399999996 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T05:01:52.783131
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '246.4323465', '26.858088399999996', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 246.4323465 26.858088399999996 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 246.4323465 26.858088399999996
Starting process 51654 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 51655 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 51656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 51657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T05:01:53.146159
Keeping 9 CCDs:
   c4d_140815_234654_ooi_z_ls9.fits.fz c4d_140815_234654_ooi_z_ls9-S7 z exptime 121.0 propid 2014B-0404 seeing 0.96 MJD 56884.989 object DECaLS_88_z
   c4d_180516_052813_ooi_g_ls9.fits.fz c4d_180516_052813_ooi_g_ls9-S7 g exptime 134.0 propid 2014B-0404 seeing 1.30 MJD 58254.228 object DECaLS_88_g
   c4d_180516_052624_ooi_r_ls9.fits.fz c4d_180516_052624_ooi_r_ls9-S7 r exptime 79.0 propid 2014B-0404 seeing 1.02 MJD 58254.227 object DECaLS_88_r
   c4d_170720_014603_ooi_g_ls9.fits.fz c4d_170720_014603_ooi_g_ls9-S12 g exptime 200.0 propid 2014B-0404 seeing 1.41 MJD 57954.071 object DECaLS_31832_g
   c4d_180212_091934_ooi_z_ls9.fits.fz c4d_180212_091934_ooi_z_ls9-S12 z exptime 153.0 propid 2014B-0404 seeing 1.16 MJD 58161.389 object DECaLS_31832_z
   c4d_140814_004243_ooi_r_ls9.fits.fz c4d_140814_004243_ooi_r_ls9-S12 r exptime 125.0 propid 2014B-0404 seeing 1.31 MJD 56883.028 object DECaLS_31832_r
   c4d_160609_052859_ooi_g_ls9.fits.fz c4d_160609_052859_ooi_g_ls9-S13 g exptime 152.0 propid 2014B-0404 seeing 1.73 MJD 57548.226 object DECaLS_15960_g
   c4d_170521_061911_ooi_r_ls9.fits.fz c4d_170521_061911_ooi_r_ls9-S13 r exptime 121.0 propid 2014B-0404 seeing 1.30 MJD 57894.261 object DECaLS_15960_r
   c4d_150410_075241_ooi_z_ls9.fits.fz c4d_150410_075241_ooi_z_ls9-S13 z exptime 111.0 propid 2014B-0404 seeing 1.04 MJD 57122.326 object DECaLS_15960_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530281-g-20180516T052813_oi[S7,noinherit][2046,4094][real]: DECaLS_8
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T234401_oi[S7,noinherit][2046,4094][real]: DECaLS_8
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170720T014150_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091934_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560003-r-20180516T052624_oi[S7,noinherit][2046,4094][real]: DECaLS_8
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95648f6-g-20160609T052538_oi[S13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954793b-r-20140814T003947_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e9f3-z-20150410T074958_oi[S13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95197f6-r-20170521T061616_oi[S13,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 95.13 s, CPU: 0.94 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.454656 MB
Stage tims finished: 2020-06-07T05:03:28.271931
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T234401_oi[S7,noinherit][2046,4094][real]: DECaLS_8 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95648f6-g-20160609T052538_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170720T014150_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954793b-r-20140814T003947_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530281-g-20180516T052813_oi[S7,noinherit][2046,4094][real]: DECaLS_8 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091934_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95197f6-r-20170521T061616_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560003-r-20180516T052624_oi[S7,noinherit][2046,4094][real]: DECaLS_8 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956e9f3-z-20150410T074958_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 3.773 s worker CPU, 328.914 s worker Wall, Wall: 95.127 s, Cores in use: 0.05, Total efficiency (on 4 cores): 1.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T05:03:28.295097
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03480.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03351.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/reference-custom-246432p26858.fits
Stage refs : Wall: 4.43 s, CPU: 2.87 s, VmPeak: 1031 MB, VmSize: 1025 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.454656 MB
Stage refs finished: 2020-06-07T05:03:32.724298
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.430 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T05:03:32.725811
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/outlier-mask-custom-246432p26858.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/outliers-pre-custom-246432p26858.jpg
Image c4d_180516_052813_ooi_g_ls9-S7 g : masking 821 positive outlier pixels and 0 negative outlier pixels
Image c4d_140814_004243_ooi_r_ls9-S12 r : masking 942 positive outlier pixels and 0 negative outlier pixels
Image c4d_180212_091934_ooi_z_ls9-S12 z : masking 189 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/outlier-mask-custom-246432p26858.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/outliers-post-custom-246432p26858.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/outliers-masked-pos-custom-246432p26858.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/outliers-masked-neg-custom-246432p26858.jpg
Stage outliers : Wall: 1.05 s, CPU: 0.77 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 217 MB, VmData: 247 MB, maxrss: 0.454656 MB
Stage outliers finished: 2020-06-07T05:03:33.779815
Resources for stage outliers : 0.801 s worker CPU, 0.805 s worker Wall, Wall: 1.055 s, Cores in use: 1.49, Total efficiency (on 4 cores): 37.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T05:03:33.781630
Stage halos : Wall: 2.54 s, CPU: 0.40 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.454656 MB
Stage halos finished: 2020-06-07T05:03:36.320640
Resources for stage halos : 0.174 s worker CPU, 5.739 s worker Wall, Wall: 2.540 s, Cores in use: 0.22, Total efficiency (on 4 cores): 5.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T05:03:36.322599
PSF sigmas in coadd pixels: ['2.12', '2.29', '2.82']
Using average PSF sigma 2.4086532107628362
Gaussian PSF norm 0.11711722987492122 vs pixelized 0.10308113
average tim pixel scale / coadd scale: 1.0012964143076528
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.65', '2.12', '2.11']
Using average PSF sigma 1.9605272586433433
Gaussian PSF norm 0.1438872071429824 vs pixelized 0.1165406
average tim pixel scale / coadd scale: 1.0013265401046751
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.55', '1.89', '1.69']
Using average PSF sigma 1.7089466423237092
Gaussian PSF norm 0.16506939701189552 vs pixelized 0.13387695
average tim pixel scale / coadd scale: 1.0013388703534565
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.17 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.454656 MB
Stage fit_on_coadds finished: 2020-06-07T05:03:36.564819
Resources for stage fit_on_coadds : 0.199 s worker CPU, 0.199 s worker Wall, Wall: 0.243 s, Cores in use: 1.51, Total efficiency (on 4 cores): 37.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T05:03:36.567278
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22 potential peaks
Of 22 potential peaks: 5 in veto map, 0 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 27 potential peaks
Of 27 potential peaks: 21 in veto map, 1 cut by saddle test, 0 cut by aper test, 5 kept
SED r : 5 new peaks
Found 26 potential peaks
Of 26 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED g : 4 new peaks
Found 36 potential peaks
Of 36 potential peaks: 30 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 39 potential peaks
Of 39 potential peaks: 31 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 31 new sources
Median coadd sky for g : 4.276129e-05
Median coadd sky for r : 2.179617e-05
Median coadd sky for z : 0.00014890527
Stage srcs : Wall: 0.54 s, CPU: 0.49 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.454656 MB
Stage srcs finished: 2020-06-07T05:03:37.104528
Resources for stage srcs : 0.135 s worker CPU, 0.147 s worker Wall, Wall: 0.538 s, Cores in use: 1.16, Total efficiency (on 4 cores): 28.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/2MASXJ16254375+2651291-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T05:03:39.619797
Blob 1 of 25, id: 8, sources: 4, size: 100x111, npix 6793, brick X: 109,209, Y: 88,199, one pixel: 159 88
Blob 2 of 25, id: 15, sources: 3, size: 49x73, npix 1916, brick X: 235,284, Y: 170,243, one pixel: 263 170
Blob 3 of 25, id: 14, sources: 3, size: 52x43, npix 1188, brick X: 20,72, Y: 156,199, one pixel: 57 156
Blob 4 of 25, id: 4, sources: 1, size: 34x42, npix 1068, brick X: 0,34, Y: 31,73, one pixel: 11 31
Blob 5 of 25, id: 7, sources: 1, size: 34x34, npix 769, brick X: 204,238, Y: 77,111, one pixel: 220 77
Blob 4 finished, total: Wall: 2.14 s, CPU: 2.14 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 6 of 25, id: 1, sources: 2, size: 39x32, npix 757, brick X: 241,280, Y: 0,32, one pixel: 262 0
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.65 s, CPU: 2.64 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146832 MB
Blob 7 of 25, id: 20, sources: 2, size: 39x37, npix 755, brick X: 198,237, Y: 252,289, one pixel: 213 252
Blob 6 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146832 MB
Blob 8 of 25, id: 13, sources: 1, size: 32x29, npix 555, brick X: 226,258, Y: 134,163, one pixel: 235 134
Blob 5 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 9 of 25, id: 2, sources: 2, size: 23x38, npix 551, brick X: 69,92, Y: 9,47, one pixel: 80 9
Blob 3 finished, total: Wall: 4.10 s, CPU: 4.10 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149336 MB
Blob 10 of 25, id: 17, sources: 1, size: 33x24, npix 535, brick X: 177,210, Y: 206,230, one pixel: 192 206
Blob 7 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146832 MB
Blob 11 of 25, id: 3, sources: 1, size: 28x28, npix 519, brick X: 196,224, Y: 13,41, one pixel: 206 13
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149336 MB
Blob 12 of 25, id: 16, sources: 1, size: 29x28, npix 517, brick X: 141,170, Y: 197,225, one pixel: 152 197
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146832 MB
Blob 13 of 25, id: 19, sources: 1, size: 28x28, npix 509, brick X: 35,63, Y: 251,279, one pixel: 47 251
Blob 8 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 14 of 25, id: 11, sources: 1, size: 28x26, npix 471, brick X: 41,69, Y: 119,145, one pixel: 52 119
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.56931, ee1=0.335475, ee2=0.438431
Blob 1 finished, total: Wall: 5.71 s, CPU: 5.71 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149892 MB
Blob 15 of 25, id: 10, sources: 1, size: 24x29, npix 458, brick X: 252,276, Y: 104,133, one pixel: 263 104
Blob 11 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149336 MB
Blob 16 of 25, id: 6, sources: 2, size: 30x26, npix 457, brick X: 74,104, Y: 75,101, one pixel: 84 75
Blob 12 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146832 MB
Blob 17 of 25, id: 18, sources: 1, size: 27x27, npix 443, brick X: 14,41, Y: 233,260, one pixel: 25 233
Blob 13 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 18 of 25, id: 22, sources: 1, size: 25x27, npix 403, brick X: 8,33, Y: 262,289, one pixel: 20 262
Blob 14 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149892 MB
Blob 19 of 25, id: 5, sources: 1, size: 20x24, npix 312, brick X: 275,295, Y: 68,92, one pixel: 285 68
Blob 17 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 20 of 25, id: 23, sources: 1, size: 21x21, npix 278, brick X: 66,87, Y: 271,292, one pixel: 74 271
Blob 16 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148976 MB
Blob 21 of 25, id: 9, sources: 1, size: 20x19, npix 218, brick X: 28,48, Y: 101,120, one pixel: 36 101
Blob 18 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149892 MB
Blob 22 of 25, id: 0, sources: 1, size: 20x17, npix 212, brick X: 218,238, Y: 0,17, one pixel: 225 0
Blob 19 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 23 of 25, id: 21, sources: 1, size: 18x19, npix 198, brick X: 154,172, Y: 254,273, one pixel: 162 254
Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149892 MB
Blob 24 of 25, id: 24, sources: 1, size: 18x18, npix 171, brick X: 156,174, Y: 273,291, one pixel: 164 273
Blob 15 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149336 MB
Blob 25 of 25, id: 12, sources: 1, size: 17x17, npix 145, brick X: 14,31, Y: 123,140, one pixel: 22 123
Blob 22 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 23 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149892 MB
Blob 25 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146952 MB
Blob 24 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149336 MB
Blob 20 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148976 MB
Old catalog: 40
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/blobs-custom-246432p26858.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/metrics/cus/all-models-custom-246432p26858.fits
Stage fitblobs : Wall: 8.27 s, CPU: 0.48 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.454656 MB
Stage fitblobs finished: 2020-06-07T05:03:47.886543
Resources for stage fitblobs : 31.047 s worker CPU, 31.106 s worker Wall, Wall: 8.268 s, Cores in use: 3.81, Total efficiency (on 4 cores): 95.3 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T05:03:47.888088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/tmp-legacysurvey-custom-246432p26858-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/tmp-legacysurvey-custom-246432p26858-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/tmp-legacysurvey-custom-246432p26858-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/tmp-legacysurvey-custom-246432p26858-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-resid.jpg
Stage coadds : Wall: 1.34 s, CPU: 0.53 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.454656 MB
Stage coadds finished: 2020-06-07T05:03:49.231027
Resources for stage coadds : 2.512 s worker CPU, 2.609 s worker Wall, Wall: 1.344 s, Cores in use: 2.26, Total efficiency (on 4 cores): 56.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T05:03:49.232482
Cut to 1 unWISE tiles
Reading WISE tile 2467p272 band 2
Reading WISE tile 2467p272 band 1
Reading WISE tile 2467p272 band 3
Reading WISE tile 2467p272 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 963 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.19152 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 954 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205032 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 952 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210828 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2467p272/unwise-2467p272-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 958 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210628 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/tmp-legacysurvey-custom-246432p26858-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/tmp-legacysurvey-custom-246432p26858-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.94 s, CPU: 0.51 s, VmPeak: 1034 MB, VmSize: 1034 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.454656 MB
Stage wise_forced finished: 2020-06-07T05:03:56.170589
Resources for stage wise_forced : 3.301 s worker CPU, 14.569 s worker Wall, Wall: 6.939 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T05:03:56.172522
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/coadd/cus/custom-246432p26858/legacysurvey-custom-246432p26858-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/tractor-i/cus/tractor-custom-246432p26858.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/tractor/cus/tractor-custom-246432p26858.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/2MASXJ16254375+2651291/tractor/cus/brick-custom-246432p26858.sha256sum
Stage writecat : Wall: 2.02 s, CPU: 1.12 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.454656 MB
Stage writecat finished: 2020-06-07T05:03:58.192439
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.021 s, Cores in use: 0.56, Total efficiency (on 4 cores): 13.9 %
Stage writecat finished
All done: 41.943 s worker CPU, 384.090 s worker Wall, Wall: 125.051 s, Cores in use: 0.40, Total efficiency (on 4 cores): 10.0 %
Finished galaxy 2MASXJ16254375+2651291 in 2.107 minutes.