Started working on galaxy PGC165744 at Sat Jun  6 10:37:54 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.2453505 15.4479685 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T10:37:55.163172
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.2453505', '15.4479685', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.2453505 15.4479685 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 267.2453505 15.4479685
Starting process 54868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 54869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 54870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 54871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 54872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 54873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Starting process 54874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Starting process 54875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T10:37:57.777888
Keeping 13 CCDs:
   c4d_170316_083715_ooi_z_ls9.fits.fz c4d_170316_083715_ooi_z_ls9-N5 z exptime 250.0 propid 2014B-0404 seeing 1.15 MJD 57828.356 object DECaLS_15321_z
   c4d_170722_030038_ooi_g_ls9.fits.fz c4d_170722_030038_ooi_g_ls9-N5 g exptime 139.0 propid 2014B-0404 seeing 1.34 MJD 57956.123 object DECaLS_15321_g
   c4d_170722_025752_ooi_r_ls9.fits.fz c4d_170722_025752_ooi_r_ls9-N5 r exptime 49.0 propid 2014B-0404 seeing 1.20 MJD 57956.122 object DECaLS_15321_r
   c4d_180514_080916_ooi_r_ls9.fits.fz c4d_180514_080916_ooi_r_ls9-N3 r exptime 175.0 propid 2014B-0404 seeing 1.48 MJD 58252.340 object DECaLS_47065_r
   c4d_180922_012034_ooi_z_ls9.fits.fz c4d_180922_012034_ooi_z_ls9-N4 z exptime 250.0 propid 2014B-0404 seeing 1.37 MJD 58383.056 object DECaLS_31193_z
   c4d_180809_022424_ooi_r_ls9.fits.fz c4d_180809_022424_ooi_r_ls9-N4 r exptime 42.0 propid 2014B-0404 seeing 1.12 MJD 58339.100 object DECaLS_31193_r
   c4d_170725_033652_ooi_g_ls9.fits.fz c4d_170725_033652_ooi_g_ls9-N4 g exptime 200.0 propid 2014B-0404 seeing 1.68 MJD 57959.148 object DECaLS_31193_g
   c4d_170720_034220_ooi_g_ls9.fits.fz c4d_170720_034220_ooi_g_ls9-N3 g exptime 200.0 propid 2014B-0404 seeing 1.36 MJD 57954.151 object DECaLS_47065_g
   c4d_160722_052716_ooi_z_ls9.fits.fz c4d_160722_052716_ooi_z_ls9-N3 z exptime 218.0 propid 2016A-0190 seeing 1.51 MJD 57591.224 object DECaLS_47065_z
   c4d_180514_100814_ooi_z_ls9.fits.fz c4d_180514_100814_ooi_z_ls9-N4 z exptime 250.0 propid 2014B-0404 seeing 1.72 MJD 58252.422 object DECaLS_31193_z
   c4d_180829_022541_ooi_z_ls9.fits.fz c4d_180829_022541_ooi_z_ls9-N5 z exptime 149.0 propid 2014B-0404 seeing 1.16 MJD 58359.101 object DECaLS_49332_z
   c4d_180811_024702_ooi_r_ls9.fits.fz c4d_180811_024702_ooi_r_ls9-N5 r exptime 40.0 propid 2014B-0404 seeing 0.89 MJD 58341.116 object DECaLS_49332_r
   c4d_180811_024811_ooi_g_ls9.fits.fz c4d_180811_024811_ooi_g_ls9-N5 g exptime 87.0 propid 2014B-0404 seeing 1.06 MJD 58341.117 object DECaLS_49332_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955fb7b-r-20180514T080916_oi[N3,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f4f7-z-20170316T083217_oi[N5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951dcf7-r-20170722T025610_oi[N5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170720T033807_oi[N3,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d93e-g-20170722T025726_oi[N5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ff0f-g-20170725T033237_oi[N4,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20180922T012034_oi[N4,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530fec-r-20180809T022424_oi[N4,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c242-z-20160722T052248_oi[N3,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f4c3-z-20180829T022541_oi[N5,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95328e1-g-20180811T024811_oi[N5,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T024702_oi[N5,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180514T100814_oi[N4,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 134.59 s, CPU: 2.72 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.452068 MB
Stage tims finished: 2020-06-06T10:40:12.367981
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ff0f-g-20170725T033237_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20180922T012034_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530fec-r-20180809T022424_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955fb7b-r-20180514T080916_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c242-z-20160722T052248_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f4f7-z-20170316T083217_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f4c3-z-20180829T022541_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d93e-g-20170722T025726_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95328e1-g-20180811T024811_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170720T033807_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T024702_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Resources for stage tims : 6.650 s worker CPU, 396.081 s worker Wall, Wall: 134.592 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951dcf7-r-20170722T025610_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180514T100814_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Running stage refs at 2020-06-06T10:40:12.394218
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04511.fits
Matched 5 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/reference-custom-267245p15447.fits
Stage refs : Wall: 15.19 s, CPU: 13.63 s, VmPeak: 1128 MB, VmSize: 1122 MB, VmRSS: 304 MB, VmData: 335 MB, maxrss: 0.452068 MB
Stage refs finished: 2020-06-06T10:40:27.584607
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 15.192 s, Cores in use: 0.90, Total efficiency (on 8 cores): 11.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T10:40:27.586589
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outlier-mask-custom-267245p15447.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-pre-custom-267245p15447.jpg
Image c4d_170725_033652_ooi_g_ls9-N4 g : masking 394 positive outlier pixels and 0 negative outlier pixels
Image c4d_170720_034220_ooi_g_ls9-N3 g : masking 477 positive outlier pixels and 0 negative outlier pixels
Image c4d_180809_022424_ooi_r_ls9-N4 r : masking 270 positive outlier pixels and 0 negative outlier pixels
Image c4d_180811_024702_ooi_r_ls9-N5 r : masking 0 positive outlier pixels and 120 negative outlier pixels
Image c4d_170316_083715_ooi_z_ls9-N5 z : masking 279 positive outlier pixels and 0 negative outlier pixels
Image c4d_180922_012034_ooi_z_ls9-N4 z : masking 502 positive outlier pixels and 0 negative outlier pixels
Image c4d_160722_052716_ooi_z_ls9-N3 z : masking 123 positive outlier pixels and 0 negative outlier pixels
Image c4d_180514_100814_ooi_z_ls9-N4 z : masking 2281 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outlier-mask-custom-267245p15447.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-post-custom-267245p15447.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-masked-pos-custom-267245p15447.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-masked-neg-custom-267245p15447.jpg
Stage outliers : Wall: 2.07 s, CPU: 1.87 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 318 MB, VmData: 348 MB, maxrss: 0.452068 MB
Stage outliers finished: 2020-06-06T10:40:29.659021
Resources for stage outliers : 1.040 s worker CPU, 1.044 s worker Wall, Wall: 2.074 s, Cores in use: 1.40, Total efficiency (on 8 cores): 17.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T10:40:29.661317
Stage halos : Wall: 4.61 s, CPU: 2.18 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 318 MB, VmData: 348 MB, maxrss: 0.452068 MB
Stage halos finished: 2020-06-06T10:40:34.274782
Resources for stage halos : 0.551 s worker CPU, 9.624 s worker Wall, Wall: 4.615 s, Cores in use: 0.59, Total efficiency (on 8 cores): 7.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T10:40:34.277091
PSF sigmas in coadd pixels: ['2.18', '2.73', '2.21', '1.72']
Using average PSF sigma 2.2087067895980743
Gaussian PSF norm 0.1277194388600634 vs pixelized 0.106777005
average tim pixel scale / coadd scale: 1.0011270316806444
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.94', '2.40', '1.82', '1.44']
Using average PSF sigma 1.8989885591381406
Gaussian PSF norm 0.14855002175574317 vs pixelized 0.12066298
average tim pixel scale / coadd scale: 1.0011657969830627
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.86', '2.23', '2.45', '2.79', '1.88']
Using average PSF sigma 2.242533337809661
Gaussian PSF norm 0.1257929088578934 vs pixelized 0.10791088
average tim pixel scale / coadd scale: 1.0013098109563285
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 320 MB, VmData: 348 MB, maxrss: 0.452068 MB
Stage fit_on_coadds finished: 2020-06-06T10:40:34.466395
Resources for stage fit_on_coadds : 0.251 s worker CPU, 0.251 s worker Wall, Wall: 0.190 s, Cores in use: 2.26, Total efficiency (on 8 cores): 28.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T10:40:34.469611
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 77 potential peaks
Of 77 potential peaks: 30 in veto map, 13 cut by saddle test, 0 cut by aper test, 34 kept
SED z : 34 new peaks
Found 79 potential peaks
Of 79 potential peaks: 63 in veto map, 12 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 59 potential peaks
Of 59 potential peaks: 49 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 66 potential peaks
Of 66 potential peaks: 56 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 74 potential peaks
Of 74 potential peaks: 61 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 43 new sources
Median coadd sky for g : 5.5510398e-05
Median coadd sky for r : 0.0002017194
Median coadd sky for z : 0.0008758451
Stage srcs : Wall: 3.30 s, CPU: 3.28 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 320 MB, VmData: 348 MB, maxrss: 0.452068 MB
Stage srcs finished: 2020-06-06T10:40:37.774047
Resources for stage srcs : 0.064 s worker CPU, 0.064 s worker Wall, Wall: 3.305 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T10:40:37.787053
Blob 1 of 4, id: 0, sources: 53, size: 233x233, npix 42893, brick X: 0,233, Y: 0,233, one pixel: 53 0
Blob 2 of 4, id: 3, sources: 2, size: 26x51, npix 820, brick X: 207,233, Y: 156,207, one pixel: 222 156
Blob 3 of 4, id: 2, sources: 1, size: 22x31, npix 481, brick X: 0,22, Y: 124,155, one pixel: 4 124
Blob 4 of 4, id: 1, sources: 2, size: 28x36, npix 480, brick X: 204,232, Y: 0,36, one pixel: 212 0
Blob 3 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144596 MB
Blob 4 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 964 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145172 MB
Blob 2 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.1453 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.24178, 15.46057), pm (-4.8, 0.2), parallax 0.527 with NanoMaggies: g=16.1, r=15.6, z=15.5
Reset brightness to NanoMaggies: g=16.1, r=15.6, z=15.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.73279, ee1=0.260468, ee2=0.138742
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.24970, 15.43714), pm (-3.9, -5.3), parallax 0.342 with NanoMaggies: g=18.1, r=17.6, z=17.4
Reset brightness to NanoMaggies: g=18.1, r=17.6, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.24450, 15.45662), pm (-0.2, -2.1), parallax -0.035 with NanoMaggies: g=20.3, r=19.4, z=19.2
Reset brightness to NanoMaggies: g=19.3, r=18.6, z=18.3
Measuring 27 iterative sources
Blob 1 finished, total: Wall: 63.13 s, CPU: 63.12 s, VmPeak: 964 MB, VmSize: 721 MB, VmRSS: 152 MB, VmData: 184 MB, maxrss: 0.174544 MB
Old catalog: 66
New catalog: 81
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/blobs-custom-267245p15447.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/all-models-custom-267245p15447.fits
Stage fitblobs : Wall: 66.80 s, CPU: 3.62 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 322 MB, VmData: 349 MB, maxrss: 0.452068 MB
Stage fitblobs finished: 2020-06-06T10:41:44.588830
Resources for stage fitblobs : 65.268 s worker CPU, 65.285 s worker Wall, Wall: 66.804 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T10:41:44.591453
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-resid.jpg
Stage coadds : Wall: 3.15 s, CPU: 2.29 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 322 MB, VmData: 349 MB, maxrss: 0.452068 MB
Stage coadds finished: 2020-06-06T10:41:47.743699
Resources for stage coadds : 5.165 s worker CPU, 5.407 s worker Wall, Wall: 3.153 s, Cores in use: 2.36, Total efficiency (on 8 cores): 29.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T10:41:47.745285
Cut to 1 unWISE tiles
Reading WISE tile 2676p151 band 1
Reading WISE tile 2676p151 band 2
Reading WISE tile 2676p151 band 3
Reading WISE tile 2676p151 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.46 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 147 MB, VmData: 189 MB, maxrss: 0.18438 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.22 s, CPU: 0.53 s, VmPeak: 991 MB, VmSize: 991 MB, VmRSS: 140 MB, VmData: 183 MB, maxrss: 0.199824 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.24 s, VmPeak: 1063 MB, VmSize: 999 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.20812 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.24 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.20622 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.99 s, CPU: 2.17 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 323 MB, VmData: 349 MB, maxrss: 0.452068 MB
Stage wise_forced finished: 2020-06-06T10:41:52.736353
Resources for stage wise_forced : 4.583 s worker CPU, 7.306 s worker Wall, Wall: 4.993 s, Cores in use: 1.35, Total efficiency (on 8 cores): 16.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T10:41:52.738554
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/tractor-i/cus/tractor-custom-267245p15447.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/tractor/cus/tractor-custom-267245p15447.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/tractor/cus/brick-custom-267245p15447.sha256sum
Stage writecat : Wall: 3.82 s, CPU: 3.36 s, VmPeak: 1263 MB, VmSize: 1135 MB, VmRSS: 325 MB, VmData: 349 MB, maxrss: 0.463824 MB
Stage writecat finished: 2020-06-06T10:41:56.556759
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.819 s, Cores in use: 0.88, Total efficiency (on 8 cores): 11.0 %
Stage writecat finished
All done: 83.573 s worker CPU, 485.065 s worker Wall, Wall: 238.784 s, Cores in use: 0.50, Total efficiency (on 8 cores): 6.2 %
Finished galaxy PGC165744 in 4.044 minutes.
Started working on galaxy PGC165744 at Thu Jul 23 04:06:40 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.2453505 15.4479685 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-23T04:06:40.703336
legacypipe git version: DR9.5.5-21-g66b1aacb
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.2453505', '15.4479685', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.2453505 15.4479685 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 267.2453505 15.4479685
Starting process 679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059164 MB
Starting process 683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059172 MB
Starting process 684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059172 MB
Starting process 685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 694 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-23T04:06:40.964965
Keeping 13 CCDs:
   c4d_170316_083715_ooi_z_ls9.fits.fz c4d_170316_083715_ooi_z_ls9-N5 z exptime 250.0 propid 2014B-0404 seeing 1.15 MJD 57828.356 object DECaLS_15321_z
   c4d_170722_030038_ooi_g_ls9.fits.fz c4d_170722_030038_ooi_g_ls9-N5 g exptime 139.0 propid 2014B-0404 seeing 1.34 MJD 57956.123 object DECaLS_15321_g
   c4d_170722_025752_ooi_r_ls9.fits.fz c4d_170722_025752_ooi_r_ls9-N5 r exptime 49.0 propid 2014B-0404 seeing 1.20 MJD 57956.122 object DECaLS_15321_r
   c4d_180514_080916_ooi_r_ls9.fits.fz c4d_180514_080916_ooi_r_ls9-N3 r exptime 175.0 propid 2014B-0404 seeing 1.48 MJD 58252.340 object DECaLS_47065_r
   c4d_180922_012034_ooi_z_ls9.fits.fz c4d_180922_012034_ooi_z_ls9-N4 z exptime 250.0 propid 2014B-0404 seeing 1.37 MJD 58383.056 object DECaLS_31193_z
   c4d_180809_022424_ooi_r_ls9.fits.fz c4d_180809_022424_ooi_r_ls9-N4 r exptime 42.0 propid 2014B-0404 seeing 1.12 MJD 58339.100 object DECaLS_31193_r
   c4d_170725_033652_ooi_g_ls9.fits.fz c4d_170725_033652_ooi_g_ls9-N4 g exptime 200.0 propid 2014B-0404 seeing 1.68 MJD 57959.148 object DECaLS_31193_g
   c4d_170720_034220_ooi_g_ls9.fits.fz c4d_170720_034220_ooi_g_ls9-N3 g exptime 200.0 propid 2014B-0404 seeing 1.36 MJD 57954.151 object DECaLS_47065_g
   c4d_160722_052716_ooi_z_ls9.fits.fz c4d_160722_052716_ooi_z_ls9-N3 z exptime 218.0 propid 2016A-0190 seeing 1.51 MJD 57591.224 object DECaLS_47065_z
   c4d_180514_100814_ooi_z_ls9.fits.fz c4d_180514_100814_ooi_z_ls9-N4 z exptime 250.0 propid 2014B-0404 seeing 1.72 MJD 58252.422 object DECaLS_31193_z
   c4d_180829_022541_ooi_z_ls9.fits.fz c4d_180829_022541_ooi_z_ls9-N5 z exptime 149.0 propid 2014B-0404 seeing 1.16 MJD 58359.101 object DECaLS_49332_z
   c4d_180811_024702_ooi_r_ls9.fits.fz c4d_180811_024702_ooi_r_ls9-N5 r exptime 40.0 propid 2014B-0404 seeing 0.89 MJD 58341.116 object DECaLS_49332_r
   c4d_180811_024811_ooi_g_ls9.fits.fz c4d_180811_024811_ooi_g_ls9-N5 g exptime 87.0 propid 2014B-0404 seeing 1.06 MJD 58341.117 object DECaLS_49332_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20180922T012034_oi[N4,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951dcf7-r-20170722T025610_oi[N5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c242-z-20160722T052248_oi[N3,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d93e-g-20170722T025726_oi[N5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955fb7b-r-20180514T080916_oi[N3,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170720T033807_oi[N3,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95328e1-g-20180811T024811_oi[N5,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f4f7-z-20170316T083217_oi[N5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f4c3-z-20180829T022541_oi[N5,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180514T100814_oi[N4,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T024702_oi[N5,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ff0f-g-20170725T033237_oi[N4,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530fec-r-20180809T022424_oi[N4,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 14.21 s, CPU: 0.72 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.18142 MB
Stage tims finished: 2020-07-23T04:06:55.171208
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20180922T012034_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951dcf7-r-20170722T025610_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c242-z-20160722T052248_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d93e-g-20170722T025726_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955fb7b-r-20180514T080916_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170720T033807_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950f4f7-z-20170316T083217_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f4c3-z-20180829T022541_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T024702_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ff0f-g-20170725T033237_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530fec-r-20180809T022424_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage tims : 8.624 s worker CPU, 159.295 s worker Wall, Wall: 14.208 s, Cores in use: 0.66, Total efficiency (on 16 cores): 4.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180514T100814_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Running stage refs at 2020-07-23T04:06:56.694332
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04511.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/reference-custom-267245p15447.fits
Stage refs : Wall: 13.24 s, CPU: 11.48 s, VmPeak: 1131 MB, VmSize: 1125 MB, VmRSS: 306 MB, VmData: 337 MB, maxrss: 0.312956 MB
Stage refs finished: 2020-07-23T04:07:09.930903
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95328e1-g-20180811T024811_oi[N5,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 13.238 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-23T04:07:09.959080
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outlier-mask-custom-267245p15447.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-pre-custom-267245p15447.jpg
Image c4d_170720_034220_ooi_g_ls9-N3 g : masking 477 positive outlier pixels and 0 negative outlier pixels
Image c4d_170725_033652_ooi_g_ls9-N4 g : masking 394 positive outlier pixels and 0 negative outlier pixels
Image c4d_180809_022424_ooi_r_ls9-N4 r : masking 270 positive outlier pixels and 0 negative outlier pixels
Image c4d_180811_024702_ooi_r_ls9-N5 r : masking 0 positive outlier pixels and 120 negative outlier pixels
Image c4d_170316_083715_ooi_z_ls9-N5 z : masking 279 positive outlier pixels and 0 negative outlier pixels
Image c4d_180922_012034_ooi_z_ls9-N4 z : masking 502 positive outlier pixels and 0 negative outlier pixels
Image c4d_180514_100814_ooi_z_ls9-N4 z : masking 2281 positive outlier pixels and 0 negative outlier pixels
Image c4d_160722_052716_ooi_z_ls9-N3 z : masking 123 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outlier-mask-custom-267245p15447.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-post-custom-267245p15447.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-masked-pos-custom-267245p15447.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/outliers-masked-neg-custom-267245p15447.jpg
Stage outliers : Wall: 0.72 s, CPU: 0.54 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 320 MB, VmData: 350 MB, maxrss: 0.327968 MB
Stage outliers finished: 2020-07-23T04:07:10.679945
Resources for stage outliers : 0.881 s worker CPU, 0.970 s worker Wall, Wall: 0.723 s, Cores in use: 1.96, Total efficiency (on 16 cores): 12.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-23T04:07:10.710610
Stage halos : Wall: 0.41 s, CPU: 0.27 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 321 MB, VmData: 350 MB, maxrss: 0.328376 MB
Stage halos finished: 2020-07-23T04:07:11.116806
Resources for stage halos : 0.658 s worker CPU, 1.357 s worker Wall, Wall: 0.408 s, Cores in use: 2.29, Total efficiency (on 16 cores): 14.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-23T04:07:11.150493
PSF sigmas in coadd pixels: ['2.18', '2.73', '2.21', '1.72']
Using average PSF sigma 2.2087067895980743
Gaussian PSF norm 0.1277194388600634 vs pixelized 0.106777005
average tim pixel scale / coadd scale: 1.0011270316806444
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.94', '2.40', '1.82', '1.44']
Using average PSF sigma 1.8989885591381406
Gaussian PSF norm 0.14855002175574317 vs pixelized 0.12066298
average tim pixel scale / coadd scale: 1.0011657969830627
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.86', '2.23', '2.45', '2.79', '1.88']
Using average PSF sigma 2.242533337809661
Gaussian PSF norm 0.1257929088578934 vs pixelized 0.10791088
average tim pixel scale / coadd scale: 1.0013098109563285
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.17 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 322 MB, VmData: 350 MB, maxrss: 0.329864 MB
Stage fit_on_coadds finished: 2020-07-23T04:07:11.337496
Resources for stage fit_on_coadds : 0.197 s worker CPU, 0.197 s worker Wall, Wall: 0.189 s, Cores in use: 1.97, Total efficiency (on 16 cores): 12.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-23T04:07:11.349982
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 77 potential peaks
Of 77 potential peaks: 30 in veto map, 13 cut by saddle test, 0 cut by aper test, 34 kept
SED z : 34 new peaks
Found 79 potential peaks
Of 79 potential peaks: 63 in veto map, 12 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 59 potential peaks
Of 59 potential peaks: 49 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 66 potential peaks
Of 66 potential peaks: 56 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 74 potential peaks
Of 74 potential peaks: 61 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 43 new sources
Median coadd sky for g : 5.5510398e-05
Median coadd sky for r : 0.00020171945
Median coadd sky for z : 0.0008758451
Stage srcs : Wall: 0.85 s, CPU: 0.81 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 323 MB, VmData: 350 MB, maxrss: 0.330376 MB
Stage srcs finished: 2020-07-23T04:07:12.195734
Resources for stage srcs : 0.073 s worker CPU, 0.073 s worker Wall, Wall: 0.847 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-23T04:07:13.485469
Blob 1 of 4, id: 0, sources: 53, size: 233x233, npix 42893, brick X: 0,233, Y: 0,233, one pixel: 53 0
Blob 2 of 4, id: 3, sources: 2, size: 26x51, npix 820, brick X: 207,233, Y: 156,207, one pixel: 222 156
Blob 3 of 4, id: 2, sources: 1, size: 22x31, npix 481, brick X: 0,22, Y: 124,155, one pixel: 4 124
Blob 4 of 4, id: 1, sources: 2, size: 28x36, npix 480, brick X: 204,232, Y: 0,36, one pixel: 212 0
Blob 3 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092868 MB
Blob 4 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143492 MB
Blob 2 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 936 MB, VmSize: 720 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143264 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.24178, 15.46057), pm (-4.8, 0.2), parallax 0.527 with NanoMaggies: g=16.1, r=15.6, z=15.5
Reset brightness to NanoMaggies: g=16.1, r=15.6, z=15.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.73279, ee1=0.260468, ee2=0.138742
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.24970, 15.43714), pm (-3.9, -5.3), parallax 0.342 with NanoMaggies: g=18.1, r=17.6, z=17.4
Reset brightness to NanoMaggies: g=18.1, r=17.6, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.24450, 15.45662), pm (-0.2, -2.1), parallax -0.035 with NanoMaggies: g=20.3, r=19.4, z=19.2
Reset brightness to NanoMaggies: g=19.3, r=18.6, z=18.3
Measuring 27 iterative sources
Blob 1 finished, total: Wall: 55.94 s, CPU: 55.94 s, VmPeak: 938 MB, VmSize: 724 MB, VmRSS: 154 MB, VmData: 186 MB, maxrss: 0.173688 MB
Old catalog: 66
New catalog: 81
T_dup:
tabledata object with 1 rows and 62 columns:
   a_g_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise_sig (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_n_good_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_n_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_params_solved (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   astrometric_sigma5d_max (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_weight_al (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ba (<class 'numpy.ndarray'>) shape (1,) dtype float32
   dec (<class 'numpy.ndarray'>) shape (1,) dtype float64
   dec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_g (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_r (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_z (<class 'numpy.ndarray'>) shape (1,) dtype float32
   donotfit (<class 'numpy.ndarray'>) shape (1,) dtype bool
   duplicated_source (<class 'numpy.ndarray'>) shape (1,) dtype bool
   e_bp_min_rp_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   freezeparams (<class 'numpy.ndarray'>) shape (1,) dtype bool
   hmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ibx (<class 'numpy.ndarray'>) shape (1,) dtype int32
   iby (<class 'numpy.ndarray'>) shape (1,) dtype int32
   in_bounds (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isbright (<class 'numpy.ndarray'>) shape (1,) dtype bool
   iscluster (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgaia (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgalaxy (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   islargegalaxy (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ismedium (<class 'numpy.ndarray'>) shape (1,) dtype bool
   istycho (<class 'numpy.ndarray'>) shape (1,) dtype bool
   jmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   keep_radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   kmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mask_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pa (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_bp_rp_excess_factor (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_rp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_variable_flag (<class 'numpy.ndarray'>) shape (1,) dtype bool
   pmdec (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmdec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pointsource (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ra (<class 'numpy.ndarray'>) shape (1,) dtype float64
   ra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius_pix (<class 'numpy.ndarray'>) shape (1,) dtype int64
   ref_cat (<class 'numpy.ndarray'>) shape (1,) dtype <U2
   ref_epoch (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ref_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   source_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   zguess (<class 'numpy.ndarray'>) shape (1,) dtype float32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/blobs-custom-267245p15447.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/metrics/cus/all-models-custom-267245p15447.fits
Stage fitblobs : Wall: 56.51 s, CPU: 0.50 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 324 MB, VmData: 351 MB, maxrss: 0.332276 MB
Stage fitblobs finished: 2020-07-23T04:08:09.990739
Resources for stage fitblobs : 57.898 s worker CPU, 57.932 s worker Wall, Wall: 56.508 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-23T04:08:10.008013
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-resid.jpg
Stage coadds : Wall: 2.38 s, CPU: 0.50 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 325 MB, VmData: 351 MB, maxrss: 0.33278 MB
Stage coadds finished: 2020-07-23T04:08:12.392954
Resources for stage coadds : 10.169 s worker CPU, 10.898 s worker Wall, Wall: 2.386 s, Cores in use: 4.47, Total efficiency (on 16 cores): 27.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-23T04:08:12.409984
Cut to 1 unWISE tiles
Reading WISE tile 2676p151 band 1
Reading WISE tile 2676p151 band 3
Reading WISE tile 2676p151 band 2
Reading WISE tile 2676p151 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.19 s, CPU: 0.50 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 147 MB, VmData: 189 MB, maxrss: 0.188008 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.39 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 162 MB, VmData: 197 MB, maxrss: 0.225048 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.25 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 143 MB, VmData: 187 MB, maxrss: 0.203908 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2676p151/unwise-2676p151-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.25 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 143 MB, VmData: 187 MB, maxrss: 0.203756 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/tmp-legacysurvey-custom-267245p15447-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.95 s, CPU: 0.87 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 325 MB, VmData: 351 MB, maxrss: 0.333292 MB
Stage wise_forced finished: 2020-07-23T04:08:15.356937
Resources for stage wise_forced : 4.528 s worker CPU, 5.725 s worker Wall, Wall: 2.949 s, Cores in use: 1.83, Total efficiency (on 16 cores): 11.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-23T04:08:15.386391
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/coadd/cus/custom-267245p15447/legacysurvey-custom-267245p15447-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/tractor-i/cus/tractor-custom-267245p15447.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/tractor/cus/tractor-custom-267245p15447.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/tractor/cus/brick-custom-267245p15447.sha256sum
Stage writecat : Wall: 2.06 s, CPU: 0.77 s, VmPeak: 1267 MB, VmSize: 1139 MB, VmRSS: 327 MB, VmData: 351 MB, maxrss: 0.466168 MB
Stage writecat finished: 2020-07-23T04:08:17.443150
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.058 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC165744/PGC165744-largegalaxy-writecat.p
All done: 83.031 s worker CPU, 236.450 s worker Wall, Wall: 96.572 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.5 %
Finished galaxy PGC165744 in 1.638 minutes.