Started working on galaxy PGC1625813 at Thu Jun  4 04:04:48 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.9585415 20.3884722 --width 281 --height 281 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T04:04:49.377297
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '353.9585415', '20.3884722', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 353.9585415 20.3884722 --width 281 --height 281 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 353.9585415 20.3884722
Starting process 6429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 6430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 6431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 6432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 6433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057384 MB
Starting process 6434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057388 MB
Starting process 6435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 6436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T04:04:51.102417
Keeping 17 CCDs:
   c4d_180808_071921_ooi_r_ls9.fits.fz c4d_180808_071921_ooi_r_ls9-N29 r exptime 83.0 propid 2014B-0404 seeing 1.58 MJD 58338.305 object DECaLS_23614_r
   c4d_180811_071317_ooi_g_ls9.fits.fz c4d_180811_071317_ooi_g_ls9-N29 g exptime 88.0 propid 2014B-0404 seeing 1.16 MJD 58341.301 object DECaLS_23614_g
   c4d_171024_014030_ooi_z_ls9.fits.fz c4d_171024_014030_ooi_z_ls9-N29 z exptime 92.0 propid 2014B-0404 seeing 0.92 MJD 58050.070 object DECaLS_23614_z
   c4d_161115_013949_ooi_z_ls9.fits.fz c4d_161115_013949_ooi_z_ls9-S24 z exptime 250.0 propid 2014B-0404 seeing 0.91 MJD 57707.066 object DECaLS_23627_z
   c4d_170916_041453_ooi_r_ls9.fits.fz c4d_170916_041453_ooi_r_ls9-S24 r exptime 96.0 propid 2014B-0404 seeing 1.32 MJD 58012.177 object DECaLS_23627_r
   c4d_180903_050529_ooi_g_ls9.fits.fz c4d_180903_050529_ooi_g_ls9-S24 g exptime 156.0 propid 2014B-0404 seeing 1.60 MJD 58364.212 object DECaLS_23627_g
   c4d_171113_005418_ooi_g_ls9.fits.fz c4d_171113_005418_ooi_g_ls9-S24 g exptime 165.0 propid 2014B-0404 seeing 1.21 MJD 58070.038 object DECaLS_7755_g
   c4d_180902_051952_ooi_z_ls9.fits.fz c4d_180902_051952_ooi_z_ls9-S24 z exptime 80.0 propid 2014B-0404 seeing 1.10 MJD 58363.222 object DECaLS_7755_z
   c4d_170922_034517_ooi_r_ls9.fits.fz c4d_170922_034517_ooi_r_ls9-S24 r exptime 76.0 propid 2014B-0404 seeing 1.11 MJD 58018.156 object DECaLS_7755_r
   c4d_140811_061828_ooi_z_ls9.fits.fz c4d_140811_061828_ooi_z_ls9-S24 z exptime 137.0 propid 2014B-0404 seeing 1.44 MJD 56880.261 object DECaLS_7755_z
   c4d_180808_071921_ooi_r_ls9.fits.fz c4d_180808_071921_ooi_r_ls9-N25 r exptime 83.0 propid 2014B-0404 seeing 1.57 MJD 58338.305 object DECaLS_23614_r
   c4d_180918_024339_ooi_z_ls9.fits.fz c4d_180918_024339_ooi_z_ls9-S17 z exptime 100.0 propid 2014B-0404 seeing 1.21 MJD 58379.114 object DECaLS_39499_z
   c4d_181006_020031_ooi_r_ls9.fits.fz c4d_181006_020031_ooi_r_ls9-S17 r exptime 71.0 propid 2014B-0404 seeing 1.14 MJD 58397.084 object DECaLS_39499_r
   c4d_181006_015730_ooi_g_ls9.fits.fz c4d_181006_015730_ooi_g_ls9-S17 g exptime 153.0 propid 2014B-0404 seeing 1.34 MJD 58397.082 object DECaLS_39499_g
   c4d_180902_035857_ooi_g_ls9.fits.fz c4d_180902_035857_ooi_g_ls9-N26 g exptime 92.0 propid 2014B-0404 seeing 1.35 MJD 58363.166 object DECaLS_7742_g
   c4d_180908_043652_ooi_r_ls9.fits.fz c4d_180908_043652_ooi_r_ls9-N26 r exptime 40.0 propid 2014B-0404 seeing 0.95 MJD 58369.192 object DECaLS_7742_r
   c4d_180902_051803_ooi_z_ls9.fits.fz c4d_180902_051803_ooi_z_ls9-N26 z exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 58363.221 object DECaLS_7742_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T050529_oi[S24,noinherit][2046,4094][real]: DECaLS_2362
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T041453_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952733c-g-20171113T005418_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95328e1-g-20180811T071317_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95202c1-z-20171024T014030_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954355c-z-20161115T013449_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180902T051952_oi[S24,noinherit][2046,4094][real]: DECaLS_7755
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T034517_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a245-z-20140811T061520_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953704b-g-20181006T015730_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560feb-r-20180808T071921_oi[N25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180902T035857_oi[N26,noinherit][2046,4094][real]: DECaLS_7742
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953502f-r-20180908T043652_oi[N26,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536893-r-20181006T020031_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T024339_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180902T051803_oi[N26,noinherit][2046,4094][real]: DECaLS_7742
Stage tims : Wall: 59.12 s, CPU: 1.45 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 180 MB, VmData: 213 MB, maxrss: 0.451436 MB
Stage tims finished: 2020-06-04T04:05:50.223887
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T050529_oi[S24,noinherit][2046,4094][real]: DECaLS_2362 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a245-z-20140811T061520_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95202c1-z-20171024T014030_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953704b-g-20181006T015730_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T041453_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560feb-r-20180808T071921_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180902T051952_oi[S24,noinherit][2046,4094][real]: DECaLS_7755 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180902T035857_oi[N26,noinherit][2046,4094][real]: DECaLS_7742 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95328e1-g-20180811T071317_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536893-r-20181006T020031_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954355c-z-20161115T013449_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953502f-r-20180908T043652_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952733c-g-20171113T005418_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T024339_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524d58-r-20170922T034517_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180902T051803_oi[N26,noinherit][2046,4094][real]: DECaLS_7742 [astropy.io.fits.card]
Resources for stage tims : 7.126 s worker CPU, 306.757 s worker Wall, Wall: 59.123 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-04T04:05:50.256127
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04157.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04030.fits
Matched 22 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/reference-custom-353958p20388.fits
Stage refs : Wall: 2.62 s, CPU: 2.10 s, VmPeak: 1027 MB, VmSize: 1018 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.451436 MB
Stage refs finished: 2020-06-04T04:05:52.874433
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.619 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T04:05:52.876275
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/outlier-mask-custom-353958p20388.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/outliers-pre-custom-353958p20388.jpg
Image c4d_181006_015730_ooi_g_ls9-S17 g : masking 138 positive outlier pixels and 0 negative outlier pixels
Image c4d_180902_035857_ooi_g_ls9-N26 g : masking 97 positive outlier pixels and 0 negative outlier pixels
Image c4d_171113_005418_ooi_g_ls9-S24 g : masking 103 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_050529_ooi_g_ls9-S24 g : masking 848 positive outlier pixels and 420 negative outlier pixels
Image c4d_180808_071921_ooi_r_ls9-N25 r : masking 225 positive outlier pixels and 0 negative outlier pixels
Image c4d_170916_041453_ooi_r_ls9-S24 r : masking 123 positive outlier pixels and 121 negative outlier pixels
Image c4d_181006_020031_ooi_r_ls9-S17 r : masking 572 positive outlier pixels and 0 negative outlier pixels
Image c4d_170922_034517_ooi_r_ls9-S24 r : masking 94 positive outlier pixels and 0 negative outlier pixels
Image c4d_180908_043652_ooi_r_ls9-N26 r : masking 106 positive outlier pixels and 0 negative outlier pixels
Image c4d_140811_061828_ooi_z_ls9-S24 z : masking 534 positive outlier pixels and 0 negative outlier pixels
Image c4d_161115_013949_ooi_z_ls9-S24 z : masking 1852 positive outlier pixels and 177 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/outlier-mask-custom-353958p20388.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/outliers-post-custom-353958p20388.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/outliers-masked-pos-custom-353958p20388.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/outliers-masked-neg-custom-353958p20388.jpg
Stage outliers : Wall: 1.21 s, CPU: 0.95 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 221 MB, VmData: 251 MB, maxrss: 0.451436 MB
Stage outliers finished: 2020-06-04T04:05:54.088007
Resources for stage outliers : 1.466 s worker CPU, 1.468 s worker Wall, Wall: 1.213 s, Cores in use: 1.99, Total efficiency (on 8 cores): 24.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T04:05:54.090162
Stage halos : Wall: 1.08 s, CPU: 0.53 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 221 MB, VmData: 251 MB, maxrss: 0.451436 MB
Stage halos finished: 2020-06-04T04:05:55.169943
Resources for stage halos : 0.840 s worker CPU, 3.774 s worker Wall, Wall: 1.081 s, Cores in use: 1.27, Total efficiency (on 8 cores): 15.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T04:05:55.172213
PSF sigmas in coadd pixels: ['1.88', '2.60', '1.97', '2.17', '2.19']
Using average PSF sigma 2.1614832974697467
Gaussian PSF norm 0.13050981800511763 vs pixelized 0.10955039
average tim pixel scale / coadd scale: 1.001235929438631
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.15', '1.80', '2.55', '1.85', '1.55']
Using average PSF sigma 1.979922886008088
Gaussian PSF norm 0.14247766605831627 vs pixelized 0.11497633
average tim pixel scale / coadd scale: 1.0012513255871092
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.50', '1.48', '1.78', '2.34', '1.96', '1.83']
Using average PSF sigma 1.8156140347247787
Gaussian PSF norm 0.15537156376775846 vs pixelized 0.1292956
average tim pixel scale / coadd scale: 1.0011780939068473
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.23 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.451436 MB
Stage fit_on_coadds finished: 2020-06-04T04:05:55.422173
Resources for stage fit_on_coadds : 0.342 s worker CPU, 0.342 s worker Wall, Wall: 0.251 s, Cores in use: 2.29, Total efficiency (on 8 cores): 28.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T04:05:55.425545
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 62 potential peaks
Of 62 potential peaks: 39 in veto map, 5 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 53 potential peaks
Of 53 potential peaks: 43 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 55 potential peaks
Of 55 potential peaks: 41 in veto map, 10 cut by saddle test, 0 cut by aper test, 4 kept
SED g : 4 new peaks
Found 72 potential peaks
Of 72 potential peaks: 59 in veto map, 12 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 83 potential peaks
Of 83 potential peaks: 71 in veto map, 11 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 27 new sources
Median coadd sky for g : 7.8247605e-05
Median coadd sky for r : 9.130359e-05
Median coadd sky for z : 0.0006086242
Stage srcs : Wall: 1.24 s, CPU: 1.20 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.451436 MB
Stage srcs finished: 2020-06-04T04:05:56.668477
Resources for stage srcs : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 1.244 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/PGC1625813-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T04:05:56.681433
Blob 1 of 8, id: 2, sources: 19, size: 238x193, npix 26337, brick X: 11,249, Y: 17,210, one pixel: 158 17
Blob 2 of 8, id: 4, sources: 5, size: 128x80, npix 5998, brick X: 7,135, Y: 201,281, one pixel: 53 201
Blob 3 of 8, id: 0, sources: 3, size: 36x41, npix 869, brick X: 28,64, Y: 0,41, one pixel: 44 0
Blob 4 of 8, id: 7, sources: 1, size: 27x27, npix 491, brick X: 155,182, Y: 246,273, one pixel: 167 246
Blob 5 of 8, id: 5, sources: 1, size: 26x34, npix 489, brick X: 224,250, Y: 211,245, one pixel: 234 211
Blob 6 of 8, id: 1, sources: 1, size: 24x25, npix 396, brick X: 207,231, Y: 9,34, one pixel: 218 9
Blob 7 of 8, id: 6, sources: 1, size: 24x25, npix 355, brick X: 249,273, Y: 241,266, one pixel: 261 241
Blob 8 of 8, id: 3, sources: 1, size: 19x19, npix 208, brick X: 234,253, Y: 24,43, one pixel: 242 24
Blob 8 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14684 MB
Blob 6 finished, total: Wall: 0.44 s, CPU: 0.35 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146216 MB
Blob 7 finished, total: Wall: 0.72 s, CPU: 0.67 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146724 MB
Blob 5 finished, total: Wall: 0.77 s, CPU: 0.74 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146404 MB
Blob 4 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146884 MB
Blob 3 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145984 MB
Measuring 6 iterative sources
Blob 2 finished, total: Wall: 7.77 s, CPU: 7.77 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149404 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.78165, ee1=-0.891498, ee2=-0.352131
Measuring 15 iterative sources
Blob 1 finished, total: Wall: 24.12 s, CPU: 24.11 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 156 MB, VmData: 188 MB, maxrss: 0.160176 MB
Old catalog: 41
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/blobs-custom-353958p20388.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/metrics/cus/all-models-custom-353958p20388.fits
Stage fitblobs : Wall: 25.48 s, CPU: 1.35 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 225 MB, VmData: 252 MB, maxrss: 0.451436 MB
Stage fitblobs finished: 2020-06-04T04:06:22.162979
Resources for stage fitblobs : 36.084 s worker CPU, 36.324 s worker Wall, Wall: 25.483 s, Cores in use: 1.47, Total efficiency (on 8 cores): 18.4 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T04:06:22.165085
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/tmp-legacysurvey-custom-353958p20388-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/tmp-legacysurvey-custom-353958p20388-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/tmp-legacysurvey-custom-353958p20388-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/tmp-legacysurvey-custom-353958p20388-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-resid.jpg
Stage coadds : Wall: 2.72 s, CPU: 1.95 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 225 MB, VmData: 252 MB, maxrss: 0.451436 MB
Stage coadds finished: 2020-06-04T04:06:24.889337
Resources for stage coadds : 4.435 s worker CPU, 4.739 s worker Wall, Wall: 2.725 s, Cores in use: 2.34, Total efficiency (on 8 cores): 29.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T04:06:24.891027
Cut to 1 unWISE tiles
Reading WISE tile 3536p196 band 1
Reading WISE tile 3536p196 band 2
Reading WISE tile 3536p196 band 3
Reading WISE tile 3536p196 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 960 MB, VmSize: 805 MB, VmRSS: 160 MB, VmData: 184 MB, maxrss: 0.20518 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 954 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209252 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 958 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.206476 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/353/3536p196/unwise-3536p196-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210004 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/tmp-legacysurvey-custom-353958p20388-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/tmp-legacysurvey-custom-353958p20388-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 14.00 s, CPU: 12.20 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 226 MB, VmData: 252 MB, maxrss: 0.451436 MB
Stage wise_forced finished: 2020-06-04T04:06:38.895399
Resources for stage wise_forced : 3.352 s worker CPU, 5.449 s worker Wall, Wall: 14.006 s, Cores in use: 1.11, Total efficiency (on 8 cores): 13.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T04:06:38.897592
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/coadd/cus/custom-353958p20388/legacysurvey-custom-353958p20388-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/tractor-i/cus/tractor-custom-353958p20388.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/tractor/cus/tractor-custom-353958p20388.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/353/PGC1625813/tractor/cus/brick-custom-353958p20388.sha256sum
Stage writecat : Wall: 1.91 s, CPU: 1.62 s, VmPeak: 1160 MB, VmSize: 1032 MB, VmRSS: 228 MB, VmData: 252 MB, maxrss: 0.451436 MB
Stage writecat finished: 2020-06-04T04:06:40.806696
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.910 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.6 %
Stage writecat finished
All done: 53.779 s worker CPU, 358.988 s worker Wall, Wall: 109.710 s, Cores in use: 0.71, Total efficiency (on 8 cores): 8.8 %
Finished galaxy PGC1625813 in 1.885 minutes.