Started working on galaxy PGC1820852 at Thu Jun  4 13:38:12 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 116.571885 27.8949718 --width 439 --height 439 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T13:38:13.855310
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '116.571885', '27.8949718', '--width', '439', '--height', '439', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 116.571885 27.8949718 --width 439 --height 439 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 116.571885 27.8949718
Starting process 26598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 26599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 26600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 26601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 26602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 26604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 26605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 26603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T13:38:18.690908
Keeping 17 CCDs:
   c4d_181211_061835_ooi_g_ls9.fits.fz c4d_181211_061835_ooi_g_ls9-S20 g exptime 200.0 propid 2014B-0404 seeing 1.52 MJD 58463.263 object DECaLS_42498_g
   c4d_181213_063439_ooi_r_ls9.fits.fz c4d_181213_063439_ooi_r_ls9-S20 r exptime 48.0 propid 2014B-0404 seeing 1.22 MJD 58465.274 object DECaLS_42498_r
   c4d_160301_010648_ooi_r_ls9.fits.fz c4d_160301_010648_ooi_r_ls9-S21 r exptime 98.0 propid 2014B-0404 seeing 1.31 MJD 57448.045 object DECaLS_26626_r
   c4d_160301_010914_ooi_g_ls9.fits.fz c4d_160301_010914_ooi_g_ls9-S21 g exptime 118.0 propid 2014B-0404 seeing 1.55 MJD 57448.046 object DECaLS_26626_g
   c4d_171113_081651_ooi_z_ls9.fits.fz c4d_171113_081651_ooi_z_ls9-S21 z exptime 132.0 propid 2014B-0404 seeing 1.05 MJD 58070.345 object DECaLS_26626_z
   c4d_190303_010753_ooi_g_ls9.fits.fz c4d_190303_010753_ooi_g_ls9-S21 g exptime 119.0 propid 2014B-0404 seeing 1.15 MJD 58545.047 object DECaLS_26626_g
   c4d_181212_061424_ooi_r_ls9.fits.fz c4d_181212_061424_ooi_r_ls9-N19 r exptime 50.0 propid 2014B-0404 seeing 1.45 MJD 58464.260 object DECaLS_42477_r
   c4d_180318_001931_ooi_z_ls9.fits.fz c4d_180318_001931_ooi_z_ls9-N19 z exptime 168.0 propid 2014B-0404 seeing 1.19 MJD 58195.014 object DECaLS_42477_z
   c4d_181214_052800_ooi_g_ls9.fits.fz c4d_181214_052800_ooi_g_ls9-N19 g exptime 200.0 propid 2014B-0404 seeing 1.75 MJD 58466.228 object DECaLS_42477_g
   c4d_181210_063713_ooi_r_ls9.fits.fz c4d_181210_063713_ooi_r_ls9-S22 r exptime 117.0 propid 2014B-0404 seeing 1.31 MJD 58462.276 object DECaLS_10754_r
   c4d_181209_064956_ooi_g_ls9.fits.fz c4d_181209_064956_ooi_g_ls9-S22 g exptime 200.0 propid 2014B-0404 seeing 1.59 MJD 58461.285 object DECaLS_10754_g
   c4d_141228_052816_ooi_g_ls9.fits.fz c4d_141228_052816_ooi_g_ls9-S22 g exptime 83.0 propid 2014B-0404 seeing 1.63 MJD 57019.226 object DECaLS_10754_g
   c4d_141228_052259_ooi_r_ls9.fits.fz c4d_141228_052259_ooi_r_ls9-S22 r exptime 69.0 propid 2014B-0404 seeing 1.48 MJD 57019.223 object DECaLS_10754_r
   c4d_141230_052039_ooi_z_ls9.fits.fz c4d_141230_052039_ooi_z_ls9-S22 z exptime 120.0 propid 2014B-0404 seeing 1.00 MJD 57021.221 object DECaLS_10754_z
   c4d_161115_073401_ooi_z_ls9.fits.fz c4d_161115_073401_ooi_z_ls9-S25 z exptime 250.0 propid 2014B-0404 seeing 1.43 MJD 57707.312 object DECaLS_42498_z
   c4d_181213_063439_ooi_r_ls9.fits.fz c4d_181213_063439_ooi_r_ls9-S25 r exptime 48.0 propid 2014B-0404 seeing 1.24 MJD 58465.274 object DECaLS_42498_r
   c4d_181211_061835_ooi_g_ls9.fits.fz c4d_181211_061835_ooi_g_ls9-S25 g exptime 200.0 propid 2014B-0404 seeing 1.56 MJD 58463.263 object DECaLS_42498_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T061835_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171113T081651_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181213T063439_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9570b49-r-20160301T010419_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538cf2-r-20181212T061424_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d11b-g-20160301T010626_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180318T001931_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181214T052800_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9552e01-g-20141228T052605_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95391af-g-20181209T064956_oi[S22,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.008060751 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538963-r-20181210T063713_oi[S22,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.021450926 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95506eb-r-20141228T052101_oi[S22,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141230T051742_oi[S22,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.01890777 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181213T063439_oi[S25,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.010859007 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T061835_oi[S25,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.026022281 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95424b2-z-20161115T072900_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a046-g-20190303T010753_oi[S21,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 66.07 s, CPU: 4.34 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 195 MB, VmData: 229 MB, maxrss: 0.455276 MB
Stage tims finished: 2020-06-04T13:39:24.764470
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T061835_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538963-r-20181210T063713_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538cf2-r-20181212T061424_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95506eb-r-20141228T052101_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.026187573 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d11b-g-20160301T010626_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141230T051742_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171113T081651_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95391af-g-20181209T064956_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181213T063439_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953988f-g-20181214T052800_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539067-r-20181213T063439_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.005063298 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9570b49-r-20160301T010419_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9552e01-g-20141228T052605_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539519-g-20181211T061835_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a046-g-20190303T010753_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955e646-z-20180318T001931_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95424b2-z-20161115T072900_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.837 s worker CPU, 392.138 s worker Wall, Wall: 66.075 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-04T13:39:24.811506
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03305.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03178.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03177.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/reference-custom-116571p27894.fits
Stage refs : Wall: 8.36 s, CPU: 7.07 s, VmPeak: 1038 MB, VmSize: 1032 MB, VmRSS: 232 MB, VmData: 265 MB, maxrss: 0.455276 MB
Stage refs finished: 2020-06-04T13:39:33.167663
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.357 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.6 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T13:39:33.169621
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/outlier-mask-custom-116571p27894.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/outliers-pre-custom-116571p27894.jpg
Image c4d_181211_061835_ooi_g_ls9-S20 g : masking 6619 positive outlier pixels and 1292 negative outlier pixels
Image c4d_190303_010753_ooi_g_ls9-S21 g : masking 0 positive outlier pixels and 100809 negative outlier pixels
Image c4d_181211_061835_ooi_g_ls9-S25 g : masking 34575 positive outlier pixels and 0 negative outlier pixels
Image c4d_160301_010914_ooi_g_ls9-S21 g : masking 0 positive outlier pixels and 88885 negative outlier pixels
Image c4d_181214_052800_ooi_g_ls9-N19 g : masking 188325 positive outlier pixels and 0 negative outlier pixels
Image c4d_181209_064956_ooi_g_ls9-S22 g : masking 1160 positive outlier pixels and 106264 negative outlier pixels
Image c4d_141228_052816_ooi_g_ls9-S22 g : masking 152092 positive outlier pixels and 0 negative outlier pixels
Image c4d_160301_010648_ooi_r_ls9-S21 r : masking 7579 positive outlier pixels and 62782 negative outlier pixels
Image c4d_181213_063439_ooi_r_ls9-S25 r : masking 37475 positive outlier pixels and 6263 negative outlier pixels
Image c4d_181210_063713_ooi_r_ls9-S22 r : masking 878 positive outlier pixels and 87127 negative outlier pixels
Image c4d_181212_061424_ooi_r_ls9-N19 r : masking 175173 positive outlier pixels and 0 negative outlier pixels
Image c4d_141228_052259_ooi_r_ls9-S22 r : masking 72482 positive outlier pixels and 3287 negative outlier pixels
Image c4d_161115_073401_ooi_z_ls9-S25 z : masking 1662 positive outlier pixels and 5483 negative outlier pixels
Image c4d_180318_001931_ooi_z_ls9-N19 z : masking 31115 positive outlier pixels and 0 negative outlier pixels
Image c4d_171113_081651_ooi_z_ls9-S21 z : masking 238 positive outlier pixels and 25372 negative outlier pixels
Image c4d_141230_052039_ooi_z_ls9-S22 z : masking 77435 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/outlier-mask-custom-116571p27894.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/outliers-post-custom-116571p27894.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/outliers-masked-pos-custom-116571p27894.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/outliers-masked-neg-custom-116571p27894.jpg
Stage outliers : Wall: 9.86 s, CPU: 5.34 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 272 MB, VmData: 302 MB, maxrss: 0.455276 MB
Stage outliers finished: 2020-06-04T13:39:43.029813
Resources for stage outliers : 28.121 s worker CPU, 28.215 s worker Wall, Wall: 9.862 s, Cores in use: 3.39, Total efficiency (on 8 cores): 42.4 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T13:39:43.031959
Stage halos : Wall: 6.12 s, CPU: 2.60 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 272 MB, VmData: 302 MB, maxrss: 0.455276 MB
Stage halos finished: 2020-06-04T13:39:49.154311
Resources for stage halos : 1.123 s worker CPU, 13.948 s worker Wall, Wall: 6.124 s, Cores in use: 0.61, Total efficiency (on 8 cores): 7.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T13:39:49.156892
PSF sigmas in coadd pixels: ['2.47', '2.51', '1.88', '2.84', '2.58', '2.65', '2.54']
Using average PSF sigma 2.4950371692821487
Gaussian PSF norm 0.11306236045174435 vs pixelized 0.10094295
average tim pixel scale / coadd scale: 1.0013397463247984
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.14', '2.36', '2.13', '2.40', '2.01']
Using average PSF sigma 2.207399042646901
Gaussian PSF norm 0.12779510470187447 vs pixelized 0.10754334
average tim pixel scale / coadd scale: 1.001359038641463
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.71', '1.93', '1.62', '2.32']
Using average PSF sigma 1.8953315133202753
Gaussian PSF norm 0.14883664930980836 vs pixelized 0.1276105
average tim pixel scale / coadd scale: 1.0013045372755998
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 5.03 s, CPU: 0.51 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 274 MB, VmData: 302 MB, maxrss: 0.455276 MB
Stage fit_on_coadds finished: 2020-06-04T13:39:54.182196
Resources for stage fit_on_coadds : 24.080 s worker CPU, 24.282 s worker Wall, Wall: 5.027 s, Cores in use: 4.89, Total efficiency (on 8 cores): 61.2 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T13:39:54.185632
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 1065 potential peaks
Of 1065 potential peaks: 980 in veto map, 30 cut by saddle test, 0 cut by aper test, 55 kept
SED z : 55 new peaks
Found 205 potential peaks
Of 205 potential peaks: 174 in veto map, 22 cut by saddle test, 0 cut by aper test, 9 kept
SED r : 9 new peaks
Found 171 potential peaks
Of 171 potential peaks: 118 in veto map, 33 cut by saddle test, 0 cut by aper test, 20 kept
SED g : 20 new peaks
Found 509 potential peaks
Of 509 potential peaks: 453 in veto map, 47 cut by saddle test, 0 cut by aper test, 9 kept
SED Flat : 9 new peaks
Found 762 potential peaks
Of 762 potential peaks: 718 in veto map, 38 cut by saddle test, 0 cut by aper test, 6 kept
SED Red : 6 new peaks
Adding 99 new sources
Median coadd sky for g : -0.0032872977
Median coadd sky for r : -0.005649759
Median coadd sky for z : 0.0036549051
Stage srcs : Wall: 6.23 s, CPU: 5.63 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 274 MB, VmData: 302 MB, maxrss: 0.455276 MB
Stage srcs finished: 2020-06-04T13:40:00.418147
Resources for stage srcs : 1.077 s worker CPU, 1.077 s worker Wall, Wall: 6.234 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/PGC1820852-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T13:40:00.513522
Blob 1 of 2, id: 0, sources: 107, size: 439x439, npix 172007, brick X: 0,439, Y: 0,439, one pixel: 43 0
Blob 2 of 2, id: 1, sources: 1, size: 39x36, npix 928, brick X: 4,43, Y: 64,100, one pixel: 27 64
Blob 2 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14992 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.50269, ee1=0.148505, ee2=-0.0612481
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (116.58597, 27.91821), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16.6, r=16.1, z=15.9
Reset brightness to NanoMaggies: g=16.6, r=16.1, z=15.9
Blob 1 finished, total: Wall: 71.00 s, CPU: 71.00 s, VmPeak: 960 MB, VmSize: 778 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.238528 MB
Old catalog: 115
New catalog: 56
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/blobs-custom-116571p27894.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/metrics/cus/all-models-custom-116571p27894.fits
Stage fitblobs : Wall: 74.47 s, CPU: 3.40 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 281 MB, VmData: 308 MB, maxrss: 0.455276 MB
Stage fitblobs finished: 2020-06-04T13:41:14.983368
Resources for stage fitblobs : 71.725 s worker CPU, 71.740 s worker Wall, Wall: 74.472 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T13:41:14.986050
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/tmp-legacysurvey-custom-116571p27894-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/tmp-legacysurvey-custom-116571p27894-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/tmp-legacysurvey-custom-116571p27894-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/tmp-legacysurvey-custom-116571p27894-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-resid.jpg
Stage coadds : Wall: 6.67 s, CPU: 5.28 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 295 MB, VmData: 323 MB, maxrss: 0.455276 MB
Stage coadds finished: 2020-06-04T13:41:21.653225
Resources for stage coadds : 5.472 s worker CPU, 5.761 s worker Wall, Wall: 6.668 s, Cores in use: 1.61, Total efficiency (on 8 cores): 20.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T13:41:21.654957
Cut to 1 unWISE tiles
Reading WISE tile 1166p272 band 1
Reading WISE tile 1166p272 band 3
Reading WISE tile 1166p272 band 2
Reading WISE tile 1166p272 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.15 s, VmPeak: 960 MB, VmSize: 870 MB, VmRSS: 228 MB, VmData: 249 MB, maxrss: 0.238528 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 959 MB, VmSize: 788 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.20668 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 957 MB, VmSize: 791 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.203792 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/116/1166p272/unwise-1166p272-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 942 MB, VmSize: 797 MB, VmRSS: 153 MB, VmData: 176 MB, maxrss: 0.2159 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/tmp-legacysurvey-custom-116571p27894-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/tmp-legacysurvey-custom-116571p27894-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.73 s, CPU: 5.13 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 296 MB, VmData: 323 MB, maxrss: 0.455276 MB
Stage wise_forced finished: 2020-06-04T13:41:28.383236
Resources for stage wise_forced : 3.864 s worker CPU, 5.202 s worker Wall, Wall: 6.730 s, Cores in use: 1.34, Total efficiency (on 8 cores): 16.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T13:41:28.385223
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/coadd/cus/custom-116571p27894/legacysurvey-custom-116571p27894-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/tractor-i/cus/tractor-custom-116571p27894.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/tractor/cus/tractor-custom-116571p27894.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC1820852/tractor/cus/brick-custom-116571p27894.sha256sum
Stage writecat : Wall: 9.35 s, CPU: 4.81 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 298 MB, VmData: 323 MB, maxrss: 0.455276 MB
Stage writecat finished: 2020-06-04T13:41:37.739115
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.355 s, Cores in use: 0.51, Total efficiency (on 8 cores): 6.4 %
Stage writecat finished
All done: 142.301 s worker CPU, 542.365 s worker Wall, Wall: 199.056 s, Cores in use: 0.94, Total efficiency (on 8 cores): 11.7 %
Finished galaxy PGC1820852 in 3.514 minutes.