Started working on galaxy PGC991670 at Wed Aug  5 20:06:17 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 46.307637 -9.3891194 --width 257 --height 257 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:06:18.094629
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '46.307637', '-9.3891194', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 46.307637 -9.3891194 --width 257 --height 257 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 46.307637 -9.3891194
Starting process 39283 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 39284 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 39285 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 39286 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 39287 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 39288 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 39289 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 39290 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39291 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39292 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39295 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 39297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 39298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:06:18.834380
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 28 CCDs:
  c4d_160102_025735_ooi_r_ls9-N2 r expnum 507752 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57389.122 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20160101/c4d_160102_025735_ooi_r_ls9.fits.fz
  c4d_160102_030129_ooi_g_ls9-N2 g expnum 507754 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57389.124 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20160101/c4d_160102_030129_ooi_g_ls9.fits.fz
  c4d_151219_023744_ooi_z_ls9-N2 z expnum 503522 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57375.108 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20151218/c4d_151219_023744_ooi_z_ls9.fits.fz
  c4d_180905_074023_ooi_z_ls9-N5 z expnum 769210 exptime 100.0 propid 2014B-0404 seeing 1.46 MJD 58366.320 object DECaLS_56411_z 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_074023_ooi_z_ls9.fits.fz
  c4d_180907_095531_ooi_z_ls9-N23 z expnum 770216 exptime 80.0 propid 2014B-0404 seeing 0.98 MJD 58368.414 object DECaLS_49415_z 
    decam/CP/V4.8.2a/CP20180906/c4d_180907_095531_ooi_z_ls9.fits.fz
  c4d_180908_082122_ooi_g_ls9-N23 g expnum 770776 exptime 56.0 propid 2014B-0404 seeing 0.91 MJD 58369.348 object DECaLS_49415_g 
    decam/CP/V4.8.2a/CP20180907/c4d_180908_082122_ooi_g_ls9.fits.fz
  c4d_180908_082014_ooi_r_ls9-N23 r expnum 770775 exptime 40.0 propid 2014B-0404 seeing 1.04 MJD 58369.347 object DECaLS_49415_r 
    decam/CP/V4.8.2a/CP20180907/c4d_180908_082014_ooi_r_ls9.fits.fz
  c4d_140904_090415_ooi_r_ls9-S2 r expnum 355438 exptime 90.0 propid 2012B-0001 seeing 1.61 MJD 56904.376 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090415_ooi_r_ls9.fits.fz
  c4d_140904_090216_ooi_g_ls9-S2 g expnum 355437 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 56904.375 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090216_ooi_g_ls9.fits.fz
  c4d_171111_063752_ooi_z_ls9-S2 z expnum 695083 exptime 80.0 propid 2014B-0404 seeing 1.07 MJD 58068.276 object DECaLS_24378_z 
    decam/CP/V4.8.2a/CP20171110/c4d_171111_063752_ooi_z_ls9.fits.fz
  c4d_180809_095010_ooi_r_ls9-S2 r expnum 763421 exptime 60.0 propid 2014B-0404 seeing 1.19 MJD 58339.410 object DECaLS_24378_r 
    decam/CP/V4.8.2a/CP20180808/c4d_180809_095010_ooi_r_ls9.fits.fz
  c4d_171025_065320_ooi_g_ls9-S2 g expnum 690593 exptime 141.0 propid 2014B-0404 seeing 1.25 MJD 58051.287 object DECaLS_24378_g 
    decam/CP/V4.8.2a/CP20171024/c4d_171025_065320_ooi_g_ls9.fits.fz
  c4d_170907_083533_ooi_z_ls9-S27 z expnum 675254 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58003.358 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2a/CP20170906/c4d_170907_083533_ooi_z_ls9.fits.fz
  c4d_161231_021157_ooi_g_ls9-S27 g expnum 605591 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57753.090 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2/CP20161230/c4d_161231_021157_ooi_g_ls9.fits.fz
  c4d_181003_054148_ooi_g_ls9-S1 g expnum 780230 exptime 133.0 propid 2014B-0404 seeing 1.24 MJD 58394.237 object DECaLS_40250_g 
    decam/CP/V4.8.2a/CP20181002/c4d_181003_054148_ooi_g_ls9.fits.fz
  c4d_181005_044736_ooi_r_ls9-S1 r expnum 780694 exptime 51.0 propid 2014B-0404 seeing 1.14 MJD 58396.200 object DECaLS_40250_r 
    decam/CP/V4.8.2a/CP20181004/c4d_181005_044736_ooi_r_ls9.fits.fz
  c4d_181101_073806_ooi_z_ls9-S1 z expnum 789690 exptime 191.0 propid 2014B-0404 seeing 1.11 MJD 58423.318 object DECaLS_40250_z 
    decam/CP/V4.8.2a/CP20181031/c4d_181101_073806_ooi_z_ls9.fits.fz
  c4d_171129_041504_ooi_z_ls9-S28 z expnum 700999 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58086.177 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171128/c4d_171129_041504_ooi_z_ls9.fits.fz
  c4d_141212_051116_ooi_z_ls9-S3 z expnum 386750 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 57003.215 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20141211/c4d_141212_051116_ooi_z_ls9.fits.fz
  c4d_141014_084300_ooi_z_ls9-S3 z expnum 367656 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56944.362 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20141013/c4d_141014_084300_ooi_z_ls9.fits.fz
  c4d_140904_090415_ooi_r_ls9-S3 r expnum 355438 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 56904.376 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090415_ooi_r_ls9.fits.fz
  c4d_140904_090216_ooi_g_ls9-S3 g expnum 355437 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 56904.375 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090216_ooi_g_ls9.fits.fz
  c4d_161225_034541_ooi_r_ls9-S27 r expnum 604369 exptime 90.0 propid 2012B-0001 seeing 1.53 MJD 57747.155 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2/CP20161224/c4d_161225_034541_ooi_r_ls9.fits.fz
  c4d_171127_050717_ooi_z_ls9-S10 z expnum 700367 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 58084.213 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171126/c4d_171127_050717_ooi_z_ls9.fits.fz
  c4d_171029_074402_ooi_r_ls9-S10 r expnum 692101 exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 58055.322 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171028/c4d_171029_074402_ooi_r_ls9.fits.fz
  c4d_171029_074759_ooi_g_ls9-S10 g expnum 692103 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58055.325 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171028/c4d_171029_074759_ooi_g_ls9.fits.fz
  c4d_171223_040554_ooi_g_ls9-S28 g expnum 706498 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58110.171 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171222/c4d_171223_040554_ooi_g_ls9.fits.fz
  c4d_171223_040355_ooi_r_ls9-S28 r expnum 706497 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58110.169 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171222/c4d_171223_040355_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d459-r-20160102T025514_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T020940_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955400f-z-20151219T023524_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171025T065320_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T044736_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T074023_oi[N5,noinherit][2046,4094][real]: DECaLS_5
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953157b-r-20180809T095010_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9578659-g-20160102T025911_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d014-z-20180907T095531_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T082122_oi[N23,noinherit][2046,4094][real]: DECaLS_
Clipping 4 pixels with anomalously large oow values: max 0.0815314 vs median 0.0613403
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180908T082014_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T054148_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521fe5-z-20171111T063752_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d3ed-z-20170907T083533_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171129T041504_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fec9-z-20141014T084042_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95264c6-r-20171029T074402_oi[S10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523fc7-z-20171127T050717_oi[S10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507868-r-20161225T034322_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181101T073806_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20171223T040355_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171029T074759_oi[S10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955586b-z-20141212T050855_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20171223T040554_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 115.54 s, CPU: 1.87 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 193 MB, VmData: 225 MB, maxrss: 0.197156 MB
Stage tims finished: 2020-08-05T20:08:14.373990
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T082122_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180908T082014_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d3ed-z-20170907T083533_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171129T041504_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171025T065320_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955400f-z-20151219T023524_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523fc7-z-20171127T050717_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d014-z-20180907T095531_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507868-r-20161225T034322_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171029T074759_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T044736_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955586b-z-20141212T050855_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T054148_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953157b-r-20180809T095010_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20171223T040554_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 14.622 s worker CPU, 1021.565 s worker Wall, Wall: 115.541 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T020940_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fec9-z-20141014T084042_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9578659-g-20160102T025911_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95264c6-r-20171029T074402_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T074023_oi[N5,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521fe5-z-20171111T063752_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20171223T040355_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d459-r-20160102T025514_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181101T073806_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Running stage refs at 2020-08-05T20:08:14.428940
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07120.fits
Matched 8 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/reference-custom-046307m09389.fits
Stage refs : Wall: 4.50 s, CPU: 1.81 s, VmPeak: 1047 MB, VmSize: 1027 MB, VmRSS: 205 MB, VmData: 237 MB, maxrss: 0.210208 MB
Stage refs finished: 2020-08-05T20:08:18.932172
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.505 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:08:19.424158
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outlier-mask-custom-046307m09389.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-pre-custom-046307m09389.jpg
Image c4d_171029_074402_ooi_r_ls9-S10 r : masking 330 positive outlier pixels and 0 negative outlier pixels
Image c4d_141014_084300_ooi_z_ls9-S3 z : masking 79 positive outlier pixels and 0 negative outlier pixels
Image c4d_170907_083533_ooi_z_ls9-S27 z : masking 186 positive outlier pixels and 0 negative outlier pixels
Image c4d_171129_041504_ooi_z_ls9-S28 z : masking 514 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outlier-mask-custom-046307m09389.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-post-custom-046307m09389.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-masked-pos-custom-046307m09389.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-masked-neg-custom-046307m09389.jpg
Stage outliers : Wall: 3.52 s, CPU: 3.11 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 232 MB, VmData: 260 MB, maxrss: 0.237304 MB
Stage outliers finished: 2020-08-05T20:08:22.947033
Resources for stage outliers : 1.723 s worker CPU, 1.723 s worker Wall, Wall: 3.524 s, Cores in use: 1.37, Total efficiency (on 16 cores): 8.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:08:23.524978
Stage halos : Wall: 2.39 s, CPU: 1.88 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.237968 MB
Stage halos finished: 2020-08-05T20:08:25.912741
Resources for stage halos : 0.647 s worker CPU, 3.964 s worker Wall, Wall: 2.389 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:08:25.965837
PSF sigmas in coadd pixels: ['2.21', '1.48', '2.11', '2.03', '1.75', '2.01', '2.04', '1.69', '1.62']
Using average PSF sigma 1.883160673183079
Gaussian PSF norm 0.14979857841713393 vs pixelized 0.13042028
average tim pixel scale / coadd scale: 1.001092565302801
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.97', '1.68', '2.61', '1.94', '1.86', '2.63', '2.48', '1.57', '1.64']
Using average PSF sigma 2.042633882628414
Gaussian PSF norm 0.13810345269064328 vs pixelized 0.12671606
average tim pixel scale / coadd scale: 1.0011247350329546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.37', '1.60', '1.74', '1.70', '1.81', '1.55', '1.42', '1.52', '2.21']
Using average PSF sigma 1.7825849691275706
Gaussian PSF norm 0.15825040413750402 vs pixelized 0.14459638
average tim pixel scale / coadd scale: 1.0010449972025026
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.23972 MB
Stage fit_on_coadds finished: 2020-08-05T20:08:26.304212
Resources for stage fit_on_coadds : 0.451 s worker CPU, 0.451 s worker Wall, Wall: 0.340 s, Cores in use: 2.33, Total efficiency (on 16 cores): 14.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:08:26.317718
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 30 potential peaks
Of 30 potential peaks: 0 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 34 potential peaks
Of 34 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 7 kept
SED r : 7 new peaks
Found 32 potential peaks
Of 32 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 42 potential peaks
Of 42 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 50 potential peaks
Of 50 potential peaks: 43 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 42 new sources
Median coadd sky for g : -1.8343977e-05
Median coadd sky for r : -3.0133488e-05
Median coadd sky for z : 5.766179e-05
Stage srcs : Wall: 0.79 s, CPU: 0.75 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.240124 MB
Stage srcs finished: 2020-08-05T20:08:27.103375
Resources for stage srcs : 0.070 s worker CPU, 0.070 s worker Wall, Wall: 0.787 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:08:27.116411
Blob 1 of 18, id: 7, sources: 8, size: 142x116, npix 8082, brick X: 64,206, Y: 77,193, one pixel: 117 77
Blob 2 of 18, id: 0, sources: 5, size: 66x68, npix 2912, brick X: 0,66, Y: 0,68, one pixel: 22 0
Blob 3 of 18, id: 1, sources: 6, size: 61x72, npix 2690, brick X: 66,127, Y: 0,72, one pixel: 74 0
Blob 4 of 18, id: 12, sources: 4, size: 64x44, npix 1639, brick X: 170,234, Y: 190,234, one pixel: 184 190
Blob 5 of 18, id: 5, sources: 2, size: 55x38, npix 1045, brick X: 202,257, Y: 64,102, one pixel: 227 64
Blob 6 of 18, id: 15, sources: 3, size: 39x39, npix 854, brick X: 42,81, Y: 215,254, one pixel: 57 215
Blob 7 of 18, id: 14, sources: 2, size: 34x31, npix 643, brick X: 11,45, Y: 195,226, one pixel: 21 195
Blob 8 of 18, id: 8, sources: 2, size: 33x32, npix 625, brick X: 224,257, Y: 104,136, one pixel: 235 104
Blob 9 of 18, id: 13, sources: 2, size: 30x31, npix 502, brick X: 72,102, Y: 192,223, one pixel: 89 192
Blob 10 of 18, id: 2, sources: 1, size: 25x26, npix 401, brick X: 128,153, Y: 8,34, one pixel: 138 8
Blob 11 of 18, id: 3, sources: 1, size: 25x24, npix 366, brick X: 147,172, Y: 20,44, one pixel: 158 20
Blob 12 of 18, id: 17, sources: 1, size: 24x25, npix 340, brick X: 16,40, Y: 232,257, one pixel: 27 232
Blob 13 of 18, id: 9, sources: 1, size: 21x24, npix 311, brick X: 21,42, Y: 126,150, one pixel: 31 126
Blob 14 of 18, id: 6, sources: 1, size: 20x20, npix 229, brick X: 50,70, Y: 74,94, one pixel: 59 74
Blob 15 of 18, id: 10, sources: 1, size: 19x20, npix 227, brick X: 73,92, Y: 161,181, one pixel: 81 161
Blob 16 of 18, id: 11, sources: 1, size: 20x19, npix 227, brick X: 91,111, Y: 174,193, one pixel: 99 174
Blob 17 of 18, id: 16, sources: 1, size: 20x20, npix 220, brick X: 153,173, Y: 222,242, one pixel: 162 222
Blob 16 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 979 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151232 MB
Blob 18 of 18, id: 4, sources: 1, size: 20x20, npix 210, brick X: 135,155, Y: 59,79, one pixel: 144 59
Blob 15 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 975 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1501 MB
Blob 14 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 974 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155284 MB
Blob 17 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 979 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151232 MB
Blob 18 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 975 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1501 MB
Blob 12 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 969 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.156044 MB
Blob 10 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 978 MB, VmSize: 738 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.154032 MB
Blob 11 finished, total: Wall: 0.89 s, CPU: 0.88 s, VmPeak: 973 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155456 MB
Blob 6 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 970 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.150012 MB
Blob 9 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 980 MB, VmSize: 738 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.15412 MB
Blob 7 finished, total: Wall: 1.33 s, CPU: 1.33 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149928 MB
Measuring 2 iterative sources
Blob 13 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150268 MB
Blob 8 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.150012 MB
Blob 5 finished, total: Wall: 2.35 s, CPU: 2.35 s, VmPeak: 974 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155728 MB
Measuring 3 iterative sources
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 3.75 s, CPU: 3.75 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150672 MB
Measuring 3 iterative sources
Blob 3 finished, total: Wall: 5.37 s, CPU: 5.37 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.1514 MB
Blob 2 finished, total: Wall: 5.40 s, CPU: 5.39 s, VmPeak: 973 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 180 MB, maxrss: 0.150212 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.51389, ee1=-0.800862, ee2=-0.352398
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 12.15 s, CPU: 12.14 s, VmPeak: 974 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152176 MB
Old catalog: 45
New catalog: 54
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/blobs-custom-046307m09389.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/all-models-custom-046307m09389.fits
Stage fitblobs : Wall: 12.58 s, CPU: 0.44 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240288 MB
Stage fitblobs finished: 2020-08-05T20:08:39.701172
Resources for stage fitblobs : 40.946 s worker CPU, 41.086 s worker Wall, Wall: 12.586 s, Cores in use: 3.29, Total efficiency (on 16 cores): 20.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:08:39.720709
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-resid.jpg
Stage coadds : Wall: 2.30 s, CPU: 1.31 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240804 MB
Stage coadds finished: 2020-08-05T20:08:42.018929
Resources for stage coadds : 8.140 s worker CPU, 10.553 s worker Wall, Wall: 2.299 s, Cores in use: 4.11, Total efficiency (on 16 cores): 25.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T20:08:42.036678
Cut to 1 unWISE tiles
Reading WISE tile 0459m091 band 1
Reading WISE tile 0459m091 band 2
Reading WISE tile 0459m091 band 3
Reading WISE tile 0459m091 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 974 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.197564 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 978 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.211948 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 974 MB, VmSize: 809 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213492 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 974 MB, VmSize: 810 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.214152 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.73 s, CPU: 0.93 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.241508 MB
Stage wise_forced finished: 2020-08-05T20:08:44.763637
Resources for stage wise_forced : 3.149 s worker CPU, 5.416 s worker Wall, Wall: 2.728 s, Cores in use: 1.49, Total efficiency (on 16 cores): 9.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:08:44.777348
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/tractor-i/cus/tractor-custom-046307m09389.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/tractor/cus/tractor-custom-046307m09389.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/tractor/cus/brick-custom-046307m09389.sha256sum
Stage writecat : Wall: 1.11 s, CPU: 0.69 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 238 MB, VmData: 261 MB, maxrss: 0.374512 MB
Stage writecat finished: 2020-08-05T20:08:45.890521
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.115 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-writecat.p
All done: 69.752 s worker CPU, 1084.832 s worker Wall, Wall: 147.086 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.5 %
Finished galaxy PGC991670 in 2.484 minutes.
Started working on galaxy PGC991670 at Wed Aug  5 20:49:35 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 46.307637 -9.3891194 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:49:36.944580
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '46.307637', '-9.3891194', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 46.307637 -9.3891194 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 46.307637 -9.3891194
Starting process 47814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05922 MB
Starting process 47816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05922 MB
Starting process 47818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 47820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 47822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05952 MB
Starting process 47824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB
Starting process 47825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB
Starting process 47827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 47829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 47831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 47833 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 47848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 47850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 47851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 47852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 47853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 47855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 47856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 47859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 47860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 47861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 47862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 47863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 47864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 47865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 47866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:49:37.454878
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 28 CCDs:
  c4d_160102_025735_ooi_r_ls9-N2 r expnum 507752 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57389.122 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20160101/c4d_160102_025735_ooi_r_ls9.fits.fz
  c4d_160102_030129_ooi_g_ls9-N2 g expnum 507754 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57389.124 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20160101/c4d_160102_030129_ooi_g_ls9.fits.fz
  c4d_151219_023744_ooi_z_ls9-N2 z expnum 503522 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57375.108 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20151218/c4d_151219_023744_ooi_z_ls9.fits.fz
  c4d_180905_074023_ooi_z_ls9-N5 z expnum 769210 exptime 100.0 propid 2014B-0404 seeing 1.46 MJD 58366.320 object DECaLS_56411_z 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_074023_ooi_z_ls9.fits.fz
  c4d_180907_095531_ooi_z_ls9-N23 z expnum 770216 exptime 80.0 propid 2014B-0404 seeing 0.98 MJD 58368.414 object DECaLS_49415_z 
    decam/CP/V4.8.2a/CP20180906/c4d_180907_095531_ooi_z_ls9.fits.fz
  c4d_180908_082122_ooi_g_ls9-N23 g expnum 770776 exptime 56.0 propid 2014B-0404 seeing 0.91 MJD 58369.348 object DECaLS_49415_g 
    decam/CP/V4.8.2a/CP20180907/c4d_180908_082122_ooi_g_ls9.fits.fz
  c4d_180908_082014_ooi_r_ls9-N23 r expnum 770775 exptime 40.0 propid 2014B-0404 seeing 1.04 MJD 58369.347 object DECaLS_49415_r 
    decam/CP/V4.8.2a/CP20180907/c4d_180908_082014_ooi_r_ls9.fits.fz
  c4d_140904_090415_ooi_r_ls9-S2 r expnum 355438 exptime 90.0 propid 2012B-0001 seeing 1.61 MJD 56904.376 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090415_ooi_r_ls9.fits.fz
  c4d_140904_090216_ooi_g_ls9-S2 g expnum 355437 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 56904.375 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090216_ooi_g_ls9.fits.fz
  c4d_171111_063752_ooi_z_ls9-S2 z expnum 695083 exptime 80.0 propid 2014B-0404 seeing 1.07 MJD 58068.276 object DECaLS_24378_z 
    decam/CP/V4.8.2a/CP20171110/c4d_171111_063752_ooi_z_ls9.fits.fz
  c4d_180809_095010_ooi_r_ls9-S2 r expnum 763421 exptime 60.0 propid 2014B-0404 seeing 1.19 MJD 58339.410 object DECaLS_24378_r 
    decam/CP/V4.8.2a/CP20180808/c4d_180809_095010_ooi_r_ls9.fits.fz
  c4d_171025_065320_ooi_g_ls9-S2 g expnum 690593 exptime 141.0 propid 2014B-0404 seeing 1.25 MJD 58051.287 object DECaLS_24378_g 
    decam/CP/V4.8.2a/CP20171024/c4d_171025_065320_ooi_g_ls9.fits.fz
  c4d_170907_083533_ooi_z_ls9-S27 z expnum 675254 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58003.358 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2a/CP20170906/c4d_170907_083533_ooi_z_ls9.fits.fz
  c4d_161231_021157_ooi_g_ls9-S27 g expnum 605591 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57753.090 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2/CP20161230/c4d_161231_021157_ooi_g_ls9.fits.fz
  c4d_181003_054148_ooi_g_ls9-S1 g expnum 780230 exptime 133.0 propid 2014B-0404 seeing 1.24 MJD 58394.237 object DECaLS_40250_g 
    decam/CP/V4.8.2a/CP20181002/c4d_181003_054148_ooi_g_ls9.fits.fz
  c4d_181005_044736_ooi_r_ls9-S1 r expnum 780694 exptime 51.0 propid 2014B-0404 seeing 1.14 MJD 58396.200 object DECaLS_40250_r 
    decam/CP/V4.8.2a/CP20181004/c4d_181005_044736_ooi_r_ls9.fits.fz
  c4d_181101_073806_ooi_z_ls9-S1 z expnum 789690 exptime 191.0 propid 2014B-0404 seeing 1.11 MJD 58423.318 object DECaLS_40250_z 
    decam/CP/V4.8.2a/CP20181031/c4d_181101_073806_ooi_z_ls9.fits.fz
  c4d_171129_041504_ooi_z_ls9-S28 z expnum 700999 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58086.177 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171128/c4d_171129_041504_ooi_z_ls9.fits.fz
  c4d_141212_051116_ooi_z_ls9-S3 z expnum 386750 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 57003.215 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20141211/c4d_141212_051116_ooi_z_ls9.fits.fz
  c4d_141014_084300_ooi_z_ls9-S3 z expnum 367656 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56944.362 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20141013/c4d_141014_084300_ooi_z_ls9.fits.fz
  c4d_140904_090415_ooi_r_ls9-S3 r expnum 355438 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 56904.376 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090415_ooi_r_ls9.fits.fz
  c4d_140904_090216_ooi_g_ls9-S3 g expnum 355437 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 56904.375 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090216_ooi_g_ls9.fits.fz
  c4d_161225_034541_ooi_r_ls9-S27 r expnum 604369 exptime 90.0 propid 2012B-0001 seeing 1.53 MJD 57747.155 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2/CP20161224/c4d_161225_034541_ooi_r_ls9.fits.fz
  c4d_171127_050717_ooi_z_ls9-S10 z expnum 700367 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 58084.213 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171126/c4d_171127_050717_ooi_z_ls9.fits.fz
  c4d_171029_074402_ooi_r_ls9-S10 r expnum 692101 exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 58055.322 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171028/c4d_171029_074402_ooi_r_ls9.fits.fz
  c4d_171029_074759_ooi_g_ls9-S10 g expnum 692103 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58055.325 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171028/c4d_171029_074759_ooi_g_ls9.fits.fz
  c4d_171223_040554_ooi_g_ls9-S28 g expnum 706498 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58110.171 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171222/c4d_171223_040554_ooi_g_ls9.fits.fz
  c4d_171223_040355_ooi_r_ls9-S28 r expnum 706497 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58110.169 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171222/c4d_171223_040355_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95264c6-r-20171029T074402_oi[S10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171129T041504_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20171223T040355_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T074023_oi[N5,noinherit][2046,4094][real]: DECaLS_5
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d459-r-20160102T025514_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953157b-r-20180809T095010_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T020940_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507868-r-20161225T034322_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521fe5-z-20171111T063752_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523fc7-z-20171127T050717_oi[S10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171025T065320_oi[S2,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d014-z-20180907T095531_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181101T073806_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955400f-z-20151219T023524_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fec9-z-20141014T084042_oi[S3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T044736_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T082122_oi[N23,noinherit][2046,4094][real]: DECaLS_
Clipping 4 pixels with anomalously large oow values: max 0.0815314 vs median 0.0613403
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180908T082014_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d3ed-z-20170907T083533_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T054148_oi[S1,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9578659-g-20160102T025911_oi[N2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20171223T040554_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171029T074759_oi[S10,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955586b-z-20141212T050855_oi[S3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 84.40 s, CPU: 1.03 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 193 MB, VmData: 225 MB, maxrss: 0.197392 MB
Stage tims finished: 2020-08-05T20:51:01.858466
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953157b-r-20180809T095010_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20171223T040355_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521fe5-z-20171111T063752_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d014-z-20180907T095531_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180908T082014_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523fc7-z-20171127T050717_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T082122_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507868-r-20161225T034322_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fec9-z-20141014T084042_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T020940_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d459-r-20160102T025514_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9578659-g-20160102T025911_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T044736_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955586b-z-20141212T050855_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171029T074759_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T054148_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20171223T040554_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 19.515 s worker CPU, 1234.789 s worker Wall, Wall: 84.406 s, Cores in use: 0.24, Total efficiency (on 32 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171129T041504_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955400f-z-20151219T023524_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d3ed-z-20170907T083533_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95264c6-r-20171029T074402_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:51:02.175156
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07120.fits
Matched 8 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/reference-custom-046307m09389.fits
Stage refs : Wall: 7.33 s, CPU: 2.00 s, VmPeak: 1047 MB, VmSize: 1027 MB, VmRSS: 205 MB, VmData: 237 MB, maxrss: 0.210216 MB
Stage refs finished: 2020-08-05T20:51:09.505765
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171025T065320_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181101T073806_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 7.333 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-refs.p
Running stage outliers
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T074023_oi[N5,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage outliers at 2020-08-05T20:51:10.029730
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outlier-mask-custom-046307m09389.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-pre-custom-046307m09389.jpg
Image c4d_171029_074402_ooi_r_ls9-S10 r : masking 330 positive outlier pixels and 0 negative outlier pixels
Image c4d_141014_084300_ooi_z_ls9-S3 z : masking 79 positive outlier pixels and 0 negative outlier pixels
Image c4d_170907_083533_ooi_z_ls9-S27 z : masking 186 positive outlier pixels and 0 negative outlier pixels
Image c4d_171129_041504_ooi_z_ls9-S28 z : masking 514 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outlier-mask-custom-046307m09389.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-post-custom-046307m09389.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-masked-pos-custom-046307m09389.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/outliers-masked-neg-custom-046307m09389.jpg
Stage outliers : Wall: 1.82 s, CPU: 1.57 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 232 MB, VmData: 260 MB, maxrss: 0.237144 MB
Stage outliers finished: 2020-08-05T20:51:11.845972
Resources for stage outliers : 1.696 s worker CPU, 1.895 s worker Wall, Wall: 1.818 s, Cores in use: 1.80, Total efficiency (on 32 cores): 5.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:51:12.265370
Stage halos : Wall: 2.46 s, CPU: 1.01 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 232 MB, VmData: 260 MB, maxrss: 0.237632 MB
Stage halos finished: 2020-08-05T20:51:14.728774
Resources for stage halos : 0.702 s worker CPU, 6.026 s worker Wall, Wall: 2.466 s, Cores in use: 0.70, Total efficiency (on 32 cores): 2.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:51:14.886443
PSF sigmas in coadd pixels: ['2.21', '1.48', '2.11', '2.03', '1.75', '2.01', '2.04', '1.69', '1.62']
Using average PSF sigma 1.883160673183079
Gaussian PSF norm 0.14979857841713393 vs pixelized 0.13042028
average tim pixel scale / coadd scale: 1.001092565302801
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.97', '1.68', '2.61', '1.94', '1.86', '2.63', '2.48', '1.57', '1.64']
Using average PSF sigma 2.042633882628414
Gaussian PSF norm 0.13810345269064328 vs pixelized 0.12671606
average tim pixel scale / coadd scale: 1.0011247350329546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.37', '1.60', '1.74', '1.70', '1.81', '1.55', '1.42', '1.52', '2.21']
Using average PSF sigma 1.7825849691275706
Gaussian PSF norm 0.15825040413750402 vs pixelized 0.14459637
average tim pixel scale / coadd scale: 1.0010449972025026
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.40 s, CPU: 0.34 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 234 MB, VmData: 261 MB, maxrss: 0.23978 MB
Stage fit_on_coadds finished: 2020-08-05T20:51:15.289061
Resources for stage fit_on_coadds : 0.372 s worker CPU, 0.372 s worker Wall, Wall: 0.405 s, Cores in use: 1.76, Total efficiency (on 32 cores): 5.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:51:15.319386
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 30 potential peaks
Of 30 potential peaks: 0 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 34 potential peaks
Of 34 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 7 kept
SED r : 7 new peaks
Found 32 potential peaks
Of 32 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 42 potential peaks
Of 42 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 50 potential peaks
Of 50 potential peaks: 43 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 42 new sources
Median coadd sky for g : -1.8343966e-05
Median coadd sky for r : -3.0133488e-05
Median coadd sky for z : 5.766173e-05
Stage srcs : Wall: 2.26 s, CPU: 2.20 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240184 MB
Stage srcs finished: 2020-08-05T20:51:17.579048
Resources for stage srcs : 0.069 s worker CPU, 0.070 s worker Wall, Wall: 2.262 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:51:17.600306
Blob 1 of 18, id: 7, sources: 8, size: 142x116, npix 8082, brick X: 64,206, Y: 77,193, one pixel: 117 77
Blob 2 of 18, id: 0, sources: 5, size: 66x68, npix 2912, brick X: 0,66, Y: 0,68, one pixel: 22 0
Blob 3 of 18, id: 1, sources: 6, size: 61x72, npix 2690, brick X: 66,127, Y: 0,72, one pixel: 74 0
Blob 4 of 18, id: 12, sources: 4, size: 64x44, npix 1639, brick X: 170,234, Y: 190,234, one pixel: 184 190
Blob 5 of 18, id: 5, sources: 2, size: 55x38, npix 1045, brick X: 202,257, Y: 64,102, one pixel: 227 64
Blob 6 of 18, id: 15, sources: 3, size: 39x39, npix 854, brick X: 42,81, Y: 215,254, one pixel: 57 215
Blob 7 of 18, id: 14, sources: 2, size: 34x31, npix 643, brick X: 11,45, Y: 195,226, one pixel: 21 195
Blob 8 of 18, id: 8, sources: 2, size: 33x32, npix 625, brick X: 224,257, Y: 104,136, one pixel: 235 104
Blob 9 of 18, id: 13, sources: 2, size: 30x31, npix 502, brick X: 72,102, Y: 192,223, one pixel: 89 192
Blob 10 of 18, id: 2, sources: 1, size: 25x26, npix 401, brick X: 128,153, Y: 8,34, one pixel: 138 8
Blob 11 of 18, id: 3, sources: 1, size: 25x24, npix 366, brick X: 147,172, Y: 20,44, one pixel: 158 20
Blob 12 of 18, id: 17, sources: 1, size: 24x25, npix 340, brick X: 16,40, Y: 232,257, one pixel: 27 232
Blob 13 of 18, id: 9, sources: 1, size: 21x24, npix 311, brick X: 21,42, Y: 126,150, one pixel: 31 126
Blob 14 of 18, id: 6, sources: 1, size: 20x20, npix 229, brick X: 50,70, Y: 74,94, one pixel: 59 74
Blob 15 of 18, id: 10, sources: 1, size: 19x20, npix 227, brick X: 73,92, Y: 161,181, one pixel: 81 161
Blob 16 of 18, id: 11, sources: 1, size: 20x19, npix 227, brick X: 91,111, Y: 174,193, one pixel: 99 174
Blob 17 of 18, id: 16, sources: 1, size: 20x20, npix 220, brick X: 153,173, Y: 222,242, one pixel: 162 222
Blob 18 of 18, id: 4, sources: 1, size: 20x20, npix 210, brick X: 135,155, Y: 59,79, one pixel: 144 59
Blob 17 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149392 MB
Blob 16 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.1498 MB
Blob 18 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149296 MB
Blob 15 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149468 MB
Blob 14 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149864 MB
Blob 10 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149468 MB
Blob 12 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 961 MB, VmSize: 737 MB, VmRSS: 151 MB, VmData: 186 MB, maxrss: 0.15482 MB
Blob 11 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149696 MB
Blob 9 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 936 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151336 MB
Blob 6 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 935 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150728 MB
Measuring 2 iterative sources
Blob 13 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150296 MB
Blob 7 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14964 MB
Blob 8 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 935 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151232 MB
Blob 5 finished, total: Wall: 2.08 s, CPU: 2.08 s, VmPeak: 936 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150996 MB
Measuring 3 iterative sources
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 3.64 s, CPU: 3.64 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150292 MB
Measuring 3 iterative sources
Blob 3 finished, total: Wall: 4.92 s, CPU: 4.92 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151252 MB
Blob 2 finished, total: Wall: 5.05 s, CPU: 5.05 s, VmPeak: 944 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150396 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.51389, ee1=-0.800862, ee2=-0.352397
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 11.25 s, CPU: 11.23 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.152324 MB
Old catalog: 45
New catalog: 54
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/blobs-custom-046307m09389.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/metrics/cus/all-models-custom-046307m09389.fits
Stage fitblobs : Wall: 12.07 s, CPU: 0.76 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240348 MB
Stage fitblobs finished: 2020-08-05T20:51:29.667643
Resources for stage fitblobs : 36.177 s worker CPU, 36.275 s worker Wall, Wall: 12.070 s, Cores in use: 3.06, Total efficiency (on 32 cores): 9.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:51:29.706718
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-resid.jpg
Stage coadds : Wall: 3.32 s, CPU: 0.75 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 235 MB, VmData: 261 MB, maxrss: 0.240864 MB
Stage coadds finished: 2020-08-05T20:51:33.023360
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 31.200 s worker CPU, 48.669 s worker Wall, Wall: 3.319 s, Cores in use: 9.63, Total efficiency (on 32 cores): 30.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T20:51:33.038319
Cut to 1 unWISE tiles
Reading WISE tile 0459m091 band 1
Reading WISE tile 0459m091 band 2
Reading WISE tile 0459m091 band 3
Reading WISE tile 0459m091 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 959 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.196188 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 801 MB, VmSize: 801 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.2052 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 951 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207164 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207168 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.04 s, CPU: 0.69 s, VmPeak: 1047 MB, VmSize: 1037 MB, VmRSS: 236 MB, VmData: 261 MB, maxrss: 0.241568 MB
Stage wise_forced finished: 2020-08-05T20:51:36.075013
Resources for stage wise_forced : 3.088 s worker CPU, 6.064 s worker Wall, Wall: 3.039 s, Cores in use: 1.24, Total efficiency (on 32 cores): 3.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:51:36.090272
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/tractor-i/cus/tractor-custom-046307m09389.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/tractor/cus/tractor-custom-046307m09389.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/tractor/cus/brick-custom-046307m09389.sha256sum
Stage writecat : Wall: 2.62 s, CPU: 0.93 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 238 MB, VmData: 261 MB, maxrss: 0.374636 MB
Stage writecat finished: 2020-08-05T20:51:38.707131
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.619 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/046/PGC991670/PGC991670-largegalaxy-writecat.p
All done: 92.826 s worker CPU, 1334.167 s worker Wall, Wall: 121.275 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 %
Finished galaxy PGC991670 in 2.064 minutes.
Started working on galaxy PGC991670 at Mon Aug 10 08:53:24 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 46.30748444435096 -9.389524879398994 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:53:25.098750
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '46.30748444435096', '-9.389524879398994', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 46.30748444435096 -9.389524879398994 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 46.30748444435096 -9.389524879398994
Starting process 16392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 16393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 16394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 16395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 16396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB
Starting process 16397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 16399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 16398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:53:25.547803
Keeping 28 CCDs:
  c4d_160102_025735_ooi_r_ls9-N2 r expnum 507752 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57389.122 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20160101/c4d_160102_025735_ooi_r_ls9.fits.fz
  c4d_160102_030129_ooi_g_ls9-N2 g expnum 507754 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57389.124 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20160101/c4d_160102_030129_ooi_g_ls9.fits.fz
  c4d_151219_023744_ooi_z_ls9-N2 z expnum 503522 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57375.108 object DES survey hex 468-95 tiling 5 
    decam/CP/V4.8.2a/CP20151218/c4d_151219_023744_ooi_z_ls9.fits.fz
  c4d_180905_074023_ooi_z_ls9-N5 z expnum 769210 exptime 100.0 propid 2014B-0404 seeing 1.46 MJD 58366.320 object DECaLS_56411_z 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_074023_ooi_z_ls9.fits.fz
  c4d_180907_095531_ooi_z_ls9-N23 z expnum 770216 exptime 80.0 propid 2014B-0404 seeing 0.98 MJD 58368.414 object DECaLS_49415_z 
    decam/CP/V4.8.2a/CP20180906/c4d_180907_095531_ooi_z_ls9.fits.fz
  c4d_180908_082122_ooi_g_ls9-N23 g expnum 770776 exptime 56.0 propid 2014B-0404 seeing 0.91 MJD 58369.348 object DECaLS_49415_g 
    decam/CP/V4.8.2a/CP20180907/c4d_180908_082122_ooi_g_ls9.fits.fz
  c4d_180908_082014_ooi_r_ls9-N23 r expnum 770775 exptime 40.0 propid 2014B-0404 seeing 1.04 MJD 58369.347 object DECaLS_49415_r 
    decam/CP/V4.8.2a/CP20180907/c4d_180908_082014_ooi_r_ls9.fits.fz
  c4d_140904_090415_ooi_r_ls9-S2 r expnum 355438 exptime 90.0 propid 2012B-0001 seeing 1.61 MJD 56904.376 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090415_ooi_r_ls9.fits.fz
  c4d_140904_090216_ooi_g_ls9-S2 g expnum 355437 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 56904.375 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090216_ooi_g_ls9.fits.fz
  c4d_171111_063752_ooi_z_ls9-S2 z expnum 695083 exptime 80.0 propid 2014B-0404 seeing 1.07 MJD 58068.276 object DECaLS_24378_z 
    decam/CP/V4.8.2a/CP20171110/c4d_171111_063752_ooi_z_ls9.fits.fz
  c4d_180809_095010_ooi_r_ls9-S2 r expnum 763421 exptime 60.0 propid 2014B-0404 seeing 1.19 MJD 58339.410 object DECaLS_24378_r 
    decam/CP/V4.8.2a/CP20180808/c4d_180809_095010_ooi_r_ls9.fits.fz
  c4d_171025_065320_ooi_g_ls9-S2 g expnum 690593 exptime 141.0 propid 2014B-0404 seeing 1.25 MJD 58051.287 object DECaLS_24378_g 
    decam/CP/V4.8.2a/CP20171024/c4d_171025_065320_ooi_g_ls9.fits.fz
  c4d_170907_083533_ooi_z_ls9-S27 z expnum 675254 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58003.358 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2a/CP20170906/c4d_170907_083533_ooi_z_ls9.fits.fz
  c4d_161231_021157_ooi_g_ls9-S27 g expnum 605591 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57753.090 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2/CP20161230/c4d_161231_021157_ooi_g_ls9.fits.fz
  c4d_181003_054148_ooi_g_ls9-S1 g expnum 780230 exptime 133.0 propid 2014B-0404 seeing 1.24 MJD 58394.237 object DECaLS_40250_g 
    decam/CP/V4.8.2a/CP20181002/c4d_181003_054148_ooi_g_ls9.fits.fz
  c4d_181005_044736_ooi_r_ls9-S1 r expnum 780694 exptime 51.0 propid 2014B-0404 seeing 1.14 MJD 58396.200 object DECaLS_40250_r 
    decam/CP/V4.8.2a/CP20181004/c4d_181005_044736_ooi_r_ls9.fits.fz
  c4d_181101_073806_ooi_z_ls9-S1 z expnum 789690 exptime 191.0 propid 2014B-0404 seeing 1.11 MJD 58423.318 object DECaLS_40250_z 
    decam/CP/V4.8.2a/CP20181031/c4d_181101_073806_ooi_z_ls9.fits.fz
  c4d_171129_041504_ooi_z_ls9-S28 z expnum 700999 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58086.177 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171128/c4d_171129_041504_ooi_z_ls9.fits.fz
  c4d_141212_051116_ooi_z_ls9-S3 z expnum 386750 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 57003.215 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20141211/c4d_141212_051116_ooi_z_ls9.fits.fz
  c4d_141014_084300_ooi_z_ls9-S3 z expnum 367656 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56944.362 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20141013/c4d_141014_084300_ooi_z_ls9.fits.fz
  c4d_140904_090415_ooi_r_ls9-S3 r expnum 355438 exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 56904.376 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090415_ooi_r_ls9.fits.fz
  c4d_140904_090216_ooi_g_ls9-S3 g expnum 355437 exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 56904.375 object DES survey hex 468-95 tiling 1 
    decam/CP/V4.8.2a/CP20140903/c4d_140904_090216_ooi_g_ls9.fits.fz
  c4d_161225_034541_ooi_r_ls9-S27 r expnum 604369 exptime 90.0 propid 2012B-0001 seeing 1.53 MJD 57747.155 object DES survey hex 452-105 tiling 7 
    decam/CP/V4.8.2/CP20161224/c4d_161225_034541_ooi_r_ls9.fits.fz
  c4d_171127_050717_ooi_z_ls9-S10 z expnum 700367 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 58084.213 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171126/c4d_171127_050717_ooi_z_ls9.fits.fz
  c4d_171029_074402_ooi_r_ls9-S10 r expnum 692101 exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 58055.322 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171028/c4d_171029_074402_ooi_r_ls9.fits.fz
  c4d_171029_074759_ooi_g_ls9-S10 g expnum 692103 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58055.325 object DES survey hex 468-95 tiling 8 
    decam/CP/V4.8.2a/CP20171028/c4d_171029_074759_ooi_g_ls9.fits.fz
  c4d_171223_040554_ooi_g_ls9-S28 g expnum 706498 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58110.171 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171222/c4d_171223_040554_ooi_g_ls9.fits.fz
  c4d_171223_040355_ooi_r_ls9-S28 r expnum 706497 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58110.169 object DES survey hex 452-105 tiling 9 
    decam/CP/V4.8.2a/CP20171222/c4d_171223_040355_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T074023_oi[N5,noinherit][2046,4094][real]: DECaLS_5
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955400f-z-20151219T023524_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9578659-g-20160102T025911_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T082122_oi[N23,noinherit][2046,4094][real]: DECaLS_
Clipping 4 pixels with anomalously large oow values: max 0.0815314 vs median 0.0613403
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d459-r-20160102T025514_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180908T082014_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d014-z-20180907T095531_oi[N23,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521fe5-z-20171111T063752_oi[S2,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171025T065320_oi[S2,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953157b-r-20180809T095010_oi[S2,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d3ed-z-20170907T083533_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T020940_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T054148_oi[S1,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T044736_oi[S1,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171129T041504_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fec9-z-20141014T084042_oi[S3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181101T073806_oi[S1,noinherit][2046,4094][real]: DECaLS_4
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507868-r-20161225T034322_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523fc7-z-20171127T050717_oi[S10,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95264c6-r-20171029T074402_oi[S10,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20171223T040355_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955586b-z-20141212T050855_oi[S3,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20171223T040554_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171029T074759_oi[S10,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 189.31 s, CPU: 1.00 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.195276 MB
Stage tims finished: 2020-08-10T08:56:34.856690
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535f76-g-20180908T082122_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171025T065320_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171129T041504_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523fc7-z-20171127T050717_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d459-r-20160102T025514_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d3ed-z-20170907T083533_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95264c6-r-20171029T074402_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d014-z-20180907T095531_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181005T044736_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507868-r-20161225T034322_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20171223T040355_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140904T090156_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T054148_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T074023_oi[N5,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953157b-r-20180809T095010_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955586b-z-20141212T050855_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9578659-g-20160102T025911_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521fe5-z-20171111T063752_oi[S2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fec9-z-20141014T084042_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171029T074759_oi[S10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95355ca-r-20180908T082014_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T020940_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20171223T040554_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955400f-z-20151219T023524_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b912-g-20140904T085958_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532159-z-20181101T073806_oi[S1,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Resources for stage tims : 10.136 s worker CPU, 1013.841 s worker Wall, Wall: 189.310 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T08:56:34.906619
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07120.fits
Matched 8 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/reference-custom-046307m09389.fits
Stage refs : Wall: 11.44 s, CPU: 1.62 s, VmPeak: 1040 MB, VmSize: 1020 MB, VmRSS: 204 MB, VmData: 236 MB, maxrss: 0.208728 MB
Stage refs finished: 2020-08-10T08:56:46.347755
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.442 s, Cores in use: 0.14, Total efficiency (on 8 cores): 1.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:56:46.403392
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/outlier-mask-custom-046307m09389.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/outliers-pre-custom-046307m09389.jpg
Image c4d_181003_054148_ooi_g_ls9-S1 g : masking 0 positive outlier pixels and 191 negative outlier pixels
Image c4d_171029_074402_ooi_r_ls9-S10 r : masking 265 positive outlier pixels and 0 negative outlier pixels
Image c4d_171111_063752_ooi_z_ls9-S2 z : masking 0 positive outlier pixels and 105 negative outlier pixels
Image c4d_171129_041504_ooi_z_ls9-S28 z : masking 504 positive outlier pixels and 0 negative outlier pixels
Image c4d_141014_084300_ooi_z_ls9-S3 z : masking 92 positive outlier pixels and 0 negative outlier pixels
Image c4d_170907_083533_ooi_z_ls9-S27 z : masking 161 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/outlier-mask-custom-046307m09389.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/outliers-post-custom-046307m09389.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/outliers-masked-pos-custom-046307m09389.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/outliers-masked-neg-custom-046307m09389.jpg
Stage outliers : Wall: 1.36 s, CPU: 1.15 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.230088 MB
Stage outliers finished: 2020-08-10T08:56:47.763501
Resources for stage outliers : 2.009 s worker CPU, 2.014 s worker Wall, Wall: 1.361 s, Cores in use: 2.32, Total efficiency (on 8 cores): 29.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:56:47.813248
Stage halos : Wall: 4.03 s, CPU: 0.37 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 225 MB, VmData: 255 MB, maxrss: 0.23056 MB
Stage halos finished: 2020-08-10T08:56:51.841505
Resources for stage halos : 0.607 s worker CPU, 7.331 s worker Wall, Wall: 4.030 s, Cores in use: 0.24, Total efficiency (on 8 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:56:52.310130
PSF sigmas in coadd pixels: ['2.21', '1.48', '2.11', '2.03', '1.75', '2.01', '2.04', '1.69', '1.62']
Using average PSF sigma 1.883160673183079
Gaussian PSF norm 0.14979857841713393 vs pixelized 0.13042392
average tim pixel scale / coadd scale: 1.001092565302801
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.97', '1.68', '2.61', '1.94', '1.86', '2.63', '2.48', '1.57', '1.64']
Using average PSF sigma 2.042633882628414
Gaussian PSF norm 0.13810345269064328 vs pixelized 0.12671818
average tim pixel scale / coadd scale: 1.0011247350329546
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.37', '1.60', '1.74', '1.70', '1.81', '1.55', '1.42', '1.52', '2.21']
Using average PSF sigma 1.7825849691275706
Gaussian PSF norm 0.15825040413750402 vs pixelized 0.1445992
average tim pixel scale / coadd scale: 1.0010449972025026
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.36 s, CPU: 0.36 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 229 MB, VmData: 258 MB, maxrss: 0.234872 MB
Stage fit_on_coadds finished: 2020-08-10T08:56:52.671069
Resources for stage fit_on_coadds : 0.402 s worker CPU, 0.402 s worker Wall, Wall: 0.362 s, Cores in use: 2.10, Total efficiency (on 8 cores): 26.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:56:52.682753
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 31 potential peaks
Of 31 potential peaks: 1 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 34 potential peaks
Of 34 potential peaks: 22 in veto map, 5 cut by saddle test, 0 cut by aper test, 7 kept
SED r : 7 new peaks
Found 35 potential peaks
Of 35 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 42 potential peaks
Of 42 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 49 potential peaks
Of 49 potential peaks: 42 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 40 new sources
Median coadd sky for g : -3.288155e-05
Median coadd sky for r : -1.9433812e-05
Median coadd sky for z : 0.000116459065
Stage srcs : Wall: 0.82 s, CPU: 0.76 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235496 MB
Stage srcs finished: 2020-08-10T08:56:53.501629
Resources for stage srcs : 0.096 s worker CPU, 0.096 s worker Wall, Wall: 0.820 s, Cores in use: 1.05, Total efficiency (on 8 cores): 13.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:56:53.517061
Blob 1 of 19, id: 8, sources: 7, size: 142x116, npix 8037, brick X: 62,204, Y: 83,199, one pixel: 115 83
Blob 2 of 19, id: 1, sources: 5, size: 64x68, npix 2847, brick X: 0,64, Y: 6,74, one pixel: 16 6
Blob 3 of 19, id: 0, sources: 5, size: 61x69, npix 2410, brick X: 64,125, Y: 0,69, one pixel: 78 0
Blob 4 of 19, id: 13, sources: 4, size: 64x44, npix 1627, brick X: 168,232, Y: 195,239, one pixel: 183 195
Blob 5 of 19, id: 6, sources: 2, size: 57x39, npix 1097, brick X: 200,257, Y: 69,108, one pixel: 225 69
Blob 6 of 19, id: 9, sources: 3, size: 35x39, npix 829, brick X: 222,257, Y: 110,149, one pixel: 232 110
Blob 7 of 19, id: 16, sources: 3, size: 39x37, npix 816, brick X: 40,79, Y: 220,257, one pixel: 56 220
Blob 8 of 19, id: 15, sources: 2, size: 34x31, npix 650, brick X: 9,43, Y: 200,231, one pixel: 20 200
Blob 9 of 19, id: 14, sources: 1, size: 30x32, npix 503, brick X: 70,100, Y: 197,229, one pixel: 88 197
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (46.29577, -9.39069), pm (10.0, -10.9), parallax 0.025 with NanoMaggies: g=(flux -1.33e+04), r=(flux -9.9e+04), z=(flux -9.16e+04)
Reset brightness to NanoMaggies: g=19, r=17.9, z=17.4
Measuring 2 iterative sources
Blob 7 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145212 MB
Blob 10 of 19, id: 2, sources: 1, size: 24x26, npix 400, brick X: 126,150, Y: 13,39, one pixel: 138 13
Blob 8 finished, total: Wall: 1.73 s, CPU: 1.58 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144888 MB
Blob 11 of 19, id: 3, sources: 1, size: 25x24, npix 375, brick X: 145,170, Y: 26,50, one pixel: 155 26
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144888 MB
Blob 12 of 19, id: 10, sources: 1, size: 21x24, npix 304, brick X: 19,40, Y: 132,156, one pixel: 29 132
Blob 9 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146884 MB
Blob 13 of 19, id: 18, sources: 1, size: 22x20, npix 299, brick X: 15,37, Y: 237,257, one pixel: 25 237
Blob 5 finished, total: Wall: 2.69 s, CPU: 2.69 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14866 MB
Blob 14 of 19, id: 4, sources: 1, size: 21x20, npix 249, brick X: 97,118, Y: 58,78, one pixel: 106 58
Blob 11 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144888 MB
Blob 15 of 19, id: 5, sources: 1, size: 19x20, npix 227, brick X: 133,152, Y: 64,84, one pixel: 142 64
Blob 13 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB
Blob 16 of 19, id: 7, sources: 1, size: 20x20, npix 219, brick X: 48,68, Y: 79,99, one pixel: 58 79
Blob 15 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB
Blob 17 of 19, id: 11, sources: 1, size: 19x20, npix 218, brick X: 71,90, Y: 166,186, one pixel: 80 166
Blob 14 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144888 MB
Blob 18 of 19, id: 12, sources: 1, size: 20x19, npix 218, brick X: 89,109, Y: 180,199, one pixel: 97 180
Blob 12 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146884 MB
Blob 19 of 19, id: 17, sources: 1, size: 20x19, npix 218, brick X: 151,171, Y: 228,247, one pixel: 159 228
Blob 17 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144888 MB
Blob 18 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146884 MB
Measuring 3 iterative sources
Blob 16 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB
Blob 19 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144888 MB
Blob 6 finished, total: Wall: 4.43 s, CPU: 4.33 s, VmPeak: 970 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14964 MB
Blob 4 finished, total: Wall: 4.80 s, CPU: 4.80 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.147996 MB
Measuring 3 iterative sources
Blob 3 finished, total: Wall: 6.13 s, CPU: 5.99 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147668 MB
Blob 2 finished, total: Wall: 7.34 s, CPU: 7.34 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14986 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.05692, ee1=-0.615824, ee2=-0.269532
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 9.20 s, CPU: 9.20 s, VmPeak: 967 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 180 MB, maxrss: 0.148384 MB
Old catalog: 43
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/blobs-custom-046307m09389.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/metrics/cus/all-models-custom-046307m09389.fits
Stage fitblobs : Wall: 9.62 s, CPU: 0.45 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.23566 MB
Stage fitblobs finished: 2020-08-10T08:57:03.136751
Resources for stage fitblobs : 44.634 s worker CPU, 45.130 s worker Wall, Wall: 9.621 s, Cores in use: 4.69, Total efficiency (on 8 cores): 58.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:57:03.149239
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-resid.jpg
Stage coadds : Wall: 1.38 s, CPU: 0.56 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.236176 MB
Stage coadds finished: 2020-08-10T08:57:04.526079
Resources for stage coadds : 4.387 s worker CPU, 4.888 s worker Wall, Wall: 1.378 s, Cores in use: 3.59, Total efficiency (on 8 cores): 44.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:57:04.544293
Cut to 1 unWISE tiles
Reading WISE tile 0459m091 band 1
Reading WISE tile 0459m091 band 2
Reading WISE tile 0459m091 band 3
Reading WISE tile 0459m091 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 969 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 179 MB, maxrss: 0.19528 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 971 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20854 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 971 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209424 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/045/0459m091/unwise-0459m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 970 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.2117 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/tmp-legacysurvey-custom-046307m09389-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.12 s, CPU: 0.66 s, VmPeak: 1040 MB, VmSize: 1030 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.23688 MB
Stage wise_forced finished: 2020-08-10T08:57:09.665182
Resources for stage wise_forced : 3.065 s worker CPU, 8.838 s worker Wall, Wall: 5.122 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:57:09.678947
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/coadd/cus/custom-046307m09389/legacysurvey-custom-046307m09389-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/tractor-i/cus/tractor-custom-046307m09389.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/tractor/cus/tractor-custom-046307m09389.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/tractor/cus/brick-custom-046307m09389.sha256sum
Stage writecat : Wall: 0.81 s, CPU: 0.65 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 233 MB, VmData: 258 MB, maxrss: 0.369752 MB
Stage writecat finished: 2020-08-10T08:57:10.490192
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.812 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/046/PGC991670/PGC991670-largegalaxy-writecat.p
All done: 65.337 s worker CPU, 1082.542 s worker Wall, Wall: 224.959 s, Cores in use: 0.33, Total efficiency (on 8 cores): 4.1 %
Finished galaxy PGC991670 in 3.778 minutes.