Started working on galaxy IC2014 at Thu Jun  4 03:07:30 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.8402735 -56.7462712 --width 435 --height 435 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T03:07:31.655423
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '58.8402735', '-56.7462712', '--width', '435', '--height', '435', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.8402735 -56.7462712 --width 435 --height 435 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 58.8402735 -56.7462712
Starting process 4966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 4968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 4970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 4973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 4975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 4977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 4979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 4981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T03:07:33.401515
Keeping 27 CCDs:
   c4d_131230_051148_ooi_r_ls9.fits.fz c4d_131230_051148_ooi_r_ls9-N25 r exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56656.215 object DES survey hex 606-552 tiling 3
   c4d_131214_041347_ooi_z_ls9.fits.fz c4d_131214_041347_ooi_z_ls9-N25 z exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 56640.175 object DES survey hex 606-552 tiling 3
   c4d_131109_080652_ooi_g_ls9.fits.fz c4d_131109_080652_ooi_g_ls9-N25 g exptime 90.0 propid 2012B-0001 seeing 1.81 MJD 56605.338 object DES survey hex 606-552 tiling 3
   c4d_131213_041339_ooi_z_ls9.fits.fz c4d_131213_041339_ooi_z_ls9-S19 z exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 56639.174 object DES survey hex 573-572 tiling 1
   c4d_140123_033448_ooi_r_ls9.fits.fz c4d_140123_033448_ooi_r_ls9-S19 r exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56680.148 object DES survey hex 573-572 tiling 1
   c4d_140123_032851_ooi_g_ls9.fits.fz c4d_140123_032851_ooi_g_ls9-S19 g exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 56680.143 object DES survey hex 573-572 tiling 1
   c4d_131213_035311_ooi_z_ls9.fits.fz c4d_131213_035311_ooi_z_ls9-N20 z exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56639.160 object DES survey hex 598-562 tiling 1
   c4d_131206_070655_ooi_r_ls9.fits.fz c4d_131206_070655_ooi_r_ls9-N20 r exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56632.295 object DES survey hex 598-562 tiling 1
   c4d_131206_070454_ooi_g_ls9.fits.fz c4d_131206_070454_ooi_g_ls9-N20 g exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56632.293 object DES survey hex 598-562 tiling 1
   c4d_180119_032745_ooi_r_v1.fits.fz c4d_180119_032745_ooi_r_v1-S4 r exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58137.144 object DES survey hex 573-572 tiling 9
   c4d_180105_043743_ooi_z_v1.fits.fz c4d_180105_043743_ooi_z_v1-S4 z exptime 90.0 propid 2012B-0001 seeing 0.84 MJD 58123.193 object DES survey hex 573-572 tiling 9
   c4d_180212_020806_ooi_g_v1.fits.fz c4d_180212_020806_ooi_g_v1-S4 g exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 58161.089 object DES survey hex 573-572 tiling 9
   c4d_160206_025047_ooi_r_ls9.fits.fz c4d_160206_025047_ooi_r_ls9-S7 r exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57424.117 object DES survey hex 573-572 tiling 5
   c4d_160206_025441_ooi_g_ls9.fits.fz c4d_160206_025441_ooi_g_ls9-S7 g exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57424.120 object DES survey hex 573-572 tiling 5
   c4d_131201_072121_ooi_g_ls9.fits.fz c4d_131201_072121_ooi_g_ls9-S11 g exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 56627.305 object DES survey hex 598-562 tiling 3
   c4d_131201_072327_ooi_r_ls9.fits.fz c4d_131201_072327_ooi_r_ls9-S11 r exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 56627.306 object DES survey hex 598-562 tiling 3
   c4d_131212_055558_ooi_z_ls9.fits.fz c4d_131212_055558_ooi_z_ls9-S11 z exptime 90.0 propid 2012B-0001 seeing 0.81 MJD 56638.246 object DES survey hex 598-562 tiling 3
   c4d_131109_075017_ooi_g_ls9.fits.fz c4d_131109_075017_ooi_g_ls9-S11 g exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56605.327 object DES survey hex 598-562 tiling 3
   c4d_171110_082330_ooi_z_v1.fits.fz c4d_171110_082330_ooi_z_v1-N16 z exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 58067.350 object DES survey hex 598-562 tiling 8
   c4d_180114_041119_ooi_g_v1.fits.fz c4d_180114_041119_ooi_g_v1-N16 g exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58132.175 object DES survey hex 598-562 tiling 8
   c4d_180114_040920_ooi_r_v1.fits.fz c4d_180114_040920_ooi_r_v1-N16 r exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58132.173 object DES survey hex 598-562 tiling 8
   c4d_161223_053348_ooi_g_ls9.fits.fz c4d_161223_053348_ooi_g_ls9-S4 g exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57745.230 object DES survey hex 573-572 tiling 7
   c4d_161223_053149_ooi_r_ls9.fits.fz c4d_161223_053149_ooi_r_ls9-S4 r exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57745.229 object DES survey hex 573-572 tiling 7
   c4d_160206_025047_ooi_r_ls9.fits.fz c4d_160206_025047_ooi_r_ls9-S13 r exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57424.117 object DES survey hex 573-572 tiling 5
   c4d_160206_025441_ooi_g_ls9.fits.fz c4d_160206_025441_ooi_g_ls9-S13 g exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 57424.120 object DES survey hex 573-572 tiling 5
   c4d_131228_052949_ooi_r_ls9.fits.fz c4d_131228_052949_ooi_r_ls9-N13 r exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 56654.227 object DES survey hex 573-572 tiling 4
   c4d_131228_051534_ooi_g_ls9.fits.fz c4d_131228_051534_ooi_g_ls9-N13 g exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 56654.218 object DES survey hex 573-572 tiling 4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9611c20-g-20140123T032628_oi[S19,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96105f3-z-20131213T041116_oi[S19,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961262c-r-20140123T033226_oi[S19,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9636c06-r-20131206T070431_oi[N20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637191-g-20131109T080652_oi[N25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96105f3-z-20131213T035049_oi[N20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9610c62-z-20131214T041124_oi[N25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96106cd-r-20131230T050922_oi[N25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-r-20180119T032745_oi[S4,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180103_908c72f-z-20180105T043743_oi[S4,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637808-g-20131206T070232_oi[N20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180210_90d885b-g-20180212T020806_oi[S4,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637191-g-20131201T071859_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9626ec7-g-20160206T025222_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635a72-r-20131201T072059_oi[S11,noinherit][2046,4094][real]: DES sur
Zeroing out 5 weight-map pixels below quantization error (= median 6.6e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131212T055337_oi[S11,noinherit][2046,4094][real]: DES sur
Zeroing out 4 weight-map pixels below quantization error (= median 3.69e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637191-g-20131109T075017_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T082330_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161223T053131_oi[S4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-r-20180114T040920_oi[N16,noinherit][2046,4094][real]: DE
Zeroing out 3 weight-map pixels below quantization error (= median 0.000223)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180114T041119_oi[N16,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9506e1c-r-20161223T052931_oi[S4,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9626ec7-g-20160206T025222_oi[S13,noinherit][2046,4094][real]: DES sur
Zeroing out 6407 weight-map pixels below quantization error (= median 2.94e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fcce-r-20131228T052720_oi[N13,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fa18-g-20131228T051312_oi[N13,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962862d-r-20160206T024826_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962862d-r-20160206T024826_oi[S13,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 208.64 s, CPU: 1.30 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 212 MB, VmData: 246 MB, maxrss: 0.451356 MB
Stage tims finished: 2020-06-04T03:11:02.039240
Zeroing out 6394 weight-map pixels below quantization error (= median 0.000257)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9636c06-r-20131206T070431_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180210_90d885b-g-20180212T020806_oi[S4,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-g-20180114T041119_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 6418 weight-map pixels below quantization error (= median 7.61e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9610c62-z-20131214T041124_oi[N25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637191-g-20131201T071859_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180110_909afae-r-20180114T040920_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96106cd-r-20131230T050922_oi[N25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9635a72-r-20131201T072059_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9506e1c-r-20161223T052931_oi[S4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961262c-r-20140123T033226_oi[S19,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180103_908c72f-z-20180105T043743_oi[S4,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637191-g-20131109T075017_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9626ec7-g-20160206T025222_oi[S13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9611c20-g-20140123T032628_oi[S19,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637808-g-20131206T070232_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T082330_oi[N16,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fcce-r-20131228T052720_oi[N13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96105f3-z-20131213T035049_oi[N20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9626ec7-g-20160206T025222_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161223T053131_oi[S4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fa18-g-20131228T051312_oi[N13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96105f3-z-20131213T041116_oi[S19,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-r-20180119T032745_oi[S4,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_960fe80-z-20131212T055337_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962862d-r-20160206T024826_oi[S13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 10.451 s worker CPU, 973.512 s worker Wall, Wall: 208.639 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9637191-g-20131109T080652_oi[N25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962862d-r-20160206T024826_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Running stage refs at 2020-06-04T03:11:02.118849
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11290.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11198.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11199.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/reference-custom-058840m56746.fits
Stage refs : Wall: 2.12 s, CPU: 1.75 s, VmPeak: 1045 MB, VmSize: 1033 MB, VmRSS: 247 MB, VmData: 280 MB, maxrss: 0.451356 MB
Stage refs finished: 2020-06-04T03:11:04.236208
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.119 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T03:11:04.237989
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/outlier-mask-custom-058840m56746.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/outliers-pre-custom-058840m56746.jpg
Image c4d_140123_032851_ooi_g_ls9-S19 g : masking 998 positive outlier pixels and 0 negative outlier pixels
Image c4d_131206_070454_ooi_g_ls9-N20 g : masking 228 positive outlier pixels and 0 negative outlier pixels
Image c4d_131109_075017_ooi_g_ls9-S11 g : masking 285 positive outlier pixels and 0 negative outlier pixels
Image c4d_131109_080652_ooi_g_ls9-N25 g : masking 6991 positive outlier pixels and 0 negative outlier pixels
Image c4d_180212_020806_ooi_g_v1-S4 g : masking 632 positive outlier pixels and 0 negative outlier pixels
Image c4d_131228_051534_ooi_g_ls9-N13 g : masking 0 positive outlier pixels and 113 negative outlier pixels
Image c4d_160206_025047_ooi_r_ls9-S13 r : masking 0 positive outlier pixels and 71 negative outlier pixels
Image c4d_131201_072327_ooi_r_ls9-S11 r : masking 0 positive outlier pixels and 470 negative outlier pixels
Image c4d_180114_040920_ooi_r_v1-N16 r : masking 396 positive outlier pixels and 0 negative outlier pixels
Image c4d_180119_032745_ooi_r_v1-S4 r : masking 1224 positive outlier pixels and 0 negative outlier pixels
Image c4d_131230_051148_ooi_r_ls9-N25 r : masking 330 positive outlier pixels and 136 negative outlier pixels
Image c4d_140123_033448_ooi_r_ls9-S19 r : masking 308 positive outlier pixels and 0 negative outlier pixels
Image c4d_161223_053149_ooi_r_ls9-S4 r : masking 408 positive outlier pixels and 0 negative outlier pixels
Image c4d_171110_082330_ooi_z_v1-N16 z : masking 256 positive outlier pixels and 0 negative outlier pixels
Image c4d_131213_041339_ooi_z_ls9-S19 z : masking 258 positive outlier pixels and 0 negative outlier pixels
Image c4d_131212_055558_ooi_z_ls9-S11 z : masking 172 positive outlier pixels and 287 negative outlier pixels
Image c4d_131213_035311_ooi_z_ls9-N20 z : masking 7382 positive outlier pixels and 0 negative outlier pixels
Image c4d_131214_041347_ooi_z_ls9-N25 z : masking 552 positive outlier pixels and 0 negative outlier pixels
Image c4d_180105_043743_ooi_z_v1-S4 z : masking 190 positive outlier pixels and 216 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/outlier-mask-custom-058840m56746.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/outliers-post-custom-058840m56746.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/outliers-masked-pos-custom-058840m56746.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/outliers-masked-neg-custom-058840m56746.jpg
Stage outliers : Wall: 2.88 s, CPU: 2.09 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 282 MB, VmData: 312 MB, maxrss: 0.451356 MB
Stage outliers finished: 2020-06-04T03:11:07.113186
Resources for stage outliers : 7.765 s worker CPU, 7.834 s worker Wall, Wall: 2.877 s, Cores in use: 3.43, Total efficiency (on 8 cores): 42.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T03:11:07.115344
Stage halos : Wall: 0.88 s, CPU: 0.48 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 282 MB, VmData: 312 MB, maxrss: 0.451356 MB
Stage halos finished: 2020-06-04T03:11:07.997758
Resources for stage halos : 0.962 s worker CPU, 3.192 s worker Wall, Wall: 0.884 s, Cores in use: 1.64, Total efficiency (on 8 cores): 20.5 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T03:11:08.000337
PSF sigmas in coadd pixels: ['2.94', '1.51', '1.82', '2.34', '1.83', '1.55', '2.53', '1.70', '1.71', '1.90', '1.95']
Using average PSF sigma 1.980431471153345
Gaussian PSF norm 0.1424410770495353 vs pixelized 0.12566008
average tim pixel scale / coadd scale: 1.0011064981809694
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.70', '1.64', '1.71', '1.92', '1.68', '1.55', '1.58', '1.62', '1.75', '1.75']
Using average PSF sigma 1.6910118274815837
Gaussian PSF norm 0.16682011751153786 vs pixelized 0.15282369
average tim pixel scale / coadd scale: 1.0011218279824088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.54', '1.50', '1.77', '1.37', '1.31', '1.48']
Using average PSF sigma 1.4939803967660101
Gaussian PSF norm 0.18882094596724508 vs pixelized 0.161673
average tim pixel scale / coadd scale: 1.0010255653969231
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.91 s, CPU: 0.90 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 284 MB, VmData: 312 MB, maxrss: 0.451356 MB
Stage fit_on_coadds finished: 2020-06-04T03:11:08.911623
Resources for stage fit_on_coadds : 1.484 s worker CPU, 1.499 s worker Wall, Wall: 0.913 s, Cores in use: 2.61, Total efficiency (on 8 cores): 32.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T03:11:08.916817
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 256 potential peaks
Of 256 potential peaks: 172 in veto map, 18 cut by saddle test, 0 cut by aper test, 66 kept
SED z : 66 new peaks
Found 255 potential peaks
Of 255 potential peaks: 184 in veto map, 28 cut by saddle test, 0 cut by aper test, 43 kept
SED r : 43 new peaks
Found 183 potential peaks
Of 183 potential peaks: 159 in veto map, 22 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 231 potential peaks
Of 231 potential peaks: 190 in veto map, 27 cut by saddle test, 0 cut by aper test, 14 kept
SED Flat : 14 new peaks
Found 266 potential peaks
Of 266 potential peaks: 233 in veto map, 26 cut by saddle test, 0 cut by aper test, 7 kept
SED Red : 7 new peaks
Adding 132 new sources
Median coadd sky for g : -0.00015429905
Median coadd sky for r : -0.00012700516
Median coadd sky for z : -0.000106594205
Stage srcs : Wall: 1.94 s, CPU: 1.85 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 284 MB, VmData: 312 MB, maxrss: 0.451356 MB
Stage srcs finished: 2020-06-04T03:11:10.859711
Resources for stage srcs : 0.227 s worker CPU, 0.227 s worker Wall, Wall: 1.944 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/IC2014-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T03:11:10.884761
Blob 1 of 49, id: 7, sources: 55, size: 254x421, npix 64202, brick X: 79,333, Y: 14,435, one pixel: 255 14
Blob 2 of 49, id: 24, sources: 8, size: 75x122, npix 4604, brick X: 41,116, Y: 198,320, one pixel: 99 198
Blob 3 of 49, id: 14, sources: 6, size: 66x102, npix 3281, brick X: 367,433, Y: 77,179, one pixel: 379 77
Blob 4 of 49, id: 27, sources: 5, size: 47x109, npix 3005, brick X: 1,48, Y: 221,330, one pixel: 10 221
Blob 5 of 49, id: 3, sources: 4, size: 64x67, npix 2683, brick X: 371,435, Y: 0,67, one pixel: 406 0
Blob 6 of 49, id: 38, sources: 3, size: 93x48, npix 2587, brick X: 340,433, Y: 340,388, one pixel: 388 340
Blob 7 of 49, id: 11, sources: 7, size: 43x85, npix 1779, brick X: 71,114, Y: 63,148, one pixel: 85 63
Blob 8 of 49, id: 0, sources: 2, size: 56x25, npix 942, brick X: 66,122, Y: 0,25, one pixel: 69 0
Blob 9 of 49, id: 33, sources: 3, size: 44x40, npix 926, brick X: 340,384, Y: 306,346, one pixel: 368 306
Blob 8 finished, total: Wall: 1.86 s, CPU: 1.86 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152776 MB
Blob 10 of 49, id: 22, sources: 2, size: 36x30, npix 743, brick X: 399,435, Y: 190,220, one pixel: 411 190
Blob 9 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 11 of 49, id: 13, sources: 2, size: 42x30, npix 703, brick X: 6,48, Y: 65,95, one pixel: 15 65
Blob 10 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 12 of 49, id: 10, sources: 2, size: 25x36, npix 588, brick X: 410,435, Y: 53,89, one pixel: 426 53
Measuring 4 iterative sources
Measuring 4 iterative sources
Blob 7 finished, total: Wall: 5.80 s, CPU: 5.80 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 13 of 49, id: 4, sources: 1, size: 34x25, npix 547, brick X: 122,156, Y: 4,29, one pixel: 144 4
Blob 11 finished, total: Wall: 2.14 s, CPU: 2.14 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 14 of 49, id: 32, sources: 1, size: 28x32, npix 544, brick X: 369,397, Y: 281,313, one pixel: 379 281
Blob 12 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 15 of 49, id: 39, sources: 1, size: 28x28, npix 526, brick X: 293,321, Y: 371,399, one pixel: 305 371
Measuring 5 iterative sources
Measuring 2 iterative sources
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 14 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 16 of 49, id: 31, sources: 1, size: 28x28, npix 510, brick X: 330,358, Y: 269,297, one pixel: 342 269
Blob 6 finished, total: Wall: 9.45 s, CPU: 9.44 s, VmPeak: 1021 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153488 MB
Blob 5 finished, total: Wall: 9.47 s, CPU: 9.47 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153332 MB
Blob 17 of 49, id: 37, sources: 2, size: 29x36, npix 507, brick X: 302,331, Y: 340,376, one pixel: 312 340
Blob 18 of 49, id: 23, sources: 2, size: 29x27, npix 470, brick X: 14,43, Y: 198,225, one pixel: 32 198
Blob 13 finished, total: Wall: 2.62 s, CPU: 2.62 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 19 of 49, id: 46, sources: 2, size: 36x23, npix 470, brick X: 267,303, Y: 410,433, one pixel: 277 410
Blob 4 finished, total: Wall: 9.95 s, CPU: 9.95 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 20 of 49, id: 41, sources: 1, size: 27x26, npix 451, brick X: 360,387, Y: 382,408, one pixel: 372 382
Blob 16 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 1021 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153488 MB
Blob 21 of 49, id: 30, sources: 1, size: 21x29, npix 446, brick X: 414,435, Y: 266,295, one pixel: 426 266
Blob 17 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 22 of 49, id: 43, sources: 1, size: 27x26, npix 405, brick X: 51,78, Y: 401,427, one pixel: 65 401
Blob 18 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 23 of 49, id: 1, sources: 1, size: 29x19, npix 372, brick X: 174,203, Y: 0,19, one pixel: 179 0
Blob 3 finished, total: Wall: 10.94 s, CPU: 10.94 s, VmPeak: 1020 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153828 MB
Blob 19 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 24 of 49, id: 12, sources: 1, size: 24x24, npix 364, brick X: 112,136, Y: 63,87, one pixel: 122 63
Blob 25 of 49, id: 36, sources: 1, size: 23x25, npix 360, brick X: 10,33, Y: 339,364, one pixel: 22 339
Blob 15 finished, total: Wall: 2.47 s, CPU: 2.47 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 26 of 49, id: 16, sources: 1, size: 24x24, npix 352, brick X: 13,37, Y: 118,142, one pixel: 24 118
Blob 20 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 1021 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153488 MB
Blob 27 of 49, id: 44, sources: 1, size: 24x24, npix 352, brick X: 97,121, Y: 405,429, one pixel: 107 405
Measuring 1 iterative sources
Blob 22 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 28 of 49, id: 5, sources: 1, size: 23x23, npix 344, brick X: 0,23, Y: 9,32, one pixel: 11 9
Blob 24 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 1020 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153828 MB
Blob 29 of 49, id: 40, sources: 1, size: 23x22, npix 301, brick X: 20,43, Y: 379,401, one pixel: 29 379
Blob 21 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 30 of 49, id: 45, sources: 1, size: 22x22, npix 294, brick X: 133,155, Y: 405,427, one pixel: 143 405
Blob 25 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 31 of 49, id: 2, sources: 1, size: 24x19, npix 288, brick X: 254,278, Y: 0,19, one pixel: 262 0
Blob 26 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 1021 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153488 MB
Blob 32 of 49, id: 15, sources: 1, size: 21x21, npix 261, brick X: 341,362, Y: 102,123, one pixel: 350 102
Blob 23 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 30 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 33 of 49, id: 6, sources: 1, size: 21x20, npix 240, brick X: 223,244, Y: 14,34, one pixel: 232 14
Blob 34 of 49, id: 42, sources: 1, size: 20x20, npix 238, brick X: 330,350, Y: 395,415, one pixel: 338 395
Blob 27 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 35 of 49, id: 19, sources: 1, size: 20x20, npix 229, brick X: 3,23, Y: 158,178, one pixel: 12 158
Blob 33 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 36 of 49, id: 34, sources: 1, size: 20x20, npix 228, brick X: 51,71, Y: 325,345, one pixel: 60 325
Blob 28 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 1020 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153828 MB
Blob 37 of 49, id: 21, sources: 1, size: 19x19, npix 208, brick X: 14,33, Y: 176,195, one pixel: 23 176
Blob 29 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 38 of 49, id: 26, sources: 1, size: 19x18, npix 189, brick X: 349,368, Y: 211,229, one pixel: 358 211
Blob 32 finished, total: Wall: 0.65 s, CPU: 0.64 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 39 of 49, id: 29, sources: 1, size: 18x19, npix 189, brick X: 398,416, Y: 261,280, one pixel: 407 261
Blob 34 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 40 of 49, id: 8, sources: 1, size: 19x19, npix 181, brick X: 27,46, Y: 18,37, one pixel: 36 18
Blob 37 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 41 of 49, id: 48, sources: 1, size: 16x18, npix 174, brick X: 0,16, Y: 417,435, one pixel: 6 417
Blob 42 of 49, id: 28, sources: 1, size: 18x18, npix 171, brick X: 371,389, Y: 243,261, one pixel: 379 243
Blob 38 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 39 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 43 of 49, id: 9, sources: 1, size: 17x18, npix 162, brick X: 99,116, Y: 44,62, one pixel: 107 44
Blob 35 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 44 of 49, id: 17, sources: 1, size: 17x18, npix 162, brick X: 106,123, Y: 123,141, one pixel: 114 123
Blob 40 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 45 of 49, id: 35, sources: 1, size: 18x17, npix 162, brick X: 402,420, Y: 330,347, one pixel: 410 330
Blob 36 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 1020 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153828 MB
Blob 46 of 49, id: 18, sources: 1, size: 17x17, npix 145, brick X: 60,77, Y: 156,173, one pixel: 68 156
Blob 44 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 47 of 49, id: 20, sources: 1, size: 17x17, npix 145, brick X: 80,97, Y: 159,176, one pixel: 88 159
Measuring 1 iterative sources
Blob 42 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 48 of 49, id: 25, sources: 1, size: 17x17, npix 145, brick X: 374,391, Y: 209,226, one pixel: 382 209
Blob 41 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 49 of 49, id: 47, sources: 1, size: 17x17, npix 145, brick X: 79,96, Y: 416,433, one pixel: 87 416
Blob 43 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 45 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 1020 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153828 MB
Blob 46 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15358 MB
Blob 49 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 1019 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152272 MB
Blob 48 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 1025 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153576 MB
Blob 31 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 1021 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153488 MB
Blob 47 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 961 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152952 MB
Blob 2 finished, total: Wall: 15.53 s, CPU: 15.53 s, VmPeak: 959 MB, VmSize: 723 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.15372 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.53341, ee1=0.29771, ee2=0.157167
Measuring 23 iterative sources
Blob 1 finished, total: Wall: 85.69 s, CPU: 85.68 s, VmPeak: 1015 MB, VmSize: 765 MB, VmRSS: 200 MB, VmData: 228 MB, maxrss: 0.220852 MB
Old catalog: 143
New catalog: 169
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/blobs-custom-058840m56746.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/metrics/cus/all-models-custom-058840m56746.fits
Stage fitblobs : Wall: 86.33 s, CPU: 0.81 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 284 MB, VmData: 312 MB, maxrss: 0.451356 MB
Stage fitblobs finished: 2020-06-04T03:12:37.213875
Resources for stage fitblobs : 186.439 s worker CPU, 186.516 s worker Wall, Wall: 86.331 s, Cores in use: 2.17, Total efficiency (on 8 cores): 27.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T03:12:37.217132
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/tmp-legacysurvey-custom-058840m56746-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/tmp-legacysurvey-custom-058840m56746-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/tmp-legacysurvey-custom-058840m56746-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/tmp-legacysurvey-custom-058840m56746-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-resid.jpg
Stage coadds : Wall: 3.22 s, CPU: 1.73 s, VmPeak: 1171 MB, VmSize: 1044 MB, VmRSS: 287 MB, VmData: 315 MB, maxrss: 0.451356 MB
Stage coadds finished: 2020-06-04T03:12:40.432587
Resources for stage coadds : 7.309 s worker CPU, 8.412 s worker Wall, Wall: 3.217 s, Cores in use: 2.81, Total efficiency (on 8 cores): 35.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T03:12:40.434472
Cut to 1 unWISE tiles
Reading WISE tile 0586m561 band 2
Reading WISE tile 0586m561 band 1
Reading WISE tile 0586m561 band 3
Reading WISE tile 0586m561 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.87 s, CPU: 2.92 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 159 MB, VmData: 194 MB, maxrss: 0.19836 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.47 s, CPU: 0.76 s, VmPeak: 1025 MB, VmSize: 1005 MB, VmRSS: 153 MB, VmData: 192 MB, maxrss: 0.214348 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.35 s, CPU: 0.79 s, VmPeak: 1019 MB, VmSize: 1005 MB, VmRSS: 153 MB, VmData: 192 MB, maxrss: 0.21546 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0586m561/unwise-0586m561-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.38 s, CPU: 1.01 s, VmPeak: 1021 MB, VmSize: 1005 MB, VmRSS: 149 MB, VmData: 192 MB, maxrss: 0.210332 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/tmp-legacysurvey-custom-058840m56746-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/tmp-legacysurvey-custom-058840m56746-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.14 s, CPU: 1.30 s, VmPeak: 1171 MB, VmSize: 1044 MB, VmRSS: 287 MB, VmData: 315 MB, maxrss: 0.451356 MB
Stage wise_forced finished: 2020-06-04T03:12:44.574430
Resources for stage wise_forced : 9.211 s worker CPU, 9.211 s worker Wall, Wall: 4.142 s, Cores in use: 2.54, Total efficiency (on 8 cores): 31.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T03:12:44.577232
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/coadd/cus/custom-058840m56746/legacysurvey-custom-058840m56746-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/tractor-i/cus/tractor-custom-058840m56746.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/tractor/cus/tractor-custom-058840m56746.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/IC2014/tractor/cus/brick-custom-058840m56746.sha256sum
Stage writecat : Wall: 2.92 s, CPU: 2.78 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 291 MB, VmData: 317 MB, maxrss: 0.451356 MB
Stage writecat finished: 2020-06-04T03:12:47.496612
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.921 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.9 %
Stage writecat finished
All done: 223.852 s worker CPU, 1190.407 s worker Wall, Wall: 314.101 s, Cores in use: 0.76, Total efficiency (on 8 cores): 9.5 %
Finished galaxy IC2014 in 5.288 minutes.