Started working on galaxy DR8-0364m230-782 at Thu Jun 25 03:47:06 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.44619276858397 -23.097529840833147 --width 283 --height 283 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-25T03:47:18.674119
legacypipe git version: DR9.5.2-150-g3ed0fdf5
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.44619276858397', '-23.097529840833147', '--width', '283', '--height', '283', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.44619276858397 -23.097529840833147 --width 283 --height 283 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 36.44619276858397 -23.097529840833147
Starting process 8118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 57 MB, VmData: 130 MB, maxrss: 0.057744 MB
Starting process 8122 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 57 MB, VmData: 130 MB, maxrss: 0.057744 MB
Starting process 8125 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057744 MB
Starting process 8129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057748 MB
Starting process 8134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057748 MB
Starting process 8137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057748 MB
Starting process 8142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057752 MB
Starting process 8147 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 57 MB, VmData: 130 MB, maxrss: 0.057744 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-25T03:47:22.792614
Keeping 32 CCDs:
   c4d_161116_062553_ooi_z_ls9.fits.fz c4d_161116_062553_ooi_z_ls9-S5 z exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57708.266 object DES survey hex 365-237 tiling 6
   c4d_161028_075313_ooi_g_ls9.fits.fz c4d_161028_075313_ooi_g_ls9-S5 g exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57689.327 object DES survey hex 365-237 tiling 6
   c4d_161028_075114_ooi_r_ls9.fits.fz c4d_161028_075114_ooi_r_ls9-S5 r exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57689.326 object DES survey hex 365-237 tiling 6
   c4d_150210_010725_ooi_r_ls9.fits.fz c4d_150210_010725_ooi_r_ls9-S6 r exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57063.045 object DES survey hex 365-237 tiling 2
   c4d_140816_092421_ooi_z_ls9.fits.fz c4d_140816_092421_ooi_z_ls9-S6 z exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56885.390 object DES survey hex 365-237 tiling 2
   c4d_141217_043708_ooi_g_ls9.fits.fz c4d_141217_043708_ooi_g_ls9-S6 g exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 57008.191 object DES survey hex 365-237 tiling 2
   c4d_150108_030947_ooi_z_ls9.fits.fz c4d_150108_030947_ooi_z_ls9-N23 z exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57030.130 object DES survey hex 366-217 tiling 3
   c4d_170209_010538_ooi_z_ls9.fits.fz c4d_170209_010538_ooi_z_ls9-N28 z exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57793.044 object DES survey hex 348-227 tiling 7
   c4d_150114_025109_ooi_g_ls9.fits.fz c4d_150114_025109_ooi_g_ls9-N23 g exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57036.117 object DES survey hex 366-217 tiling 3
   c4d_161231_034111_ooi_r_ls9.fits.fz c4d_161231_034111_ooi_r_ls9-N28 r exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 57753.152 object DES survey hex 348-227 tiling 7
   c4d_161231_034507_ooi_g_ls9.fits.fz c4d_161231_034507_ooi_g_ls9-N28 g exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57753.155 object DES survey hex 348-227 tiling 7
   c4d_141217_041657_ooi_r_ls9.fits.fz c4d_141217_041657_ooi_r_ls9-N23 r exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57008.177 object DES survey hex 366-217 tiling 3
   c4d_171011_082339_ooi_z_ls9.fits.fz c4d_171011_082339_ooi_z_ls9-S27 z exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 58037.350 object DES survey hex 365-237 tiling 8
   c4d_171123_055005_ooi_r_ls9.fits.fz c4d_171123_055005_ooi_r_ls9-S27 r exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58080.243 object DES survey hex 365-237 tiling 8
   c4d_171123_055203_ooi_g_ls9.fits.fz c4d_171123_055203_ooi_g_ls9-S27 g exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 58080.244 object DES survey hex 365-237 tiling 8
   c4d_160205_011304_ooi_g_ls9.fits.fz c4d_160205_011304_ooi_g_ls9-S16 g exptime 90.0 propid 2012B-0001 seeing 1.41 MJD 57423.049 object DES survey hex 365-237 tiling 5
   c4d_160205_010905_ooi_r_ls9.fits.fz c4d_160205_010905_ooi_r_ls9-S16 r exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57423.046 object DES survey hex 365-237 tiling 5
   c4d_160117_023242_ooi_z_ls9.fits.fz c4d_160117_023242_ooi_z_ls9-S16 z exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57404.104 object DES survey hex 365-237 tiling 5
   c4d_150210_010924_ooi_g_ls9.fits.fz c4d_150210_010924_ooi_g_ls9-S22 g exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57063.047 object DES survey hex 365-237 tiling 1
   c4d_141213_043753_ooi_z_ls9.fits.fz c4d_141213_043753_ooi_z_ls9-S22 z exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57004.191 object DES survey hex 365-237 tiling 1
   c4d_150115_024954_ooi_r_ls9.fits.fz c4d_150115_024954_ooi_r_ls9-S22 r exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57037.116 object DES survey hex 365-237 tiling 1
   c4d_180110_025100_ooi_g_ls9.fits.fz c4d_180110_025100_ooi_g_ls9-S8 g exptime 90.0 propid 2012B-0001 seeing 1.38 MJD 58128.119 object DES survey hex 365-237 tiling 9
   c4d_180110_024901_ooi_r_ls9.fits.fz c4d_180110_024901_ooi_r_ls9-S8 r exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 58128.117 object DES survey hex 365-237 tiling 9
   c4d_180127_010227_ooi_z_ls9.fits.fz c4d_180127_010227_ooi_z_ls9-S8 z exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 58145.043 object DES survey hex 365-237 tiling 9
   c4d_140816_092421_ooi_z_ls9.fits.fz c4d_140816_092421_ooi_z_ls9-S13 z exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56885.390 object DES survey hex 365-237 tiling 2
   c4d_151119_050825_ooi_g_ls9.fits.fz c4d_151119_050825_ooi_g_ls9-N4 g exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57345.213 object DES survey hex 365-237 tiling 4
   c4d_151119_050630_ooi_r_ls9.fits.fz c4d_151119_050630_ooi_r_ls9-N4 r exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57345.211 object DES survey hex 365-237 tiling 4
   c4d_151122_020023_ooi_z_ls9.fits.fz c4d_151122_020023_ooi_z_ls9-N4 z exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57348.082 object DES survey hex 365-237 tiling 4
   c4d_180919_083510_ooi_g_ls9.fits.fz c4d_180919_083510_ooi_g_ls9-S11 g exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58380.358 object DES survey hex 365-237 tiling 10
   c4d_181020_071949_ooi_z_ls9.fits.fz c4d_181020_071949_ooi_z_ls9-S11 z exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58411.305 object DES survey hex 365-237 tiling 10
   c4d_180916_091129_ooi_g_ls9.fits.fz c4d_180916_091129_ooi_g_ls9-S11 g exptime 90.0 propid 2012B-0001 seeing 2.00 MJD 58377.383 object DES survey hex 365-237 tiling 10
   c4d_180916_090930_ooi_r_ls9.fits.fz c4d_180916_090930_ooi_r_ls9-S11 r exptime 90.0 propid 2012B-0001 seeing 1.70 MJD 58377.382 object DES survey hex 365-237 tiling 10
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9509aac-z-20170209T010319_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95009e7-z-20161116T062333_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550d68-g-20141217T043443_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955833c-g-20161028T075052_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956067b-r-20161028T074854_oi[S5,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95544bb-g-20150114T024848_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955305d-r-20150210T010506_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95629d9-z-20150108T030728_oi[N23,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T034248_oi[N28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954ea59-r-20141217T041438_oi[N23,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950856c-r-20161231T033850_oi[N28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T055005_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9571eaa-r-20160205T010647_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T082339_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551493-z-20160117T023024_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T055203_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d11b-g-20160205T011045_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b2-z-20141213T043530_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9556626-g-20150210T010705_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150115T024734_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180110T024901_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S13,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20180110T025100_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b9-z-20151122T015804_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180919T083510_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151119T050408_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010227_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d57b-g-20151119T050606_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9601883-z-20181020T071949_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fc861-r-20180916T090930_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180916T091129_oi[S11,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 63.66 s, CPU: 4.15 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.204056 MB
Stage tims finished: 2020-06-25T03:48:26.451852
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95629d9-z-20150108T030728_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9571eaa-r-20160205T010647_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20180110T025100_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956067b-r-20161028T074854_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T055005_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150115T024734_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180919T083510_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95009e7-z-20161116T062333_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950856c-r-20161231T033850_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b2-z-20141213T043530_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151119T050408_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955833c-g-20161028T075052_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T082339_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010227_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955305d-r-20150210T010506_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d11b-g-20160205T011045_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d57b-g-20151119T050606_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T034248_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551493-z-20160117T023024_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180110T024901_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9601883-z-20181020T071949_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9509aac-z-20170209T010319_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95544bb-g-20150114T024848_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T055203_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180916T091129_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550d68-g-20141217T043443_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954ea59-r-20141217T041438_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9556626-g-20150210T010705_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b9-z-20151122T015804_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fc861-r-20180916T090930_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 11.621 s worker CPU, 425.573 s worker Wall, Wall: 63.661 s, Cores in use: 0.25, Total efficiency (on 8 cores): 3.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-25T03:48:26.511292
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08525.fits
Matched 18 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/reference-custom-036446m23097.fits
Stage refs : Wall: 2.71 s, CPU: 2.40 s, VmPeak: 1032 MB, VmSize: 1011 MB, VmRSS: 211 MB, VmData: 243 MB, maxrss: 0.21604 MB
Stage refs finished: 2020-06-25T03:48:29.226070
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.716 s, Cores in use: 0.88, Total efficiency (on 8 cores): 11.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-06-25T03:48:31.621085
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outlier-mask-custom-036446m23097.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-pre-custom-036446m23097.jpg
Image c4d_161028_075313_ooi_g_ls9-S5 g : masking 0 positive outlier pixels and 130 negative outlier pixels
Image c4d_150114_025109_ooi_g_ls9-N23 g : masking 368 positive outlier pixels and 0 negative outlier pixels
Image c4d_161028_075114_ooi_r_ls9-S5 r : masking 350 positive outlier pixels and 127 negative outlier pixels
Image c4d_150115_024954_ooi_r_ls9-S22 r : masking 203 positive outlier pixels and 0 negative outlier pixels
Image c4d_151119_050630_ooi_r_ls9-N4 r : masking 229 positive outlier pixels and 0 negative outlier pixels
Image c4d_180916_090930_ooi_r_ls9-S11 r : masking 237 positive outlier pixels and 0 negative outlier pixels
Image c4d_140816_092421_ooi_z_ls9-S6 z : masking 142 positive outlier pixels and 0 negative outlier pixels
Image c4d_161116_062553_ooi_z_ls9-S5 z : masking 261 positive outlier pixels and 0 negative outlier pixels
Image c4d_151122_020023_ooi_z_ls9-N4 z : masking 0 positive outlier pixels and 73 negative outlier pixels
Image c4d_181020_071949_ooi_z_ls9-S11 z : masking 293 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outlier-mask-custom-036446m23097.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-post-custom-036446m23097.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-masked-pos-custom-036446m23097.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-masked-neg-custom-036446m23097.jpg
Stage outliers : Wall: 3.10 s, CPU: 2.78 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 245 MB, VmData: 274 MB, maxrss: 0.250896 MB
Stage outliers finished: 2020-06-25T03:48:34.720648
Resources for stage outliers : 3.023 s worker CPU, 3.038 s worker Wall, Wall: 3.101 s, Cores in use: 1.87, Total efficiency (on 8 cores): 23.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-06-25T03:48:34.782842
Stage halos : Wall: 1.39 s, CPU: 1.39 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 245 MB, VmData: 275 MB, maxrss: 0.25108 MB
Stage halos finished: 2020-06-25T03:48:36.171858
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.390 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-25T03:48:36.243945
PSF sigmas in coadd pixels: ['1.91', '1.86', '1.82', '2.04', '1.81', '2.29', '1.63', '2.23', '2.04', '2.37', '3.25']
Using average PSF sigma 2.1142157670045094
Gaussian PSF norm 0.13342762653480697 vs pixelized 0.11356711
average tim pixel scale / coadd scale: 1.0010687803437883
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.98', '1.92', '2.01', '1.96', '1.92', '2.03', '1.92', '1.99', '1.84', '2.76']
Using average PSF sigma 2.03328211657091
Gaussian PSF norm 0.13873863812348158 vs pixelized 0.1301856
average tim pixel scale / coadd scale: 1.0010847772510707
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.61', '1.81', '1.74', '1.81', '1.90', '1.79', '1.73', '1.83', '1.62', '1.59']
Using average PSF sigma 1.7421218897775923
Gaussian PSF norm 0.16192597856048507 vs pixelized 0.15122092
average tim pixel scale / coadd scale: 1.0010189037300816
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.56 s, CPU: 0.55 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.254664 MB
Stage fit_on_coadds finished: 2020-06-25T03:48:36.799572
Resources for stage fit_on_coadds : 0.751 s worker CPU, 0.754 s worker Wall, Wall: 0.557 s, Cores in use: 2.34, Total efficiency (on 8 cores): 29.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-06-25T03:48:36.812101
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 23 kept
SED z : 23 new peaks
Found 41 potential peaks
Of 41 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 12 kept
SED r : 12 new peaks
Found 29 potential peaks
Of 29 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 53 potential peaks
Of 53 potential peaks: 38 in veto map, 6 cut by saddle test, 0 cut by aper test, 9 kept
SED Flat : 9 new peaks
Found 52 potential peaks
Of 52 potential peaks: 46 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 44 new sources
Median coadd sky for g : -0.00011363122
Median coadd sky for r : -7.572757e-05
Median coadd sky for z : 8.5819214e-05
Stage srcs : Wall: 1.58 s, CPU: 1.50 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 249 MB, VmData: 277 MB, maxrss: 0.25528 MB
Stage srcs finished: 2020-06-25T03:48:38.390410
Resources for stage srcs : 0.124 s worker CPU, 0.124 s worker Wall, Wall: 1.579 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-25T03:48:38.402729
Blob 1 of 27, id: 11, sources: 6, size: 98x96, npix 5237, brick X: 102,200, Y: 91,187, one pixel: 137 91
Blob 2 of 27, id: 1, sources: 7, size: 84x88, npix 2719, brick X: 74,158, Y: 0,88, one pixel: 82 0
Blob 3 of 27, id: 24, sources: 2, size: 48x42, npix 1427, brick X: 68,116, Y: 241,283, one pixel: 92 241
Blob 4 of 27, id: 10, sources: 2, size: 49x39, npix 1172, brick X: 42,91, Y: 79,118, one pixel: 54 79
Blob 5 of 27, id: 23, sources: 2, size: 52x43, npix 1161, brick X: 13,65, Y: 234,277, one pixel: 23 234
Blob 6 of 27, id: 8, sources: 2, size: 38x32, npix 761, brick X: 6,44, Y: 60,92, one pixel: 15 60
Blob 7 of 27, id: 16, sources: 2, size: 26x46, npix 717, brick X: 230,256, Y: 144,190, one pixel: 241 144
Blob 8 of 27, id: 14, sources: 1, size: 33x31, npix 712, brick X: 11,44, Y: 121,152, one pixel: 28 121
Blob 9 of 27, id: 9, sources: 2, size: 28x44, npix 706, brick X: 182,210, Y: 71,115, one pixel: 195 71
Blob 7 finished, total: Wall: 1.43 s, CPU: 1.32 s, VmPeak: 1027 MB, VmSize: 789 MB, VmRSS: 147 MB, VmData: 188 MB, maxrss: 0.1509 MB
Blob 10 of 27, id: 3, sources: 2, size: 35x39, npix 705, brick X: 189,224, Y: 21,60, one pixel: 198 21
Blob 8 finished, total: Wall: 1.52 s, CPU: 1.42 s, VmPeak: 1025 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145788 MB
Blob 11 of 27, id: 20, sources: 1, size: 32x29, npix 586, brick X: 179,211, Y: 195,224, one pixel: 193 195
Blob 6 finished, total: Wall: 2.19 s, CPU: 2.09 s, VmPeak: 1035 MB, VmSize: 788 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.150008 MB
Blob 12 of 27, id: 17, sources: 1, size: 29x28, npix 552, brick X: 161,190, Y: 173,201, one pixel: 174 173
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 2.37 s, CPU: 2.28 s, VmPeak: 1020 MB, VmSize: 783 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144748 MB
Blob 13 of 27, id: 4, sources: 1, size: 27x28, npix 481, brick X: 255,282, Y: 29,57, one pixel: 268 29
Blob 11 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 1035 MB, VmSize: 788 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.150008 MB
Blob 14 of 27, id: 7, sources: 1, size: 27x27, npix 461, brick X: 235,262, Y: 55,82, one pixel: 246 55
Blob 10 finished, total: Wall: 1.64 s, CPU: 1.64 s, VmPeak: 1025 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145788 MB
Blob 15 of 27, id: 5, sources: 1, size: 26x26, npix 426, brick X: 70,96, Y: 51,77, one pixel: 81 51
Blob 9 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 1027 MB, VmSize: 789 MB, VmRSS: 147 MB, VmData: 188 MB, maxrss: 0.1509 MB
Blob 16 of 27, id: 18, sources: 1, size: 25x25, npix 380, brick X: 83,108, Y: 175,200, one pixel: 95 175
Blob 12 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 1020 MB, VmSize: 783 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144748 MB
Blob 17 of 27, id: 2, sources: 1, size: 24x23, npix 349, brick X: 228,252, Y: 3,26, one pixel: 238 3
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 3.65 s, CPU: 3.56 s, VmPeak: 1026 MB, VmSize: 784 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146256 MB
Blob 18 of 27, id: 0, sources: 1, size: 25x18, npix 319, brick X: 39,64, Y: 0,18, one pixel: 44 0
Blob 17 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 1026 MB, VmSize: 784 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146256 MB
Blob 19 of 27, id: 26, sources: 1, size: 22x20, npix 309, brick X: 261,283, Y: 263,283, one pixel: 270 263
Blob 13 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 1035 MB, VmSize: 788 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.150008 MB
Blob 20 of 27, id: 13, sources: 1, size: 20x24, npix 293, brick X: 259,279, Y: 115,139, one pixel: 267 115
Blob 14 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 1025 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145788 MB
Blob 21 of 27, id: 21, sources: 1, size: 22x22, npix 291, brick X: 126,148, Y: 211,233, one pixel: 136 211
Blob 15 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 1027 MB, VmSize: 789 MB, VmRSS: 147 MB, VmData: 188 MB, maxrss: 0.1509 MB
Blob 22 of 27, id: 15, sources: 1, size: 23x21, npix 282, brick X: 59,82, Y: 128,149, one pixel: 70 128
Blob 16 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 1020 MB, VmSize: 783 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144748 MB
Blob 23 of 27, id: 19, sources: 1, size: 21x21, npix 250, brick X: 124,145, Y: 179,200, one pixel: 133 179
Blob 4 finished, total: Wall: 4.69 s, CPU: 4.59 s, VmPeak: 1029 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145436 MB
Blob 24 of 27, id: 22, sources: 1, size: 21x20, npix 240, brick X: 6,27, Y: 212,232, one pixel: 15 212
Blob 20 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 1025 MB, VmSize: 784 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146552 MB
Blob 25 of 27, id: 6, sources: 1, size: 20x19, npix 208, brick X: 173,193, Y: 54,73, one pixel: 182 54
Blob 19 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 1035 MB, VmSize: 788 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.150008 MB
Blob 26 of 27, id: 25, sources: 1, size: 18x17, npix 162, brick X: 187,205, Y: 256,273, one pixel: 195 256
Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1035 MB, VmSize: 788 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.150008 MB
Blob 27 of 27, id: 12, sources: 1, size: 17x17, npix 145, brick X: 15,32, Y: 103,120, one pixel: 23 103
Blob 23 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 1029 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145436 MB
Blob 18 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 1026 MB, VmSize: 784 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146256 MB
Blob 26 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1035 MB, VmSize: 788 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.150008 MB
Blob 21 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 1027 MB, VmSize: 789 MB, VmRSS: 147 MB, VmData: 188 MB, maxrss: 0.1509 MB
Blob 27 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 1029 MB, VmSize: 784 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145436 MB
Blob 22 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 1020 MB, VmSize: 783 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144748 MB
Blob 24 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 1025 MB, VmSize: 784 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146552 MB
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 7.24 s, CPU: 7.15 s, VmPeak: 1025 MB, VmSize: 789 MB, VmRSS: 148 MB, VmData: 188 MB, maxrss: 0.151452 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.10935, ee1=0.056301, ee2=-0.543896
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 7.69 s, CPU: 7.60 s, VmPeak: 1026 MB, VmSize: 789 MB, VmRSS: 148 MB, VmData: 188 MB, maxrss: 0.151324 MB
Old catalog: 45
New catalog: 47
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/blobs-custom-036446m23097.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/all-models-custom-036446m23097.fits
Stage fitblobs : Wall: 8.82 s, CPU: 1.15 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.255552 MB
Stage fitblobs finished: 2020-06-25T03:48:47.220328
Resources for stage fitblobs : 45.405 s worker CPU, 46.709 s worker Wall, Wall: 8.819 s, Cores in use: 5.28, Total efficiency (on 8 cores): 66.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-06-25T03:48:47.234787
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-resid.jpg
Stage coadds : Wall: 1.94 s, CPU: 0.69 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.256196 MB
Stage coadds finished: 2020-06-25T03:48:49.176729
Resources for stage coadds : 4.297 s worker CPU, 8.230 s worker Wall, Wall: 1.943 s, Cores in use: 2.57, Total efficiency (on 8 cores): 32.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-06-25T03:48:49.250216
Cut to 1 unWISE tiles
Reading WISE tile 0358m228 band 1
Reading WISE tile 0358m228 band 2
Reading WISE tile 0358m228 band 3
Reading WISE tile 0358m228 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.12 s, VmPeak: 1020 MB, VmSize: 861 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.206928 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.27 s, CPU: 0.18 s, VmPeak: 1026 MB, VmSize: 864 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.194312 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1027 MB, VmSize: 861 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.209568 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1025 MB, VmSize: 861 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.208048 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.70 s, CPU: 1.03 s, VmPeak: 1032 MB, VmSize: 1021 MB, VmRSS: 251 MB, VmData: 277 MB, maxrss: 0.256868 MB
Stage wise_forced finished: 2020-06-25T03:48:53.954327
Resources for stage wise_forced : 3.684 s worker CPU, 5.567 s worker Wall, Wall: 4.706 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-06-25T03:48:54.735484
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/tractor-i/cus/tractor-custom-036446m23097.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/tractor/cus/tractor-custom-036446m23097.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/tractor/cus/brick-custom-036446m23097.sha256sum
Stage writecat : Wall: 2.62 s, CPU: 2.48 s, VmPeak: 1153 MB, VmSize: 1025 MB, VmRSS: 253 MB, VmData: 277 MB, maxrss: 0.389672 MB
Stage writecat finished: 2020-06-25T03:48:57.359157
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.625 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-writecat.p
All done: 68.909 s worker CPU, 490.001 s worker Wall, Wall: 94.584 s, Cores in use: 0.92, Total efficiency (on 8 cores): 11.5 %
Finished galaxy DR8-0364m230-782 in 1.853 minutes.
Started working on galaxy DR8-0364m230-782 at Thu Jul 23 05:04:33 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.44619276858397 -23.097529840833147 --width 283 --height 283 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-23T05:04:34.364206
legacypipe git version: DR9.5.5-21-g66b1aacb
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.44619276858397', '-23.097529840833147', '--width', '283', '--height', '283', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.44619276858397 -23.097529840833147 --width 283 --height 283 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 36.44619276858397 -23.097529840833147
Starting process 62746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 62747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 62748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 62749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059028 MB
Starting process 62750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059032 MB
Starting process 62751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059032 MB
Starting process 62752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 62753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 62754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 62755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 62756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 62757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 62758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 62759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 62760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 62761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-23T05:04:34.865787
Keeping 32 CCDs:
   c4d_161116_062553_ooi_z_ls9.fits.fz c4d_161116_062553_ooi_z_ls9-S5 z exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57708.266 object DES survey hex 365-237 tiling 6
   c4d_161028_075313_ooi_g_ls9.fits.fz c4d_161028_075313_ooi_g_ls9-S5 g exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57689.327 object DES survey hex 365-237 tiling 6
   c4d_161028_075114_ooi_r_ls9.fits.fz c4d_161028_075114_ooi_r_ls9-S5 r exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57689.326 object DES survey hex 365-237 tiling 6
   c4d_150210_010725_ooi_r_ls9.fits.fz c4d_150210_010725_ooi_r_ls9-S6 r exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57063.045 object DES survey hex 365-237 tiling 2
   c4d_140816_092421_ooi_z_ls9.fits.fz c4d_140816_092421_ooi_z_ls9-S6 z exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56885.390 object DES survey hex 365-237 tiling 2
   c4d_141217_043708_ooi_g_ls9.fits.fz c4d_141217_043708_ooi_g_ls9-S6 g exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 57008.191 object DES survey hex 365-237 tiling 2
   c4d_150108_030947_ooi_z_ls9.fits.fz c4d_150108_030947_ooi_z_ls9-N23 z exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57030.130 object DES survey hex 366-217 tiling 3
   c4d_170209_010538_ooi_z_ls9.fits.fz c4d_170209_010538_ooi_z_ls9-N28 z exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57793.044 object DES survey hex 348-227 tiling 7
   c4d_150114_025109_ooi_g_ls9.fits.fz c4d_150114_025109_ooi_g_ls9-N23 g exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57036.117 object DES survey hex 366-217 tiling 3
   c4d_161231_034111_ooi_r_ls9.fits.fz c4d_161231_034111_ooi_r_ls9-N28 r exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 57753.152 object DES survey hex 348-227 tiling 7
   c4d_161231_034507_ooi_g_ls9.fits.fz c4d_161231_034507_ooi_g_ls9-N28 g exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57753.155 object DES survey hex 348-227 tiling 7
   c4d_141217_041657_ooi_r_ls9.fits.fz c4d_141217_041657_ooi_r_ls9-N23 r exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57008.177 object DES survey hex 366-217 tiling 3
   c4d_171011_082339_ooi_z_ls9.fits.fz c4d_171011_082339_ooi_z_ls9-S27 z exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 58037.350 object DES survey hex 365-237 tiling 8
   c4d_171123_055005_ooi_r_ls9.fits.fz c4d_171123_055005_ooi_r_ls9-S27 r exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58080.243 object DES survey hex 365-237 tiling 8
   c4d_171123_055203_ooi_g_ls9.fits.fz c4d_171123_055203_ooi_g_ls9-S27 g exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 58080.244 object DES survey hex 365-237 tiling 8
   c4d_160205_011304_ooi_g_ls9.fits.fz c4d_160205_011304_ooi_g_ls9-S16 g exptime 90.0 propid 2012B-0001 seeing 1.41 MJD 57423.049 object DES survey hex 365-237 tiling 5
   c4d_160205_010905_ooi_r_ls9.fits.fz c4d_160205_010905_ooi_r_ls9-S16 r exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57423.046 object DES survey hex 365-237 tiling 5
   c4d_160117_023242_ooi_z_ls9.fits.fz c4d_160117_023242_ooi_z_ls9-S16 z exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57404.104 object DES survey hex 365-237 tiling 5
   c4d_150210_010924_ooi_g_ls9.fits.fz c4d_150210_010924_ooi_g_ls9-S22 g exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57063.047 object DES survey hex 365-237 tiling 1
   c4d_141213_043753_ooi_z_ls9.fits.fz c4d_141213_043753_ooi_z_ls9-S22 z exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57004.191 object DES survey hex 365-237 tiling 1
   c4d_150115_024954_ooi_r_ls9.fits.fz c4d_150115_024954_ooi_r_ls9-S22 r exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57037.116 object DES survey hex 365-237 tiling 1
   c4d_180110_025100_ooi_g_ls9.fits.fz c4d_180110_025100_ooi_g_ls9-S8 g exptime 90.0 propid 2012B-0001 seeing 1.38 MJD 58128.119 object DES survey hex 365-237 tiling 9
   c4d_180110_024901_ooi_r_ls9.fits.fz c4d_180110_024901_ooi_r_ls9-S8 r exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 58128.117 object DES survey hex 365-237 tiling 9
   c4d_180127_010227_ooi_z_ls9.fits.fz c4d_180127_010227_ooi_z_ls9-S8 z exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 58145.043 object DES survey hex 365-237 tiling 9
   c4d_140816_092421_ooi_z_ls9.fits.fz c4d_140816_092421_ooi_z_ls9-S13 z exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56885.390 object DES survey hex 365-237 tiling 2
   c4d_151119_050825_ooi_g_ls9.fits.fz c4d_151119_050825_ooi_g_ls9-N4 g exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57345.213 object DES survey hex 365-237 tiling 4
   c4d_151119_050630_ooi_r_ls9.fits.fz c4d_151119_050630_ooi_r_ls9-N4 r exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57345.211 object DES survey hex 365-237 tiling 4
   c4d_151122_020023_ooi_z_ls9.fits.fz c4d_151122_020023_ooi_z_ls9-N4 z exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57348.082 object DES survey hex 365-237 tiling 4
   c4d_180919_083510_ooi_g_ls9.fits.fz c4d_180919_083510_ooi_g_ls9-S11 g exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58380.358 object DES survey hex 365-237 tiling 10
   c4d_181020_071949_ooi_z_ls9.fits.fz c4d_181020_071949_ooi_z_ls9-S11 z exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58411.305 object DES survey hex 365-237 tiling 10
   c4d_180916_091129_ooi_g_ls9.fits.fz c4d_180916_091129_ooi_g_ls9-S11 g exptime 90.0 propid 2012B-0001 seeing 2.00 MJD 58377.383 object DES survey hex 365-237 tiling 10
   c4d_180916_090930_ooi_r_ls9.fits.fz c4d_180916_090930_ooi_r_ls9-S11 r exptime 90.0 propid 2012B-0001 seeing 1.70 MJD 58377.382 object DES survey hex 365-237 tiling 10
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T055203_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T082339_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d11b-g-20160205T011045_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T055005_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95629d9-z-20150108T030728_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956067b-r-20161028T074854_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955305d-r-20150210T010506_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955833c-g-20161028T075052_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954ea59-r-20141217T041438_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T034248_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95544bb-g-20150114T024848_oi[N23,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9509aac-z-20170209T010319_oi[N28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550d68-g-20141217T043443_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95009e7-z-20161116T062333_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950856c-r-20161231T033850_oi[N28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9571eaa-r-20160205T010647_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9556626-g-20150210T010705_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551493-z-20160117T023024_oi[S16,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b2-z-20141213T043530_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150115T024734_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010227_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9601883-z-20181020T071949_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180916T091129_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180919T083510_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180110T024901_oi[S8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fc861-r-20180916T090930_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151119T050408_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b9-z-20151122T015804_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S13,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d57b-g-20151119T050606_oi[N4,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20180110T025100_oi[S8,noinherit][2046,4094][real]: DES surv
Stage tims : Wall: 18.97 s, CPU: 0.90 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 199 MB, VmData: 233 MB, maxrss: 0.20426 MB
Stage tims finished: 2020-07-23T05:04:53.839861
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T055203_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9571eaa-r-20160205T010647_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T082339_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9556626-g-20150210T010705_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956d11b-g-20160205T011045_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551493-z-20160117T023024_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T055005_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b2-z-20141213T043530_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956067b-r-20161028T074854_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150115T024734_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955833c-g-20161028T075052_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010227_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550d68-g-20141217T043443_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9601883-z-20181020T071949_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950856c-r-20161231T033850_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fc861-r-20180916T090930_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9509aac-z-20170209T010319_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95561b9-z-20151122T015804_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95629d9-z-20150108T030728_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20180110T025100_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950820e-g-20161231T034248_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d57b-g-20151119T050606_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 15.203 s worker CPU, 221.108 s worker Wall, Wall: 18.976 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95009e7-z-20161116T062333_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180916T091129_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955305d-r-20150210T010506_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180110T024901_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95fac5d-g-20180919T083510_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95544bb-g-20150114T024848_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151119T050408_oi[N4,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954ea59-r-20141217T041438_oi[N23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140816T092201_oi[S13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
/opt/conda/lib/python3.7/site-packages/numpy/core/fromnumeric.py:3257: RuntimeWarning: Mean of empty slice.
  out=out, **kwargs)
/opt/conda/lib/python3.7/site-packages/numpy/core/_methods.py:161: RuntimeWarning: invalid value encountered in true_divide
  ret = ret.dtype.type(ret / rcount)
/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py:858: RuntimeWarning: invalid value encountered in greater
  n = np.sum(invvar > thresh)
Running stage refs at 2020-07-23T05:04:54.628665
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08525.fits
Matched 18 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/reference-custom-036446m23097.fits
Stage refs : Wall: 1.91 s, CPU: 1.22 s, VmPeak: 1034 MB, VmSize: 1014 MB, VmRSS: 211 MB, VmData: 244 MB, maxrss: 0.216252 MB
Stage refs finished: 2020-07-23T05:04:56.541497
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.914 s, Cores in use: 0.64, Total efficiency (on 16 cores): 4.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-23T05:04:56.607561
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outlier-mask-custom-036446m23097.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-pre-custom-036446m23097.jpg
Image c4d_161028_075313_ooi_g_ls9-S5 g : masking 0 positive outlier pixels and 130 negative outlier pixels
Image c4d_150114_025109_ooi_g_ls9-N23 g : masking 368 positive outlier pixels and 0 negative outlier pixels
Image c4d_161028_075114_ooi_r_ls9-S5 r : masking 350 positive outlier pixels and 127 negative outlier pixels
Image c4d_150115_024954_ooi_r_ls9-S22 r : masking 203 positive outlier pixels and 0 negative outlier pixels
Image c4d_151119_050630_ooi_r_ls9-N4 r : masking 229 positive outlier pixels and 0 negative outlier pixels
Image c4d_180916_090930_ooi_r_ls9-S11 r : masking 237 positive outlier pixels and 0 negative outlier pixels
Image c4d_140816_092421_ooi_z_ls9-S6 z : masking 142 positive outlier pixels and 0 negative outlier pixels
Image c4d_161116_062553_ooi_z_ls9-S5 z : masking 261 positive outlier pixels and 0 negative outlier pixels
Image c4d_151122_020023_ooi_z_ls9-N4 z : masking 0 positive outlier pixels and 73 negative outlier pixels
Image c4d_181020_071949_ooi_z_ls9-S11 z : masking 293 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outlier-mask-custom-036446m23097.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-post-custom-036446m23097.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-masked-pos-custom-036446m23097.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/outliers-masked-neg-custom-036446m23097.jpg
Stage outliers : Wall: 2.02 s, CPU: 1.68 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 248 MB, VmData: 278 MB, maxrss: 0.253912 MB
Stage outliers finished: 2020-07-23T05:04:58.629057
Resources for stage outliers : 3.006 s worker CPU, 3.006 s worker Wall, Wall: 2.023 s, Cores in use: 2.32, Total efficiency (on 16 cores): 14.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-23T05:04:58.705035
Stage halos : Wall: 0.50 s, CPU: 0.50 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 248 MB, VmData: 279 MB, maxrss: 0.25424 MB
Stage halos finished: 2020-07-23T05:04:59.209275
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.506 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-23T05:04:59.276874
PSF sigmas in coadd pixels: ['1.91', '1.86', '1.82', '2.04', '1.81', '2.29', '1.63', '2.23', '2.04', '2.37', '3.25']
Using average PSF sigma 2.1142157670045094
Gaussian PSF norm 0.13342762653480697 vs pixelized 0.113567114
average tim pixel scale / coadd scale: 1.0010687803437883
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.98', '1.92', '2.01', '1.96', '1.92', '2.03', '1.92', '1.99', '1.84', '2.76']
Using average PSF sigma 2.03328211657091
Gaussian PSF norm 0.13873863812348158 vs pixelized 0.13018559
average tim pixel scale / coadd scale: 1.0010847772510707
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.61', '1.81', '1.74', '1.81', '1.90', '1.79', '1.73', '1.83', '1.62', '1.59']
Using average PSF sigma 1.7421218897775923
Gaussian PSF norm 0.16192597856048507 vs pixelized 0.1512209
average tim pixel scale / coadd scale: 1.0010189037300816
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.52 s, CPU: 0.49 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 251 MB, VmData: 280 MB, maxrss: 0.257284 MB
Stage fit_on_coadds finished: 2020-07-23T05:04:59.792854
Resources for stage fit_on_coadds : 0.641 s worker CPU, 0.641 s worker Wall, Wall: 0.518 s, Cores in use: 2.19, Total efficiency (on 16 cores): 13.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-23T05:04:59.814844
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 23 kept
SED z : 23 new peaks
Found 41 potential peaks
Of 41 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 12 kept
SED r : 12 new peaks
Found 29 potential peaks
Of 29 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 53 potential peaks
Of 53 potential peaks: 38 in veto map, 6 cut by saddle test, 0 cut by aper test, 9 kept
SED Flat : 9 new peaks
Found 52 potential peaks
Of 52 potential peaks: 46 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 44 new sources
Median coadd sky for g : -0.00011363116
Median coadd sky for r : -7.5727585e-05
Median coadd sky for z : 8.581891e-05
Stage srcs : Wall: 1.11 s, CPU: 1.06 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.257656 MB
Stage srcs finished: 2020-07-23T05:05:00.920955
Resources for stage srcs : 0.083 s worker CPU, 0.083 s worker Wall, Wall: 1.108 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-23T05:05:00.940914
Blob 1 of 27, id: 11, sources: 6, size: 98x96, npix 5237, brick X: 102,200, Y: 91,187, one pixel: 137 91
Blob 2 of 27, id: 1, sources: 7, size: 84x88, npix 2719, brick X: 74,158, Y: 0,88, one pixel: 82 0
Blob 3 of 27, id: 24, sources: 2, size: 48x42, npix 1427, brick X: 68,116, Y: 241,283, one pixel: 92 241
Blob 4 of 27, id: 10, sources: 2, size: 49x39, npix 1172, brick X: 42,91, Y: 79,118, one pixel: 54 79
Blob 5 of 27, id: 23, sources: 2, size: 52x43, npix 1161, brick X: 13,65, Y: 234,277, one pixel: 23 234
Blob 6 of 27, id: 8, sources: 2, size: 38x32, npix 761, brick X: 6,44, Y: 60,92, one pixel: 15 60
Blob 7 of 27, id: 16, sources: 2, size: 26x46, npix 717, brick X: 230,256, Y: 144,190, one pixel: 241 144
Blob 8 of 27, id: 14, sources: 1, size: 33x31, npix 712, brick X: 11,44, Y: 121,152, one pixel: 28 121
Blob 9 of 27, id: 9, sources: 2, size: 28x44, npix 706, brick X: 182,210, Y: 71,115, one pixel: 195 71
Blob 10 of 27, id: 3, sources: 2, size: 35x39, npix 705, brick X: 189,224, Y: 21,60, one pixel: 198 21
Blob 11 of 27, id: 20, sources: 1, size: 32x29, npix 586, brick X: 179,211, Y: 195,224, one pixel: 193 195
Blob 12 of 27, id: 17, sources: 1, size: 29x28, npix 552, brick X: 161,190, Y: 173,201, one pixel: 174 173
Blob 13 of 27, id: 4, sources: 1, size: 27x28, npix 481, brick X: 255,282, Y: 29,57, one pixel: 268 29
Blob 14 of 27, id: 7, sources: 1, size: 27x27, npix 461, brick X: 235,262, Y: 55,82, one pixel: 246 55
Blob 15 of 27, id: 5, sources: 1, size: 26x26, npix 426, brick X: 70,96, Y: 51,77, one pixel: 81 51
Blob 16 of 27, id: 18, sources: 1, size: 25x25, npix 380, brick X: 83,108, Y: 175,200, one pixel: 95 175
Blob 17 of 27, id: 2, sources: 1, size: 24x23, npix 349, brick X: 228,252, Y: 3,26, one pixel: 238 3
Blob 15 finished, total: Wall: 0.83 s, CPU: 0.82 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14708 MB
Blob 18 of 27, id: 0, sources: 1, size: 25x18, npix 319, brick X: 39,64, Y: 0,18, one pixel: 44 0
Blob 13 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146392 MB
Blob 19 of 27, id: 26, sources: 1, size: 22x20, npix 309, brick X: 261,283, Y: 263,283, one pixel: 270 263
Blob 11 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 963 MB, VmSize: 721 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14562 MB
Blob 20 of 27, id: 13, sources: 1, size: 20x24, npix 293, brick X: 259,279, Y: 115,139, one pixel: 267 115
Blob 14 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 962 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147204 MB
Blob 12 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145248 MB
Blob 21 of 27, id: 21, sources: 1, size: 22x22, npix 291, brick X: 126,148, Y: 211,233, one pixel: 136 211
Blob 22 of 27, id: 15, sources: 1, size: 23x21, npix 282, brick X: 59,82, Y: 128,149, one pixel: 70 128
Blob 17 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14708 MB
Blob 23 of 27, id: 19, sources: 1, size: 21x21, npix 250, brick X: 124,145, Y: 179,200, one pixel: 133 179
Blob 16 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144736 MB
Blob 24 of 27, id: 22, sources: 1, size: 21x20, npix 240, brick X: 6,27, Y: 212,232, one pixel: 15 212
Blob 7 finished, total: Wall: 1.22 s, CPU: 1.21 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145376 MB
Blob 25 of 27, id: 6, sources: 1, size: 20x19, npix 208, brick X: 173,193, Y: 54,73, one pixel: 182 54
Blob 8 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147052 MB
Blob 26 of 27, id: 25, sources: 1, size: 18x17, npix 162, brick X: 187,205, Y: 256,273, one pixel: 195 256
Blob 23 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144736 MB
Blob 27 of 27, id: 12, sources: 1, size: 17x17, npix 145, brick X: 15,32, Y: 103,120, one pixel: 23 103
Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147052 MB
Blob 26 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144736 MB
Blob 10 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.1519 MB
Blob 20 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 962 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147204 MB
Blob 9 finished, total: Wall: 1.75 s, CPU: 1.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144672 MB
Blob 19 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 963 MB, VmSize: 721 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14562 MB
Blob 24 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 959 MB, VmSize: 721 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145376 MB
Blob 27 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147052 MB
Blob 21 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147152 MB
Blob 22 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14708 MB
Blob 18 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146392 MB
Blob 6 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14676 MB
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 2.19 s, CPU: 2.18 s, VmPeak: 963 MB, VmSize: 721 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145452 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 2.79 s, CPU: 2.79 s, VmPeak: 960 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 186 MB, maxrss: 0.151328 MB
Blob 4 finished, total: Wall: 3.36 s, CPU: 3.35 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147188 MB
Measuring 3 iterative sources
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.10935, ee1=0.0563009, ee2=-0.543895
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 5.49 s, CPU: 5.49 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147712 MB
Blob 1 finished, total: Wall: 5.72 s, CPU: 5.70 s, VmPeak: 966 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147048 MB
Old catalog: 45
New catalog: 47
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/blobs-custom-036446m23097.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/metrics/cus/all-models-custom-036446m23097.fits
Stage fitblobs : Wall: 6.68 s, CPU: 0.85 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.258028 MB
Stage fitblobs finished: 2020-07-23T05:05:07.619975
Resources for stage fitblobs : 39.511 s worker CPU, 39.854 s worker Wall, Wall: 6.681 s, Cores in use: 6.04, Total efficiency (on 16 cores): 37.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-23T05:05:07.647042
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-resid.jpg
Stage coadds : Wall: 2.53 s, CPU: 1.34 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.258608 MB
Stage coadds finished: 2020-07-23T05:05:10.175985
Resources for stage coadds : 7.974 s worker CPU, 9.304 s worker Wall, Wall: 2.530 s, Cores in use: 3.68, Total efficiency (on 16 cores): 23.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-23T05:05:10.195969
Cut to 1 unWISE tiles
Reading WISE tile 0358m228 band 1
Reading WISE tile 0358m228 band 3
Reading WISE tile 0358m228 band 4
Reading WISE tile 0358m228 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 958 MB, VmSize: 798 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.1936 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 966 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.208396 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 797 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.210416 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/035/0358m228/unwise-0358m228-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 960 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208364 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/tmp-legacysurvey-custom-036446m23097-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.77 s, CPU: 0.89 s, VmPeak: 1034 MB, VmSize: 1024 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259312 MB
Stage wise_forced finished: 2020-07-23T05:05:12.963071
Resources for stage wise_forced : 3.174 s worker CPU, 5.179 s worker Wall, Wall: 2.769 s, Cores in use: 1.47, Total efficiency (on 16 cores): 9.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-23T05:05:12.982626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/coadd/cus/custom-036446m23097/legacysurvey-custom-036446m23097-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/tractor-i/cus/tractor-custom-036446m23097.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/tractor/cus/tractor-custom-036446m23097.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/tractor/cus/brick-custom-036446m23097.sha256sum
Stage writecat : Wall: 1.64 s, CPU: 0.88 s, VmPeak: 1156 MB, VmSize: 1028 MB, VmRSS: 255 MB, VmData: 280 MB, maxrss: 0.392164 MB
Stage writecat finished: 2020-07-23T05:05:14.618875
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.638 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/DR8-0364m230-782/DR8-0364m230-782-largegalaxy-writecat.p
All done: 69.596 s worker CPU, 279.180 s worker Wall, Wall: 39.777 s, Cores in use: 2.00, Total efficiency (on 16 cores): 12.5 %
Finished galaxy DR8-0364m230-782 in 0.694 minutes.