Started working on galaxy PGC1404515 at Sat Jun  6 11:29:40 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.663185 12.1452 --width 405 --height 405 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T11:29:41.731091
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.663185', '12.1452', '--width', '405', '--height', '405', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.663185 12.1452 --width 405 --height 405 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 313.663185 12.1452
Starting process 12345 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 12346 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057368 MB
Starting process 12347 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 12348 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 12349 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 12350 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 12351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 12352 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T11:29:43.265049
Keeping 5 CCDs:
   c4d_160813_030635_ooi_z_ls9.fits.fz c4d_160813_030635_ooi_z_ls9-N19 z exptime 82.0 propid 2014B-0404 seeing 1.05 MJD 57613.128 object DECaLS_5097_z
   c4d_170922_011844_ooi_g_ls9.fits.fz c4d_170922_011844_ooi_g_ls9-N14 g exptime 200.0 propid 2014B-0404 seeing 1.23 MJD 58018.055 object DECaLS_5096_g
   c4d_160813_030831_ooi_z_ls9.fits.fz c4d_160813_030831_ooi_z_ls9-N14 z exptime 89.0 propid 2014B-0404 seeing 1.03 MJD 57613.129 object DECaLS_5096_z
   c4d_170917_004518_ooi_r_ls9.fits.fz c4d_170917_004518_ooi_r_ls9-N14 r exptime 108.0 propid 2014B-0404 seeing 1.07 MJD 58013.031 object DECaLS_5096_r
   c4d_170521_103258_ooi_z_ls9.fits.fz c4d_170521_103258_ooi_z_ls9-N14 z exptime 100.0 propid 2014B-0404 seeing 0.88 MJD 57894.438 object DECaLS_5096_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030421_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030612_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T004518_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T011844_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951822a-z-20170521T103022_oi[N14,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 33.22 s, CPU: 2.48 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 169 MB, VmData: 202 MB, maxrss: 0.452024 MB
Stage tims finished: 2020-06-06T11:30:16.484542
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030421_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030612_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T004518_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951822a-z-20170521T103022_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T011844_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 2.760 s worker CPU, 120.995 s worker Wall, Wall: 33.221 s, Cores in use: 0.16, Total efficiency (on 8 cores): 2.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-06T11:30:16.498220
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04911.fits
Matched 0 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/reference-custom-313663p12145.fits
Stage refs : Wall: 16.58 s, CPU: 16.17 s, VmPeak: 1100 MB, VmSize: 1093 MB, VmRSS: 269 MB, VmData: 301 MB, maxrss: 0.452024 MB
Stage refs finished: 2020-06-06T11:30:33.080788
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.584 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T11:30:33.082664
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outlier-mask-custom-313663p12145.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-pre-custom-313663p12145.jpg
Image c4d_170521_103258_ooi_z_ls9-N14 z : masking 105 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outlier-mask-custom-313663p12145.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-post-custom-313663p12145.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-masked-pos-custom-313663p12145.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-masked-neg-custom-313663p12145.jpg
Stage outliers : Wall: 5.41 s, CPU: 5.14 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 286 MB, VmData: 314 MB, maxrss: 0.452024 MB
Stage outliers finished: 2020-06-06T11:30:38.497075
Resources for stage outliers : 0.302 s worker CPU, 0.384 s worker Wall, Wall: 5.416 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.6 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T11:30:38.499129
Stage halos : Wall: 8.29 s, CPU: 4.14 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 286 MB, VmData: 314 MB, maxrss: 0.452024 MB
Stage halos finished: 2020-06-06T11:30:46.786240
Resources for stage halos : 0.261 s worker CPU, 7.599 s worker Wall, Wall: 8.289 s, Cores in use: 0.53, Total efficiency (on 8 cores): 6.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T11:30:46.788495
PSF sigmas in coadd pixels: ['2.00']
Using average PSF sigma 1.9992308597703896
Gaussian PSF norm 0.14110165936828153 vs pixelized 0.11276508
average tim pixel scale / coadd scale: 1.001088266378226
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73']
Using average PSF sigma 1.7309529671133168
Gaussian PSF norm 0.16297080113292925 vs pixelized 0.12794074
average tim pixel scale / coadd scale: 1.001132255373878
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.71', '1.68', '1.42']
Using average PSF sigma 1.6039501657923134
Gaussian PSF norm 0.17587503514146277 vs pixelized 0.14017597
average tim pixel scale / coadd scale: 1.0011329551988088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.08 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 287 MB, VmData: 314 MB, maxrss: 0.452024 MB
Stage fit_on_coadds finished: 2020-06-06T11:30:46.910533
Resources for stage fit_on_coadds : 0.056 s worker CPU, 0.056 s worker Wall, Wall: 0.123 s, Cores in use: 1.12, Total efficiency (on 8 cores): 14.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T11:30:46.912819
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 94 potential peaks
Of 94 potential peaks: 41 in veto map, 10 cut by saddle test, 0 cut by aper test, 43 kept
SED z : 43 new peaks
Found 134952 potential peaks
Of 134952 potential peaks: 134951 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 132038 potential peaks
Of 132038 potential peaks: 132036 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 1804 potential peaks
Of 1804 potential peaks: 1803 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 1799 potential peaks
Of 1799 potential peaks: 1797 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 44 new sources
Median coadd sky for g : 0.0001975626
Median coadd sky for r : 0.00039697308
Median coadd sky for z : 0.0008295347
Stage srcs : Wall: 14.13 s, CPU: 7.06 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 289 MB, VmData: 316 MB, maxrss: 0.452024 MB
Stage srcs finished: 2020-06-06T11:31:01.045462
Resources for stage srcs : 14.114 s worker CPU, 14.115 s worker Wall, Wall: 14.134 s, Cores in use: 1.50, Total efficiency (on 8 cores): 18.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T11:31:01.062114
Blob 1 of 3, id: 0, sources: 77, size: 405x405, npix 155311, brick X: 0,405, Y: 0,405, one pixel: 0 0
Blob 2 of 3, id: 2, sources: 1, size: 18x27, npix 336, brick X: 0,18, Y: 316,343, one pixel: 4 316
Blob 3 of 3, id: 1, sources: 1, size: 23x22, npix 315, brick X: 2,25, Y: 293,315, one pixel: 11 293
Blob 3 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 948 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 176 MB, maxrss: 0.13924 MB
Blob 2 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 683 MB, VmSize: 683 MB, VmRSS: 118 MB, VmData: 163 MB, maxrss: 0.120604 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.60745, 12.07438), pm (28.4, 8.7), parallax 3.770 with NanoMaggies: g=8.18, r=7.41, z=7.07
Reset brightness to NanoMaggies: g=8.18, r=7.41, z=7.07
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65887, 12.14099), pm (3.3, 0.7), parallax 0.623 with NanoMaggies: g=12.2, r=11.2, z=10.9
Reset brightness to NanoMaggies: g=12.2, r=11.2, z=10.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.63514, 12.11532), pm (4.6, 5.1), parallax 0.886 with NanoMaggies: g=13.5, r=12.7, z=12.3
Reset brightness to NanoMaggies: g=13.5, r=12.7, z=12.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66223, 12.16646), pm (1.7, -2.6), parallax 0.595 with NanoMaggies: g=15.9, r=15.4, z=15.2
Reset brightness to NanoMaggies: g=15.9, r=15.4, z=15.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64614, 12.13407), pm (2.5, -0.3), parallax 0.487 with NanoMaggies: g=16.5, r=15.9, z=(flux -1.8e+03)
Reset brightness to NanoMaggies: g=16.5, r=15.9, z=15.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65181, 12.16042), pm (-9.2, -10.0), parallax 0.607 with NanoMaggies: g=16.8, r=16.3, z=16.3
Reset brightness to NanoMaggies: g=16.8, r=16.3, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64254, 12.14193), pm (-6.4, -7.7), parallax 1.053 with NanoMaggies: g=17.1, r=16.3, z=16
Reset brightness to NanoMaggies: g=17.1, r=16.3, z=16
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.945278, ee1=0.106206, ee2=0.0596722
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65366, 12.12673), pm (0.2, 1.9), parallax 0.303 with NanoMaggies: g=18.7, r=17.8, z=17.4
Reset brightness to NanoMaggies: g=18.7, r=17.8, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64799, 12.16018), pm (4.7, -5.9), parallax 0.651 with NanoMaggies: g=18.7, r=17.8, z=17.1
Reset brightness to NanoMaggies: g=18.7, r=17.8, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65755, 12.13033), pm (-2.3, -4.2), parallax -0.247 with NanoMaggies: g=18.9, r=18.3, z=18
Reset brightness to NanoMaggies: g=18.9, r=18.3, z=18.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64580, 12.16124), pm (3.4, -7.6), parallax -0.152 with NanoMaggies: g=19.6, r=18.7, z=-7.65
Reset brightness to NanoMaggies: g=19.6, r=18.7, z=18.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66393, 12.12879), pm (0.6, -16.9), parallax 0.392 with NanoMaggies: g=19.8, r=19, z=(flux -1.2e+03)
Reset brightness to NanoMaggies: g=19.8, r=19, z=18.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66259, 12.16104), pm (-2.2, -3.9), parallax -1.905 with NanoMaggies: g=20.4, r=19.7, z=(flux -197)
Reset brightness to NanoMaggies: g=20.4, r=19.7, z=19.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66455, 12.12817), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.1, r=19.9, z=(flux -2.56e+06)
Reset brightness to NanoMaggies: g=21.1, r=19.9, z=19.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65776, 12.14109), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21, r=20, z=(flux -152)
Reset brightness to NanoMaggies: g=21, r=20, z=19.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66626, 12.16006), pm (1.6, -2.5), parallax 0.630 with NanoMaggies: g=20.3, r=20, z=19.6
Reset brightness to NanoMaggies: g=20.3, r=20, z=20
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64666, 12.15836), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.9, r=20.7, z=(flux -11.5)
Reset brightness to NanoMaggies: g=21.9, r=20.7, z=20.1
Measuring 9 iterative sources
Blob 1 finished, total: Wall: 23.59 s, CPU: 23.59 s, VmPeak: 948 MB, VmSize: 732 MB, VmRSS: 164 MB, VmData: 195 MB, maxrss: 0.223888 MB
Old catalog: 85
New catalog: 86
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/blobs-custom-313663p12145.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/all-models-custom-313663p12145.fits
Stage fitblobs : Wall: 31.20 s, CPU: 7.51 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 295 MB, VmData: 322 MB, maxrss: 0.452024 MB
Stage fitblobs finished: 2020-06-06T11:31:32.264614
Resources for stage fitblobs : 24.893 s worker CPU, 24.909 s worker Wall, Wall: 31.204 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T11:31:32.266999
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-resid.jpg
Stage coadds : Wall: 12.34 s, CPU: 4.13 s, VmPeak: 1113 MB, VmSize: 1113 MB, VmRSS: 315 MB, VmData: 341 MB, maxrss: 0.452024 MB
Stage coadds finished: 2020-06-06T11:31:44.604513
Resources for stage coadds : 20.436 s worker CPU, 20.900 s worker Wall, Wall: 12.339 s, Cores in use: 1.99, Total efficiency (on 8 cores): 24.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T11:31:44.606629
Cut to 1 unWISE tiles
Reading WISE tile 3136p121 band 1
Reading WISE tile 3136p121 band 2
Reading WISE tile 3136p121 band 3
Reading WISE tile 3136p121 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.60 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 146 MB, VmData: 186 MB, maxrss: 0.207916 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.37 s, CPU: 1.00 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 146 MB, VmData: 189 MB, maxrss: 0.183424 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.43 s, VmPeak: 987 MB, VmSize: 987 MB, VmRSS: 135 MB, VmData: 181 MB, maxrss: 0.195608 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.29 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 165 MB, VmData: 200 MB, maxrss: 0.223888 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.44 s, CPU: 1.74 s, VmPeak: 1113 MB, VmSize: 1113 MB, VmRSS: 316 MB, VmData: 341 MB, maxrss: 0.452024 MB
Stage wise_forced finished: 2020-06-06T11:31:49.047061
Resources for stage wise_forced : 5.510 s worker CPU, 8.651 s worker Wall, Wall: 4.442 s, Cores in use: 1.63, Total efficiency (on 8 cores): 20.4 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T11:31:49.049119
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/tractor-i/cus/tractor-custom-313663p12145.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/tractor/cus/tractor-custom-313663p12145.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/tractor/cus/brick-custom-313663p12145.sha256sum
Stage writecat : Wall: 4.40 s, CPU: 4.24 s, VmPeak: 1246 MB, VmSize: 1117 MB, VmRSS: 317 MB, VmData: 341 MB, maxrss: 0.45602 MB
Stage writecat finished: 2020-06-06T11:31:53.450511
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.403 s, Cores in use: 0.96, Total efficiency (on 8 cores): 12.0 %
Stage writecat finished
All done: 68.335 s worker CPU, 197.611 s worker Wall, Wall: 130.190 s, Cores in use: 0.93, Total efficiency (on 8 cores): 11.6 %
Finished galaxy PGC1404515 in 2.233 minutes.
Started working on galaxy PGC1404515 at Sat Jul 18 21:13:54 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.663185 12.1452 --width 405 --height 405 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T21:13:54.883194
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.663185', '12.1452', '--width', '405', '--height', '405', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.663185 12.1452 --width 405 --height 405 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 313.663185 12.1452
Starting process 11664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05884 MB
Starting process 11665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059 MB
Starting process 11666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059008 MB
Starting process 11667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 11668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05884 MB
Starting process 11669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05884 MB
Starting process 11670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059008 MB
Starting process 11671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058948 MB
Starting process 11672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058948 MB
Starting process 11673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058948 MB
Starting process 11674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058948 MB
Starting process 11675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059016 MB
Starting process 11676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059016 MB
Starting process 11677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB
Starting process 11678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB
Starting process 11679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB
Starting process 11680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB
Starting process 11681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB
Starting process 11682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 11683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 11684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 11685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 11686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 11687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 11688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 11689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 11690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 11691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 11692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 11693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 11694 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 11695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T21:13:55.465024
Keeping 5 CCDs:
   c4d_160813_030635_ooi_z_ls9.fits.fz c4d_160813_030635_ooi_z_ls9-N19 z exptime 82.0 propid 2014B-0404 seeing 1.05 MJD 57613.128 object DECaLS_5097_z
   c4d_170922_011844_ooi_g_ls9.fits.fz c4d_170922_011844_ooi_g_ls9-N14 g exptime 200.0 propid 2014B-0404 seeing 1.23 MJD 58018.055 object DECaLS_5096_g
   c4d_160813_030831_ooi_z_ls9.fits.fz c4d_160813_030831_ooi_z_ls9-N14 z exptime 89.0 propid 2014B-0404 seeing 1.03 MJD 57613.129 object DECaLS_5096_z
   c4d_170917_004518_ooi_r_ls9.fits.fz c4d_170917_004518_ooi_r_ls9-N14 r exptime 108.0 propid 2014B-0404 seeing 1.07 MJD 58013.031 object DECaLS_5096_r
   c4d_170521_103258_ooi_z_ls9.fits.fz c4d_170521_103258_ooi_z_ls9-N14 z exptime 100.0 propid 2014B-0404 seeing 0.88 MJD 57894.438 object DECaLS_5096_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030612_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T004518_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T011844_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030421_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951822a-z-20170521T103022_oi[N14,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 10.09 s, CPU: 0.92 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 170 MB, VmData: 205 MB, maxrss: 0.210784 MB
Stage tims finished: 2020-07-18T21:14:05.555443
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030612_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T004518_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T011844_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954922e-z-20160813T030421_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951822a-z-20170521T103022_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 2.619 s worker CPU, 42.610 s worker Wall, Wall: 10.093 s, Cores in use: 0.35, Total efficiency (on 32 cores): 1.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T21:14:05.651409
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04911.fits
Matched 0 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/reference-custom-313663p12145.fits
Stage refs : Wall: 8.71 s, CPU: 8.34 s, VmPeak: 1102 MB, VmSize: 1097 MB, VmRSS: 272 MB, VmData: 304 MB, maxrss: 0.278592 MB
Stage refs finished: 2020-07-18T21:14:14.364106
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 8.715 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T21:14:14.379916
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outlier-mask-custom-313663p12145.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-pre-custom-313663p12145.jpg
Image c4d_170521_103258_ooi_z_ls9-N14 z : masking 105 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outlier-mask-custom-313663p12145.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-post-custom-313663p12145.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-masked-pos-custom-313663p12145.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/outliers-masked-neg-custom-313663p12145.jpg
Stage outliers : Wall: 0.98 s, CPU: 0.66 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 287 MB, VmData: 316 MB, maxrss: 0.294064 MB
Stage outliers finished: 2020-07-18T21:14:15.364771
Resources for stage outliers : 0.366 s worker CPU, 0.550 s worker Wall, Wall: 0.988 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T21:14:15.382793
Stage halos : Wall: 0.54 s, CPU: 0.35 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 287 MB, VmData: 316 MB, maxrss: 0.294332 MB
Stage halos finished: 2020-07-18T21:14:15.922207
Resources for stage halos : 0.294 s worker CPU, 0.412 s worker Wall, Wall: 0.542 s, Cores in use: 1.20, Total efficiency (on 32 cores): 3.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T21:14:17.190023
PSF sigmas in coadd pixels: ['2.00']
Using average PSF sigma 1.9992308597703896
Gaussian PSF norm 0.14110165936828153 vs pixelized 0.11276508
average tim pixel scale / coadd scale: 1.001088266378226
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73']
Using average PSF sigma 1.7309529671133168
Gaussian PSF norm 0.16297080113292925 vs pixelized 0.12794074
average tim pixel scale / coadd scale: 1.001132255373878
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.71', '1.68', '1.42']
Using average PSF sigma 1.6039501657923134
Gaussian PSF norm 0.17587503514146277 vs pixelized 0.14017597
average tim pixel scale / coadd scale: 1.0011329551988088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.62 s, CPU: 0.09 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 289 MB, VmData: 316 MB, maxrss: 0.295804 MB
Stage fit_on_coadds finished: 2020-07-18T21:14:17.806259
Resources for stage fit_on_coadds : 0.057 s worker CPU, 0.081 s worker Wall, Wall: 0.618 s, Cores in use: 0.24, Total efficiency (on 32 cores): 0.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T21:14:17.821545
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 179 potential peaks
Of 179 potential peaks: 127 in veto map, 10 cut by saddle test, 0 cut by aper test, 42 kept
SED z : 42 new peaks
Found 134952 potential peaks
Of 134952 potential peaks: 134951 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 132038 potential peaks
Of 132038 potential peaks: 132036 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 1885 potential peaks
Of 1885 potential peaks: 1884 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 1880 potential peaks
Of 1880 potential peaks: 1878 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 43 new sources
Median coadd sky for g : 0.0001975626
Median coadd sky for r : 0.00039697308
Median coadd sky for z : 0.0008295347
Stage srcs : Wall: 9.39 s, CPU: 2.40 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 293 MB, VmData: 320 MB, maxrss: 0.29974 MB
Stage srcs finished: 2020-07-18T21:14:27.207388
Resources for stage srcs : 13.542 s worker CPU, 13.588 s worker Wall, Wall: 9.388 s, Cores in use: 1.70, Total efficiency (on 32 cores): 5.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T21:14:27.640230
Blob 1 of 3, id: 0, sources: 76, size: 405x405, npix 155311, brick X: 0,405, Y: 0,405, one pixel: 0 0
Blob 2 of 3, id: 2, sources: 1, size: 18x27, npix 336, brick X: 0,18, Y: 316,343, one pixel: 4 316
Blob 3 of 3, id: 1, sources: 1, size: 23x22, npix 315, brick X: 2,25, Y: 293,315, one pixel: 11 293
Blob 3 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091728 MB
Blob 2 finished, total: Wall: 0.76 s, CPU: 0.74 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090176 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.60745, 12.07438), pm (28.4, 8.7), parallax 3.770 with NanoMaggies: g=8.18, r=7.41, z=7.07
Reset brightness to NanoMaggies: g=8.18, r=7.41, z=7.07
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.63514, 12.11532), pm (4.6, 5.1), parallax 0.886 with NanoMaggies: g=13.5, r=12.7, z=12.3
Reset brightness to NanoMaggies: g=13.5, r=12.7, z=12.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66223, 12.16646), pm (1.7, -2.6), parallax 0.595 with NanoMaggies: g=15.9, r=15.4, z=15.2
Reset brightness to NanoMaggies: g=15.9, r=15.4, z=15.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64614, 12.13407), pm (2.5, -0.3), parallax 0.487 with NanoMaggies: g=16.5, r=15.9, z=(flux -1.8e+03)
Reset brightness to NanoMaggies: g=16.5, r=15.9, z=15.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65181, 12.16042), pm (-9.2, -10.0), parallax 0.607 with NanoMaggies: g=16.8, r=16.3, z=16.3
Reset brightness to NanoMaggies: g=16.8, r=16.3, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64254, 12.14193), pm (-6.4, -7.7), parallax 1.053 with NanoMaggies: g=17.1, r=16.3, z=16
Reset brightness to NanoMaggies: g=17.1, r=16.3, z=16
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.945278, ee1=0.106206, ee2=0.0596723
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65366, 12.12673), pm (0.2, 1.9), parallax 0.303 with NanoMaggies: g=18.7, r=17.8, z=17.4
Reset brightness to NanoMaggies: g=18.7, r=17.8, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64799, 12.16018), pm (4.7, -5.9), parallax 0.651 with NanoMaggies: g=18.7, r=17.8, z=17.1
Reset brightness to NanoMaggies: g=18.7, r=17.8, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65755, 12.13033), pm (-2.3, -4.2), parallax -0.247 with NanoMaggies: g=18.9, r=18.3, z=19.2
Reset brightness to NanoMaggies: g=18.9, r=18.3, z=18.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64580, 12.16124), pm (3.4, -7.6), parallax -0.152 with NanoMaggies: g=19.6, r=18.7, z=-7.65
Reset brightness to NanoMaggies: g=19.6, r=18.7, z=18.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66393, 12.12879), pm (0.6, -16.9), parallax 0.392 with NanoMaggies: g=19.8, r=19, z=(flux -1.2e+03)
Reset brightness to NanoMaggies: g=19.8, r=19, z=18.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66259, 12.16104), pm (-2.2, -3.9), parallax -1.905 with NanoMaggies: g=20.4, r=19.7, z=(flux -197)
Reset brightness to NanoMaggies: g=20.4, r=19.7, z=19.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66455, 12.12817), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.1, r=19.9, z=(flux -2.56e+06)
Reset brightness to NanoMaggies: g=21.1, r=19.9, z=19.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.65776, 12.14109), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21, r=20, z=(flux -152)
Reset brightness to NanoMaggies: g=21, r=20, z=19.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.66626, 12.16006), pm (1.6, -2.5), parallax 0.630 with NanoMaggies: g=20.3, r=20, z=19.6
Reset brightness to NanoMaggies: g=20.3, r=20, z=20
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.64666, 12.15836), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.9, r=20.7, z=(flux -11.5)
Reset brightness to NanoMaggies: g=21.9, r=20.7, z=20.1
Measuring 9 iterative sources
Blob 1 finished, total: Wall: 22.76 s, CPU: 22.75 s, VmPeak: 764 MB, VmSize: 707 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.205368 MB
Old catalog: 84
New catalog: 85
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/blobs-custom-313663p12145.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/metrics/cus/all-models-custom-313663p12145.fits
Stage fitblobs : Wall: 24.92 s, CPU: 0.59 s, VmPeak: 1106 MB, VmSize: 1106 MB, VmRSS: 299 MB, VmData: 325 MB, maxrss: 0.305668 MB
Stage fitblobs finished: 2020-07-18T21:14:52.562352
Resources for stage fitblobs : 24.033 s worker CPU, 24.083 s worker Wall, Wall: 24.925 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T21:14:52.584956
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-resid.jpg
Stage coadds : Wall: 13.82 s, CPU: 0.99 s, VmPeak: 1116 MB, VmSize: 1116 MB, VmRSS: 316 MB, VmData: 342 MB, maxrss: 0.323216 MB
Stage coadds finished: 2020-07-18T21:15:06.407433
Resources for stage coadds : 61.254 s worker CPU, 73.465 s worker Wall, Wall: 13.825 s, Cores in use: 4.50, Total efficiency (on 32 cores): 14.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T21:15:06.429935
Cut to 1 unWISE tiles
Reading WISE tile 3136p121 band 1
Reading WISE tile 3136p121 band 2
Reading WISE tile 3136p121 band 3
Reading WISE tile 3136p121 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.22 s, CPU: 0.66 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 144 MB, VmData: 189 MB, maxrss: 0.187404 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.47 s, VmPeak: 989 MB, VmSize: 989 MB, VmRSS: 135 MB, VmData: 182 MB, maxrss: 0.19342 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.28 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 142 MB, VmData: 186 MB, maxrss: 0.20288 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136p121/unwise-3136p121-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.28 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 140 MB, VmData: 188 MB, maxrss: 0.201452 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/tmp-legacysurvey-custom-313663p12145-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.55 s, CPU: 0.81 s, VmPeak: 1116 MB, VmSize: 1116 MB, VmRSS: 316 MB, VmData: 342 MB, maxrss: 0.323728 MB
Stage wise_forced finished: 2020-07-18T21:15:08.979668
Resources for stage wise_forced : 5.082 s worker CPU, 4.827 s worker Wall, Wall: 2.552 s, Cores in use: 2.31, Total efficiency (on 32 cores): 7.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T21:15:09.003139
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/coadd/cus/custom-313663p12145/legacysurvey-custom-313663p12145-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/tractor-i/cus/tractor-custom-313663p12145.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/tractor/cus/tractor-custom-313663p12145.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/tractor/cus/brick-custom-313663p12145.sha256sum
Stage writecat : Wall: 0.81 s, CPU: 0.70 s, VmPeak: 1248 MB, VmSize: 1120 MB, VmRSS: 318 MB, VmData: 342 MB, maxrss: 0.456536 MB
Stage writecat finished: 2020-07-18T21:15:09.814339
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.813 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1404515/PGC1404515-largegalaxy-writecat.p
All done: 107.253 s worker CPU, 159.622 s worker Wall, Wall: 74.380 s, Cores in use: 1.66, Total efficiency (on 32 cores): 5.2 %
Finished galaxy PGC1404515 in 1.277 minutes.