Started working on galaxy PGC2369956 at Mon Jun 15 07:52:40 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.886167 50.335694399999994 --width 295 --height 295 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-15T07:52:41.555603
legacypipe git version: DR9.5.2-29-gb5a6d7b1
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.886167', '50.335694399999994', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.886167 50.335694399999994 --width 295 --height 295 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.886167 50.335694399999994
Starting process 37941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 37944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 37946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 37948 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB
Starting process 37950 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 37952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Starting process 37956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Starting process 37957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-15T07:52:42.495863
Keeping 3 CCDs:
   k4m_170221_022911_ooi_zd_ls9.fits.fz k4m_170221_022911_ooi_zd_ls9-CCD2 z exptime 86.103 propid 2016A-0453 seeing 0.85 MJD 57805.104 object MzLS_650123_z
   ksb_171127_061427_ooi_r_ls9.fits.fz ksb_171127_061427_ooi_r_ls9-CCD3 r exptime 250.0 propid BASS seeing 1.12 MJD 58084.260 object 63241
   ksb_151113_121207_ooi_g_ls9.fits.fz ksb_151113_121207_ooi_g_ls9-CCD3 g exptime 120.3 propid 2015A-0801 seeing 1.17 MJD 57339.508 object 63241
mosaic get_fwhm: self.fwhm = 3.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2169 2469 and amp range 2048 4095 and image y 3479 3776 and amp range 2040 4078
Range in image: x 0 301 , y 0 298 (with image size 301 x 298)
dzp -0.032976374 -> scaling image by 0.9700842429001929
Stage tims : Wall: 3.85 s, CPU: 1.14 s, VmPeak: 939 MB, VmSize: 939 MB, VmRSS: 166 MB, VmData: 200 MB, maxrss: 0.246096 MB
Stage tims finished: 2020-06-15T07:52:46.349165
Faked up EXPNUM 73390123
Faked up EXPNUM 73390123
Faked up EXPNUM 73390123
Faked up EXPNUM 80850104
Faked up EXPNUM 80850104
Faked up EXPNUM 80850104
90prime get_fwhm: self.fwhm = 2.47
Resources for stage tims : 0.995 s worker CPU, 4.210 s worker Wall, Wall: 3.855 s, Cores in use: 0.55, Total efficiency (on 8 cores): 6.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-15T07:52:46.367253
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01432.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01326.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01327.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/reference-custom-093886p50335.fits
Stage refs : Wall: 6.28 s, CPU: 5.68 s, VmPeak: 1015 MB, VmSize: 1009 MB, VmRSS: 238 MB, VmData: 270 MB, maxrss: 0.246096 MB
Stage refs finished: 2020-06-15T07:52:52.646641
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.281 s, Cores in use: 0.90, Total efficiency (on 8 cores): 11.3 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-06-15T07:52:52.663633
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outlier-mask-custom-093886p50335.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-pre-custom-093886p50335.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outlier-mask-custom-093886p50335.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-post-custom-093886p50335.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-masked-pos-custom-093886p50335.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-masked-neg-custom-093886p50335.jpg
Stage outliers : Wall: 0.71 s, CPU: 0.44 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 248 MB, VmData: 277 MB, maxrss: 0.254064 MB
Stage outliers finished: 2020-06-15T07:52:53.370391
Resources for stage outliers : 0.085 s worker CPU, 0.190 s worker Wall, Wall: 0.708 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-06-15T07:52:53.383387
Stage halos : Wall: 0.50 s, CPU: 0.50 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 248 MB, VmData: 277 MB, maxrss: 0.254368 MB
Stage halos finished: 2020-06-15T07:52:53.887813
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.506 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-15T07:52:53.905188
PSF sigmas in coadd pixels: ['1.39']
Using average PSF sigma 1.3871421545172926
Gaussian PSF norm 0.20336401057038272 vs pixelized 0.17123358
average tim pixel scale / coadd scale: 0.9908158361435448
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.06 s, CPU: 0.03 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.25594 MB
Stage fit_on_coadds finished: 2020-06-15T07:52:53.964860
Resources for stage fit_on_coadds : 0.013 s worker CPU, 0.013 s worker Wall, Wall: 0.061 s, Cores in use: 0.69, Total efficiency (on 8 cores): 8.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-06-15T07:52:53.981141
SED-matched filters: [('z', array([1.]))]
Found 53 potential peaks
Of 53 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 22 kept
SED z : 22 new peaks
Adding 22 new sources
Median coadd sky for z : 0.00053471833
Stage srcs : Wall: 0.60 s, CPU: 0.54 s, VmPeak: 1019 MB, VmSize: 1019 MB, VmRSS: 250 MB, VmData: 277 MB, maxrss: 0.256296 MB
Stage srcs finished: 2020-06-15T07:52:54.582219
Resources for stage srcs : 0.034 s worker CPU, 0.034 s worker Wall, Wall: 0.602 s, Cores in use: 0.96, Total efficiency (on 8 cores): 12.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-15T07:52:54.598761
Blob 1 of 20, id: 6, sources: 5, size: 119x115, npix 8061, brick X: 85,204, Y: 84,199, one pixel: 94 84
Blob 2 of 20, id: 13, sources: 5, size: 60x77, npix 1749, brick X: 41,101, Y: 193,270, one pixel: 50 193
Blob 3 of 20, id: 9, sources: 1, size: 55x51, npix 1607, brick X: 37,92, Y: 147,198, one pixel: 71 147
Blob 4 of 20, id: 3, sources: 3, size: 42x53, npix 1091, brick X: 174,216, Y: 40,93, one pixel: 201 40
Blob 5 of 20, id: 5, sources: 1, size: 34x32, npix 763, brick X: 21,55, Y: 76,108, one pixel: 34 76
Blob 6 of 20, id: 7, sources: 2, size: 43x28, npix 728, brick X: 209,252, Y: 98,126, one pixel: 221 98
Blob 7 of 20, id: 19, sources: 1, size: 42x22, npix 623, brick X: 191,233, Y: 273,295, one pixel: 207 273
Blob 8 of 20, id: 14, sources: 2, size: 31x36, npix 564, brick X: 199,230, Y: 204,240, one pixel: 207 204
Blob 9 of 20, id: 1, sources: 1, size: 25x30, npix 530, brick X: 0,25, Y: 1,31, one pixel: 8 1
Blob 10 of 20, id: 8, sources: 1, size: 28x27, npix 503, brick X: 0,28, Y: 113,140, one pixel: 11 113
Blob 11 of 20, id: 2, sources: 1, size: 26x26, npix 451, brick X: 155,181, Y: 17,43, one pixel: 166 17
Blob 5 finished, total: Wall: 0.07 s, CPU: 0.04 s, VmPeak: 655 MB, VmSize: 655 MB, VmRSS: 81 MB, VmData: 135 MB, maxrss: 0.082788 MB
Blob 12 of 20, id: 10, sources: 1, size: 27x24, npix 429, brick X: 203,230, Y: 156,180, one pixel: 215 156
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 0.31 s, CPU: 0.29 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.08972 MB
Blob 8 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.09538 MB
Blob 13 of 20, id: 16, sources: 1, size: 25x26, npix 394, brick X: 10,35, Y: 264,290, one pixel: 22 264
Blob 14 of 20, id: 0, sources: 1, size: 27x20, npix 354, brick X: 87,114, Y: 0,20, one pixel: 95 0
Blob 9 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 656 MB, VmSize: 656 MB, VmRSS: 86 MB, VmData: 135 MB, maxrss: 0.088116 MB
Blob 15 of 20, id: 11, sources: 3, size: 17x27, npix 334, brick X: 278,295, Y: 160,187, one pixel: 289 160
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095916 MB
Blob 16 of 20, id: 12, sources: 1, size: 23x23, npix 315, brick X: 213,236, Y: 184,207, one pixel: 223 184
Blob 11 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095496 MB
Blob 17 of 20, id: 17, sources: 1, size: 22x23, npix 306, brick X: 102,124, Y: 271,294, one pixel: 111 271
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141864 MB
Blob 18 of 20, id: 4, sources: 1, size: 22x22, npix 292, brick X: 103,125, Y: 57,79, one pixel: 113 57
Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.09008 MB
Blob 19 of 20, id: 15, sources: 1, size: 21x21, npix 270, brick X: 257,278, Y: 255,276, one pixel: 266 255
Blob 12 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 656 MB, VmSize: 656 MB, VmRSS: 87 MB, VmData: 135 MB, maxrss: 0.088852 MB
Blob 20 of 20, id: 18, sources: 1, size: 19x18, npix 198, brick X: 164,183, Y: 272,290, one pixel: 172 272
Blob 3 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 798 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.14112 MB
Blob 16 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.09008 MB
Blob 14 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095904 MB
Blob 13 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096352 MB
Blob 17 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 656 MB, VmSize: 656 MB, VmRSS: 87 MB, VmData: 135 MB, maxrss: 0.089312 MB
Blob 18 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 798 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.14112 MB
Blob 19 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.090148 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.86119, 50.33702), pm (0.5, -0.1), parallax 0.026 with NanoMaggies: z=15.7
Reset brightness to NanoMaggies: z=15.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.86910, 50.33745), pm (1.6, -10.3), parallax -0.557 with NanoMaggies: z=18.3
Reset brightness to NanoMaggies: z=18.4
Blob 15 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 795 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142332 MB
Blob 20 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096308 MB
Blob 2 finished, total: Wall: 1.42 s, CPU: 1.41 s, VmPeak: 681 MB, VmSize: 681 MB, VmRSS: 113 MB, VmData: 158 MB, maxrss: 0.116084 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.653622, ee1=0.0788224, ee2=0.00507757
Blob 1 finished, total: Wall: 1.65 s, CPU: 1.62 s, VmPeak: 660 MB, VmSize: 658 MB, VmRSS: 91 MB, VmData: 137 MB, maxrss: 0.095196 MB
Old catalog: 43
New catalog: 35
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/blobs-custom-093886p50335.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/all-models-custom-093886p50335.fits
Stage fitblobs : Wall: 2.32 s, CPU: 0.64 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.25668 MB
Stage fitblobs finished: 2020-06-15T07:52:56.921493
Resources for stage fitblobs : 8.355 s worker CPU, 8.594 s worker Wall, Wall: 2.324 s, Cores in use: 3.87, Total efficiency (on 8 cores): 48.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-06-15T07:52:56.938250
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-resid.jpg
Stage coadds : Wall: 1.54 s, CPU: 0.59 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.25668 MB
Stage coadds finished: 2020-06-15T07:52:58.477043
Resources for stage coadds : 4.266 s worker CPU, 4.855 s worker Wall, Wall: 1.540 s, Cores in use: 3.15, Total efficiency (on 8 cores): 39.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-06-15T07:52:58.496321
Cut to 1 unWISE tiles
Reading WISE tile 0929p499 band 1
Reading WISE tile 0929p499 band 2
Reading WISE tile 0929p499 band 3
Reading WISE tile 0929p499 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 793 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.183416 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 789 MB, VmSize: 787 MB, VmRSS: 139 MB, VmData: 168 MB, maxrss: 0.200856 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 789 MB, VmSize: 787 MB, VmRSS: 139 MB, VmData: 168 MB, maxrss: 0.200404 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 792 MB, VmSize: 790 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202472 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.11 s, CPU: 0.54 s, VmPeak: 1019 MB, VmSize: 991 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.25668 MB
Stage wise_forced finished: 2020-06-15T07:53:00.603206
Resources for stage wise_forced : 3.102 s worker CPU, 4.616 s worker Wall, Wall: 2.108 s, Cores in use: 1.73, Total efficiency (on 8 cores): 21.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-06-15T07:53:00.626293
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/tractor-i/cus/tractor-custom-093886p50335.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/tractor/cus/tractor-custom-093886p50335.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/tractor/cus/brick-custom-093886p50335.sha256sum
Stage writecat : Wall: 0.83 s, CPU: 0.60 s, VmPeak: 1123 MB, VmSize: 995 MB, VmRSS: 226 MB, VmData: 250 MB, maxrss: 0.36232 MB
Stage writecat finished: 2020-06-15T07:53:01.453205
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.828 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-writecat.p
All done: 16.851 s worker CPU, 22.515 s worker Wall, Wall: 18.990 s, Cores in use: 1.45, Total efficiency (on 8 cores): 18.2 %
Lost grz coverage and require_grz=True.
Finished galaxy PGC2369956 in 0.351 minutes.
Started working on galaxy PGC2369956 at Sat Jul 18 20:22:06 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.886167 50.335694399999994 --width 295 --height 295 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T20:22:07.243266
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.886167', '50.335694399999994', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.886167 50.335694399999994 --width 295 --height 295 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.886167 50.335694399999994
Starting process 64018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 64019 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 64020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 64021 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB
Starting process 64022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB
Starting process 64023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB
Starting process 64024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 64025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 64026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 64027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 64028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 64029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 64030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 64031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 64032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 64033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 64034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 64035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 64036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 64037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 64038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 64039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 64040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 64041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 64042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 64043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 64044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 64045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 64046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 64047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 64048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 64049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T20:22:07.919420
Keeping 3 CCDs:
   k4m_170221_022911_ooi_zd_ls9.fits.fz k4m_170221_022911_ooi_zd_ls9-CCD2 z exptime 86.103 propid 2016A-0453 seeing 0.85 MJD 57805.104 object MzLS_650123_z
   ksb_171127_061427_ooi_r_ls9.fits.fz ksb_171127_061427_ooi_r_ls9-CCD3 r exptime 250.0 propid BASS seeing 1.12 MJD 58084.260 object 63241
   ksb_151113_121207_ooi_g_ls9.fits.fz ksb_151113_121207_ooi_g_ls9-CCD3 g exptime 120.3 propid 2015A-0801 seeing 1.17 MJD 57339.508 object 63241
mosaic get_fwhm: self.fwhm = 3.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2169 2469 and amp range 2048 4095 and image y 3479 3776 and amp range 2040 4078
Range in image: x 0 301 , y 0 298 (with image size 301 x 298)
dzp -0.032976374 -> scaling image by 0.9700842429001929
Stage tims : Wall: 2.17 s, CPU: 0.90 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 168 MB, VmData: 201 MB, maxrss: 0.176212 MB
Stage tims finished: 2020-07-18T20:22:10.084772
Faked up EXPNUM 73390123
Faked up EXPNUM 73390123
Faked up EXPNUM 73390123
Resources for stage tims : 1.001 s worker CPU, 2.427 s worker Wall, Wall: 2.168 s, Cores in use: 0.88, Total efficiency (on 32 cores): 2.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-tims.p
Running stage refs
Faked up EXPNUM 80850104
Faked up EXPNUM 80850104
Faked up EXPNUM 80850104
90prime get_fwhm: self.fwhm = 2.47
Running stage refs at 2020-07-18T20:22:10.258991
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01432.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01326.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01327.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/reference-custom-093886p50335.fits
Stage refs : Wall: 5.96 s, CPU: 5.50 s, VmPeak: 1018 MB, VmSize: 1013 MB, VmRSS: 240 MB, VmData: 272 MB, maxrss: 0.246232 MB
Stage refs finished: 2020-07-18T20:22:16.216662
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.960 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T20:22:16.226114
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outlier-mask-custom-093886p50335.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-pre-custom-093886p50335.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outlier-mask-custom-093886p50335.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-post-custom-093886p50335.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-masked-pos-custom-093886p50335.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/outliers-masked-neg-custom-093886p50335.jpg
Stage outliers : Wall: 0.74 s, CPU: 0.57 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 250 MB, VmData: 279 MB, maxrss: 0.255972 MB
Stage outliers finished: 2020-07-18T20:22:16.968377
Resources for stage outliers : 0.088 s worker CPU, 0.103 s worker Wall, Wall: 0.744 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T20:22:16.977908
Stage halos : Wall: 0.42 s, CPU: 0.40 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 250 MB, VmData: 279 MB, maxrss: 0.256112 MB
Stage halos finished: 2020-07-18T20:22:17.396557
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.421 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-07-18T20:22:17.407063
PSF sigmas in coadd pixels: ['1.39']
Using average PSF sigma 1.3871421545172926
Gaussian PSF norm 0.20336401057038272 vs pixelized 0.17123358
average tim pixel scale / coadd scale: 0.9908158361435448
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.03 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 252 MB, VmData: 279 MB, maxrss: 0.257688 MB
Stage fit_on_coadds finished: 2020-07-18T20:22:17.558453
Resources for stage fit_on_coadds : 0.020 s worker CPU, 0.024 s worker Wall, Wall: 0.153 s, Cores in use: 0.32, Total efficiency (on 32 cores): 1.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T20:22:17.566920
SED-matched filters: [('z', array([1.]))]
Found 53 potential peaks
Of 53 potential peaks: 26 in veto map, 5 cut by saddle test, 0 cut by aper test, 22 kept
SED z : 22 new peaks
Adding 22 new sources
Median coadd sky for z : 0.00053471833
Stage srcs : Wall: 0.53 s, CPU: 0.47 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 252 MB, VmData: 279 MB, maxrss: 0.258228 MB
Stage srcs finished: 2020-07-18T20:22:18.098063
Resources for stage srcs : 0.042 s worker CPU, 0.047 s worker Wall, Wall: 0.534 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T20:22:19.321809
Blob 1 of 20, id: 6, sources: 5, size: 119x115, npix 8061, brick X: 85,204, Y: 84,199, one pixel: 94 84
Blob 2 of 20, id: 13, sources: 5, size: 60x77, npix 1749, brick X: 41,101, Y: 193,270, one pixel: 50 193
Blob 3 of 20, id: 9, sources: 1, size: 55x51, npix 1607, brick X: 37,92, Y: 147,198, one pixel: 71 147
Blob 4 of 20, id: 3, sources: 3, size: 42x53, npix 1091, brick X: 174,216, Y: 40,93, one pixel: 201 40
Blob 5 of 20, id: 5, sources: 1, size: 34x32, npix 763, brick X: 21,55, Y: 76,108, one pixel: 34 76
Blob 6 of 20, id: 7, sources: 2, size: 43x28, npix 728, brick X: 209,252, Y: 98,126, one pixel: 221 98
Blob 7 of 20, id: 19, sources: 1, size: 42x22, npix 623, brick X: 191,233, Y: 273,295, one pixel: 207 273
Blob 8 of 20, id: 14, sources: 2, size: 31x36, npix 564, brick X: 199,230, Y: 204,240, one pixel: 207 204
Blob 9 of 20, id: 1, sources: 1, size: 25x30, npix 530, brick X: 0,25, Y: 1,31, one pixel: 8 1
Blob 10 of 20, id: 8, sources: 1, size: 28x27, npix 503, brick X: 0,28, Y: 113,140, one pixel: 11 113
Blob 11 of 20, id: 2, sources: 1, size: 26x26, npix 451, brick X: 155,181, Y: 17,43, one pixel: 166 17
Blob 12 of 20, id: 10, sources: 1, size: 27x24, npix 429, brick X: 203,230, Y: 156,180, one pixel: 215 156
Blob 13 of 20, id: 16, sources: 1, size: 25x26, npix 394, brick X: 10,35, Y: 264,290, one pixel: 22 264
Blob 14 of 20, id: 0, sources: 1, size: 27x20, npix 354, brick X: 87,114, Y: 0,20, one pixel: 95 0
Blob 15 of 20, id: 11, sources: 3, size: 17x27, npix 334, brick X: 278,295, Y: 160,187, one pixel: 289 160
Blob 16 of 20, id: 12, sources: 1, size: 23x23, npix 315, brick X: 213,236, Y: 184,207, one pixel: 223 184
Blob 17 of 20, id: 17, sources: 1, size: 22x23, npix 306, brick X: 102,124, Y: 271,294, one pixel: 111 271
Blob 18 of 20, id: 4, sources: 1, size: 22x22, npix 292, brick X: 103,125, Y: 57,79, one pixel: 113 57
Blob 19 of 20, id: 15, sources: 1, size: 21x21, npix 270, brick X: 257,278, Y: 255,276, one pixel: 266 255
Blob 20 of 20, id: 18, sources: 1, size: 19x18, npix 198, brick X: 164,183, Y: 272,290, one pixel: 172 272
Blob 5 finished, total: Wall: 0.06 s, CPU: 0.04 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 83 MB, VmData: 136 MB, maxrss: 0.084584 MB
Blob 19 finished, total: Wall: 0.18 s, CPU: 0.16 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 87 MB, VmData: 136 MB, maxrss: 0.089336 MB
Blob 18 finished, total: Wall: 0.20 s, CPU: 0.17 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 87 MB, VmData: 136 MB, maxrss: 0.089496 MB
Blob 17 finished, total: Wall: 0.21 s, CPU: 0.18 s, VmPeak: 685 MB, VmSize: 685 MB, VmRSS: 114 MB, VmData: 160 MB, maxrss: 0.116832 MB
Blob 16 finished, total: Wall: 0.23 s, CPU: 0.20 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.089604 MB
Blob 11 finished, total: Wall: 0.25 s, CPU: 0.23 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 87 MB, VmData: 136 MB, maxrss: 0.089544 MB
Blob 7 finished, total: Wall: 0.27 s, CPU: 0.25 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091448 MB
Blob 20 finished, total: Wall: 0.28 s, CPU: 0.26 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 87 MB, VmData: 136 MB, maxrss: 0.08956 MB
Blob 13 finished, total: Wall: 0.30 s, CPU: 0.27 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 136 MB, maxrss: 0.090664 MB
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.32 s, CPU: 0.30 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.089784 MB
Blob 14 finished, total: Wall: 0.36 s, CPU: 0.34 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 136 MB, maxrss: 0.090688 MB
Blob 8 finished, total: Wall: 0.37 s, CPU: 0.35 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.089784 MB
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.41 s, CPU: 0.39 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.089688 MB
Blob 12 finished, total: Wall: 0.42 s, CPU: 0.39 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090624 MB
Blob 6 finished, total: Wall: 0.47 s, CPU: 0.45 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.09066 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.86119, 50.33702), pm (0.5, -0.1), parallax 0.026 with NanoMaggies: z=15.7
Reset brightness to NanoMaggies: z=15.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.86910, 50.33745), pm (1.6, -10.3), parallax -0.557 with NanoMaggies: z=18.3
Reset brightness to NanoMaggies: z=18.4
Blob 15 finished, total: Wall: 0.49 s, CPU: 0.45 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 136 MB, maxrss: 0.089812 MB
Blob 3 finished, total: Wall: 0.53 s, CPU: 0.51 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091984 MB
Blob 4 finished, total: Wall: 0.62 s, CPU: 0.60 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090056 MB
Blob 2 finished, total: Wall: 1.23 s, CPU: 1.21 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092528 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.653622, ee1=0.0788224, ee2=0.00507757
Blob 1 finished, total: Wall: 1.24 s, CPU: 1.22 s, VmPeak: 804 MB, VmSize: 717 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144584 MB
Old catalog: 43
New catalog: 35
T_dup:
tabledata object with 1 rows and 62 columns:
   a_g_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise_sig (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_n_good_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_n_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_params_solved (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   astrometric_sigma5d_max (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_weight_al (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ba (<class 'numpy.ndarray'>) shape (1,) dtype float32
   dec (<class 'numpy.ndarray'>) shape (1,) dtype float64
   dec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_g (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_r (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_z (<class 'numpy.ndarray'>) shape (1,) dtype float32
   donotfit (<class 'numpy.ndarray'>) shape (1,) dtype bool
   duplicated_source (<class 'numpy.ndarray'>) shape (1,) dtype bool
   e_bp_min_rp_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   freezeparams (<class 'numpy.ndarray'>) shape (1,) dtype bool
   hmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ibx (<class 'numpy.ndarray'>) shape (1,) dtype int32
   iby (<class 'numpy.ndarray'>) shape (1,) dtype int32
   in_bounds (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isbright (<class 'numpy.ndarray'>) shape (1,) dtype bool
   iscluster (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgaia (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgalaxy (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   islargegalaxy (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ismedium (<class 'numpy.ndarray'>) shape (1,) dtype bool
   istycho (<class 'numpy.ndarray'>) shape (1,) dtype bool
   jmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   keep_radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   kmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mask_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pa (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_bp_rp_excess_factor (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_rp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_variable_flag (<class 'numpy.ndarray'>) shape (1,) dtype bool
   pmdec (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmdec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pointsource (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ra (<class 'numpy.ndarray'>) shape (1,) dtype float64
   ra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius_pix (<class 'numpy.ndarray'>) shape (1,) dtype int64
   ref_cat (<class 'numpy.ndarray'>) shape (1,) dtype <U2
   ref_epoch (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ref_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   source_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   zguess (<class 'numpy.ndarray'>) shape (1,) dtype float32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/blobs-custom-093886p50335.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/metrics/cus/all-models-custom-093886p50335.fits
Stage fitblobs : Wall: 10.80 s, CPU: 0.57 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 253 MB, VmData: 279 MB, maxrss: 0.258792 MB
Stage fitblobs finished: 2020-07-18T20:22:30.117070
Resources for stage fitblobs : 8.237 s worker CPU, 8.759 s worker Wall, Wall: 10.799 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T20:22:30.139090
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-resid.jpg
Stage coadds : Wall: 2.03 s, CPU: 0.61 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 253 MB, VmData: 279 MB, maxrss: 0.259536 MB
Stage coadds finished: 2020-07-18T20:22:32.168933
Resources for stage coadds : 21.461 s worker CPU, 22.096 s worker Wall, Wall: 2.032 s, Cores in use: 10.86, Total efficiency (on 32 cores): 33.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T20:22:32.182437
Cut to 1 unWISE tiles
Reading WISE tile 0929p499 band 1
Reading WISE tile 0929p499 band 2
Reading WISE tile 0929p499 band 3
Reading WISE tile 0929p499 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 738 MB, VmSize: 738 MB, VmRSS: 121 MB, VmData: 153 MB, maxrss: 0.158212 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 729 MB, VmSize: 729 MB, VmRSS: 110 MB, VmData: 149 MB, maxrss: 0.167544 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 803 MB, VmSize: 803 MB, VmRSS: 185 MB, VmData: 219 MB, maxrss: 0.189412 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p499/unwise-0929p499-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 799 MB, VmSize: 799 MB, VmRSS: 180 MB, VmData: 215 MB, maxrss: 0.184568 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/tmp-legacysurvey-custom-093886p50335-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.20 s, CPU: 0.62 s, VmPeak: 1022 MB, VmSize: 1022 MB, VmRSS: 254 MB, VmData: 279 MB, maxrss: 0.260052 MB
Stage wise_forced finished: 2020-07-18T20:22:34.385003
Resources for stage wise_forced : 3.490 s worker CPU, 4.827 s worker Wall, Wall: 2.206 s, Cores in use: 1.87, Total efficiency (on 32 cores): 5.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T20:22:34.432659
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/coadd/cus/custom-093886p50335/legacysurvey-custom-093886p50335-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/tractor-i/cus/tractor-custom-093886p50335.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/tractor/cus/tractor-custom-093886p50335.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/tractor/cus/brick-custom-093886p50335.sha256sum
Stage writecat : Wall: 0.93 s, CPU: 0.69 s, VmPeak: 1155 MB, VmSize: 1027 MB, VmRSS: 256 MB, VmData: 279 MB, maxrss: 0.392832 MB
Stage writecat finished: 2020-07-18T20:22:35.359038
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.929 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2369956/PGC2369956-largegalaxy-writecat.p
All done: 34.344 s worker CPU, 38.290 s worker Wall, Wall: 27.461 s, Cores in use: 1.63, Total efficiency (on 32 cores): 5.1 %
Lost grz coverage and require_grz=True.
Finished galaxy PGC2369956 in 0.491 minutes.