Started working on galaxy PGC1902721 at Wed Aug 5 22:35:18 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.79356499999994 30.412001 --width 369 --height 369 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:35:19.051677 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.79356499999994', '30.412001', '--width', '369', '--height', '369', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.79356499999994 30.412001 --width 369 --height 369 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.79356499999994 30.412001 Starting process 20231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 20232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 20234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 20235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 20236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 20237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 20238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 20239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 20240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20247 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20248 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 20249 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 20250 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20251 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20252 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 20253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 20257 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20259 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 20260 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 20261 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 20262 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:35:19.623598 Keeping 13 CCDs: c4d_181103_005103_ooi_g_ls9-S11 g expnum 790198 exptime 185.0 propid 2014B-0404 seeing 1.57 MJD 58425.035 object DECaLS_8300_g decam/CP/V4.8.2a/CP20181102/c4d_181103_005103_ooi_g_ls9.fits.fz c4d_180917_022012_ooi_z_ls9-S11 z expnum 774632 exptime 120.0 propid 2014B-0404 seeing 1.14 MJD 58378.097 object DECaLS_8300_z decam/CP/V4.8.2a/CP20180916/c4d_180917_022012_ooi_z_ls9.fits.fz c4d_181003_014647_ooi_r_ls9-S11 r expnum 780156 exptime 115.0 propid 2014B-0404 seeing 1.46 MJD 58394.074 object DECaLS_8300_r decam/CP/V4.8.2a/CP20181002/c4d_181003_014647_ooi_r_ls9.fits.fz c4d_180922_021450_ooi_z_ls9-S10 z expnum 776305 exptime 250.0 propid 2014B-0404 seeing 1.43 MJD 58383.094 object DECaLS_24172_z decam/CP/V4.8.2a/CP20180921/c4d_180922_021450_ooi_z_ls9.fits.fz c4d_171024_020207_ooi_z_ls9-S10 z expnum 690197 exptime 110.0 propid 2014B-0404 seeing 0.96 MJD 58050.085 object DECaLS_24172_z decam/CP/V4.8.2a/CP20171023/c4d_171024_020207_ooi_z_ls9.fits.fz c4d_181002_020617_ooi_r_ls9-S10 r expnum 779850 exptime 69.0 propid 2014B-0404 seeing 1.21 MJD 58393.088 object DECaLS_24172_r decam/CP/V4.8.2a/CP20181001/c4d_181002_020617_ooi_r_ls9.fits.fz c4d_181003_025807_ooi_g_ls9-S10 g expnum 780177 exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58394.124 object DECaLS_24172_g decam/CP/V4.8.2a/CP20181002/c4d_181003_025807_ooi_g_ls9.fits.fz c4d_170728_065430_ooi_g_ls9-S9 g expnum 662893 exptime 200.0 propid 2014B-0404 seeing 1.30 MJD 57962.285 object DECaLS_40044_g decam/CP/V4.8.2a/CP20170727/c4d_170728_065430_ooi_g_ls9.fits.fz c4d_181017_010910_ooi_z_ls9-S9 z expnum 784206 exptime 250.0 propid 2014B-0404 seeing 1.45 MJD 58408.048 object DECaLS_40044_z decam/CP/V4.8.2a/CP20181016/c4d_181017_010910_ooi_z_ls9.fits.fz c4d_181102_010659_ooi_r_ls9-S9 r expnum 789879 exptime 70.0 propid 2014B-0404 seeing 1.29 MJD 58424.047 object DECaLS_40044_r decam/CP/V4.8.2a/CP20181101/c4d_181102_010659_ooi_r_ls9.fits.fz c4d_181103_005103_ooi_g_ls9-S17 g expnum 790198 exptime 185.0 propid 2014B-0404 seeing 1.58 MJD 58425.035 object DECaLS_8300_g decam/CP/V4.8.2a/CP20181102/c4d_181103_005103_ooi_g_ls9.fits.fz c4d_180917_022012_ooi_z_ls9-S17 z expnum 774632 exptime 120.0 propid 2014B-0404 seeing 1.05 MJD 58378.097 object DECaLS_8300_z decam/CP/V4.8.2a/CP20180916/c4d_180917_022012_ooi_z_ls9.fits.fz c4d_181003_014647_ooi_r_ls9-S17 r expnum 780156 exptime 115.0 propid 2014B-0404 seeing 1.46 MJD 58394.074 object DECaLS_8300_r decam/CP/V4.8.2a/CP20181002/c4d_181003_014647_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171024T020207_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181003T025807_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20180922T021450_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T010910_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T010659_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T065018_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T020617_oi[S10,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 20.13 s, CPU: 0.85 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.187228 MB Stage tims finished: 2020-08-05T22:35:39.755374 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T010659_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T020617_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171024T020207_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181003T025807_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T010910_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage tims : 7.075 s worker CPU, 128.186 s worker Wall, Wall: 20.134 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T065018_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage refs at 2020-08-05T22:35:42.441808 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03130.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/reference-custom-343793p30412.fits Stage refs : Wall: 7.58 s, CPU: 3.82 s, VmPeak: 1053 MB, VmSize: 1048 MB, VmRSS: 228 MB, VmData: 259 MB, maxrss: 0.232968 MB Stage refs finished: 2020-08-05T22:35:50.023769 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20180922T021450_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 7.584 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T22:35:50.252012 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/outlier-mask-custom-343793p30412.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/outliers-pre-custom-343793p30412.jpg Image c4d_181103_005103_ooi_g_ls9-S17 g : masking 188 positive outlier pixels and 0 negative outlier pixels Image c4d_181102_010659_ooi_r_ls9-S9 r : masking 370 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_020617_ooi_r_ls9-S10 r : masking 186 positive outlier pixels and 0 negative outlier pixels Image c4d_171024_020207_ooi_z_ls9-S10 z : masking 572 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_010910_ooi_z_ls9-S9 z : masking 338 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/outlier-mask-custom-343793p30412.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/outliers-post-custom-343793p30412.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/outliers-masked-pos-custom-343793p30412.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/outliers-masked-neg-custom-343793p30412.jpg Stage outliers : Wall: 1.29 s, CPU: 0.82 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 251 MB, VmData: 279 MB, maxrss: 0.257224 MB Stage outliers finished: 2020-08-05T22:35:51.545292 Resources for stage outliers : 1.396 s worker CPU, 1.733 s worker Wall, Wall: 1.295 s, Cores in use: 1.72, Total efficiency (on 32 cores): 5.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:35:51.833401 Stage halos : Wall: 0.42 s, CPU: 0.24 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 251 MB, VmData: 280 MB, maxrss: 0.257508 MB Stage halos finished: 2020-08-05T22:35:52.253298 Resources for stage halos : 1.125 s worker CPU, 1.803 s worker Wall, Wall: 0.422 s, Cores in use: 3.25, Total efficiency (on 32 cores): 10.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T22:35:52.478464 PSF sigmas in coadd pixels: ['2.56', '2.56', '2.11', '2.57'] Using average PSF sigma 2.449834173118967 Gaussian PSF norm 0.11514852509985758 vs pixelized 0.10280836 average tim pixel scale / coadd scale: 1.001345127121588 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.37', '1.97', '2.09', '2.38'] Using average PSF sigma 2.200028153621872 Gaussian PSF norm 0.128223264465716 vs pixelized 0.1097158 average tim pixel scale / coadd scale: 1.0013963393102763 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '2.32', '1.56', '2.35', '1.70'] Using average PSF sigma 1.9578791734304783 Gaussian PSF norm 0.14408181853204383 vs pixelized 0.10792052 average tim pixel scale / coadd scale: 1.001384332313963 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.25 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.258976 MB Stage fit_on_coadds finished: 2020-08-05T22:35:52.760972 Resources for stage fit_on_coadds : 0.306 s worker CPU, 0.306 s worker Wall, Wall: 0.285 s, Cores in use: 1.95, Total efficiency (on 32 cores): 6.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:35:52.883969 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 44 potential peaks Of 44 potential peaks: 9 in veto map, 3 cut by saddle test, 1 cut by aper test, 31 kept SED z : 31 new peaks Found 48 potential peaks Of 48 potential peaks: 43 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 43 potential peaks Of 43 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 67 potential peaks Of 67 potential peaks: 52 in veto map, 7 cut by saddle test, 0 cut by aper test, 8 kept SED Flat : 8 new peaks Found 69 potential peaks Of 69 potential peaks: 63 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 46 new sources Median coadd sky for g : 2.379225e-05 Median coadd sky for r : 0.00012752211 Median coadd sky for z : 0.0004529167 Stage srcs : Wall: 1.94 s, CPU: 1.84 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259496 MB Stage srcs finished: 2020-08-05T22:35:54.823919 Resources for stage srcs : 0.144 s worker CPU, 0.144 s worker Wall, Wall: 1.942 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:35:54.927037 Blob 1 of 28, id: 11, sources: 8, size: 192x103, npix 13444, brick X: 85,277, Y: 126,229, one pixel: 187 126 Blob 2 of 28, id: 12, sources: 3, size: 65x74, npix 2900, brick X: 24,89, Y: 135,209, one pixel: 52 135 Blob 3 of 28, id: 6, sources: 4, size: 72x58, npix 1787, brick X: 119,191, Y: 42,100, one pixel: 182 42 Blob 4 of 28, id: 21, sources: 3, size: 41x68, npix 1588, brick X: 21,62, Y: 272,340, one pixel: 41 272 Blob 5 of 28, id: 14, sources: 2, size: 43x59, npix 1419, brick X: 291,334, Y: 191,250, one pixel: 308 191 Blob 6 of 28, id: 24, sources: 1, size: 53x39, npix 1378, brick X: 86,139, Y: 312,351, one pixel: 109 312 Blob 7 of 28, id: 20, sources: 2, size: 37x53, npix 1279, brick X: 317,354, Y: 271,324, one pixel: 330 271 Blob 8 of 28, id: 16, sources: 3, size: 61x33, npix 1158, brick X: 0,61, Y: 226,259, one pixel: 26 226 Blob 9 of 28, id: 18, sources: 2, size: 34x50, npix 1092, brick X: 287,321, Y: 249,299, one pixel: 303 249 Blob 10 of 28, id: 27, sources: 3, size: 27x42, npix 914, brick X: 0,27, Y: 327,369, one pixel: 8 327 Blob 11 of 28, id: 2, sources: 1, size: 32x33, npix 706, brick X: 167,199, Y: 1,34, one pixel: 181 1 Blob 12 of 28, id: 17, sources: 2, size: 30x42, npix 630, brick X: 199,229, Y: 226,268, one pixel: 218 226 Blob 13 of 28, id: 1, sources: 2, size: 28x38, npix 625, brick X: 121,149, Y: 0,38, one pixel: 133 0 Blob 14 of 28, id: 22, sources: 1, size: 29x30, npix 597, brick X: 107,136, Y: 280,310, one pixel: 118 280 Blob 15 of 28, id: 8, sources: 1, size: 29x30, npix 577, brick X: 307,336, Y: 93,123, one pixel: 319 93 Blob 16 of 28, id: 0, sources: 1, size: 31x25, npix 562, brick X: 13,44, Y: 0,25, one pixel: 20 0 Blob 17 of 28, id: 4, sources: 1, size: 26x27, npix 444, brick X: 213,239, Y: 15,42, one pixel: 225 15 Blob 18 of 28, id: 13, sources: 1, size: 26x26, npix 428, brick X: 327,353, Y: 165,191, one pixel: 337 165 Blob 19 of 28, id: 26, sources: 1, size: 25x26, npix 418, brick X: 158,183, Y: 322,348, one pixel: 168 322 Blob 20 of 28, id: 5, sources: 1, size: 21x22, npix 281, brick X: 297,318, Y: 41,63, one pixel: 305 41 Blob 21 of 28, id: 7, sources: 1, size: 21x22, npix 262, brick X: 259,280, Y: 63,85, one pixel: 268 63 Blob 22 of 28, id: 23, sources: 1, size: 20x21, npix 257, brick X: 174,194, Y: 284,305, one pixel: 182 284 Blob 23 of 28, id: 9, sources: 1, size: 17x23, npix 252, brick X: 0,17, Y: 111,134, one pixel: 5 111 Blob 24 of 28, id: 3, sources: 1, size: 20x21, npix 249, brick X: 70,90, Y: 15,36, one pixel: 79 15 Blob 25 of 28, id: 19, sources: 1, size: 16x21, npix 210, brick X: 0,16, Y: 262,283, one pixel: 5 262 Blob 26 of 28, id: 10, sources: 1, size: 19x19, npix 208, brick X: 264,283, Y: 122,141, one pixel: 272 122 Blob 27 of 28, id: 15, sources: 1, size: 18x19, npix 180, brick X: 334,352, Y: 221,240, one pixel: 342 221 Blob 28 of 28, id: 25, sources: 1, size: 18x18, npix 180, brick X: 65,83, Y: 314,332, one pixel: 73 314 Blob 27 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 89 MB, VmData: 140 MB, maxrss: 0.091132 MB Blob 26 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145212 MB Blob 28 finished, total: Wall: 0.10 s, CPU: 0.08 s, VmPeak: 946 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144516 MB Blob 23 finished, total: Wall: 0.37 s, CPU: 0.35 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143008 MB Blob 18 finished, total: Wall: 0.38 s, CPU: 0.36 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095744 MB Blob 21 finished, total: Wall: 0.42 s, CPU: 0.40 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096544 MB Blob 22 finished, total: Wall: 0.52 s, CPU: 0.50 s, VmPeak: 940 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147084 MB Blob 14 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.11376 MB Blob 17 finished, total: Wall: 0.70 s, CPU: 0.68 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146248 MB Blob 24 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096696 MB Blob 20 finished, total: Wall: 0.85 s, CPU: 0.83 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 102 MB, VmData: 148 MB, maxrss: 0.104648 MB Blob 19 finished, total: Wall: 0.92 s, CPU: 0.90 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145804 MB Blob 12 finished, total: Wall: 0.97 s, CPU: 0.95 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095992 MB Blob 25 finished, total: Wall: 0.97 s, CPU: 0.94 s, VmPeak: 699 MB, VmSize: 699 MB, VmRSS: 117 MB, VmData: 170 MB, maxrss: 0.120092 MB Blob 15 finished, total: Wall: 1.03 s, CPU: 1.02 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096548 MB Blob 13 finished, total: Wall: 1.18 s, CPU: 1.17 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096012 MB Measuring 1 iterative sources Blob 11 finished, total: Wall: 1.24 s, CPU: 1.22 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14568 MB Blob 16 finished, total: Wall: 1.24 s, CPU: 1.22 s, VmPeak: 941 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.145952 MB Blob 9 finished, total: Wall: 1.41 s, CPU: 1.39 s, VmPeak: 699 MB, VmSize: 699 MB, VmRSS: 118 MB, VmData: 170 MB, maxrss: 0.12046 MB Blob 5 finished, total: Wall: 1.60 s, CPU: 1.59 s, VmPeak: 962 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145756 MB Blob 8 finished, total: Wall: 1.75 s, CPU: 1.74 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.117984 MB Measuring 1 iterative sources Measuring 3 iterative sources Blob 7 finished, total: Wall: 2.17 s, CPU: 2.15 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.097904 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.81597, 30.45307), pm (-10.8, -4.9), parallax 2.549 with NanoMaggies: g=12, r=11.7, z=11.6 Reset brightness to NanoMaggies: g=12, r=11.7, z=11.6 Blob 10 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146116 MB Blob 4 finished, total: Wall: 2.47 s, CPU: 2.46 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147192 MB Blob 6 finished, total: Wall: 2.51 s, CPU: 2.49 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097372 MB Blob 2 finished, total: Wall: 3.36 s, CPU: 3.35 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099284 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 3.76 s, CPU: 3.75 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098664 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.55275, ee1=-0.767834, ee2=0.152979 Measuring 4 iterative sources Blob 1 finished, total: Wall: 10.87 s, CPU: 10.86 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 126 MB, VmData: 166 MB, maxrss: 0.129496 MB Old catalog: 62 New catalog: 53 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/blobs-custom-343793p30412.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/metrics/cus/all-models-custom-343793p30412.fits Stage fitblobs : Wall: 12.25 s, CPU: 1.33 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 254 MB, VmData: 280 MB, maxrss: 0.259852 MB Stage fitblobs finished: 2020-08-05T22:36:07.180320 Resources for stage fitblobs : 44.517 s worker CPU, 46.187 s worker Wall, Wall: 12.256 s, Cores in use: 3.74, Total efficiency (on 32 cores): 11.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:36:07.248145 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/tmp-legacysurvey-custom-343793p30412-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/tmp-legacysurvey-custom-343793p30412-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/tmp-legacysurvey-custom-343793p30412-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/tmp-legacysurvey-custom-343793p30412-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-resid.jpg Stage coadds : Wall: 11.54 s, CPU: 1.72 s, VmPeak: 1061 MB, VmSize: 1061 MB, VmRSS: 257 MB, VmData: 285 MB, maxrss: 0.263264 MB Stage coadds finished: 2020-08-05T22:36:18.783545 Resources for stage coadds : 25.956 s worker CPU, 29.939 s worker Wall, Wall: 11.538 s, Cores in use: 2.40, Total efficiency (on 32 cores): 7.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T22:36:18.920766 Cut to 1 unWISE tiles Reading WISE tile 3443p302 band 1 Reading WISE tile 3443p302 band 2 Reading WISE tile 3443p302 band 3 Reading WISE tile 3443p302 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.20602 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 945 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.190264 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 795 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.20074 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 803 MB, VmSize: 801 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.207336 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/tmp-legacysurvey-custom-343793p30412-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/tmp-legacysurvey-custom-343793p30412-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.43 s, CPU: 0.90 s, VmPeak: 1061 MB, VmSize: 1061 MB, VmRSS: 258 MB, VmData: 285 MB, maxrss: 0.263776 MB Stage wise_forced finished: 2020-08-05T22:36:21.349364 Resources for stage wise_forced : 3.322 s worker CPU, 4.659 s worker Wall, Wall: 2.431 s, Cores in use: 1.74, Total efficiency (on 32 cores): 5.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:36:21.425877 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/coadd/cus/custom-343793p30412/legacysurvey-custom-343793p30412-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/tractor-i/cus/tractor-custom-343793p30412.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/tractor/cus/tractor-custom-343793p30412.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/tractor/cus/brick-custom-343793p30412.sha256sum Stage writecat : Wall: 0.73 s, CPU: 0.61 s, VmPeak: 1193 MB, VmSize: 1065 MB, VmRSS: 259 MB, VmData: 285 MB, maxrss: 0.396636 MB Stage writecat finished: 2020-08-05T22:36:22.158557 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.735 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1902721/PGC1902721-largegalaxy-writecat.p All done: 83.846 s worker CPU, 212.964 s worker Wall, Wall: 62.610 s, Cores in use: 1.54, Total efficiency (on 32 cores): 4.8 % Finished galaxy PGC1902721 in 1.076 minutes. Started working on galaxy PGC1902721 at Fri Aug 7 09:50:05 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.79301474452893 30.411901030585934 --width 369 --height 369 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:50:06.614087 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.79301474452893', '30.411901030585934', '--width', '369', '--height', '369', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.79301474452893 30.411901030585934 --width 369 --height 369 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.79301474452893 30.411901030585934 Starting process 49290 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 49291 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 49292 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 49293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 49294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 49295 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 49296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 49297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 49298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 49299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 49300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 49301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 49302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 49303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 49304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 49305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:50:07.022235 Keeping 13 CCDs: c4d_181103_005103_ooi_g_ls9-S11 g expnum 790198 exptime 185.0 propid 2014B-0404 seeing 1.57 MJD 58425.035 object DECaLS_8300_g decam/CP/V4.8.2a/CP20181102/c4d_181103_005103_ooi_g_ls9.fits.fz c4d_180917_022012_ooi_z_ls9-S11 z expnum 774632 exptime 120.0 propid 2014B-0404 seeing 1.14 MJD 58378.097 object DECaLS_8300_z decam/CP/V4.8.2a/CP20180916/c4d_180917_022012_ooi_z_ls9.fits.fz c4d_181003_014647_ooi_r_ls9-S11 r expnum 780156 exptime 115.0 propid 2014B-0404 seeing 1.46 MJD 58394.074 object DECaLS_8300_r decam/CP/V4.8.2a/CP20181002/c4d_181003_014647_ooi_r_ls9.fits.fz c4d_180922_021450_ooi_z_ls9-S10 z expnum 776305 exptime 250.0 propid 2014B-0404 seeing 1.43 MJD 58383.094 object DECaLS_24172_z decam/CP/V4.8.2a/CP20180921/c4d_180922_021450_ooi_z_ls9.fits.fz c4d_171024_020207_ooi_z_ls9-S10 z expnum 690197 exptime 110.0 propid 2014B-0404 seeing 0.96 MJD 58050.085 object DECaLS_24172_z decam/CP/V4.8.2a/CP20171023/c4d_171024_020207_ooi_z_ls9.fits.fz c4d_181002_020617_ooi_r_ls9-S10 r expnum 779850 exptime 69.0 propid 2014B-0404 seeing 1.21 MJD 58393.088 object DECaLS_24172_r decam/CP/V4.8.2a/CP20181001/c4d_181002_020617_ooi_r_ls9.fits.fz c4d_181003_025807_ooi_g_ls9-S10 g expnum 780177 exptime 200.0 propid 2014B-0404 seeing 1.58 MJD 58394.124 object DECaLS_24172_g decam/CP/V4.8.2a/CP20181002/c4d_181003_025807_ooi_g_ls9.fits.fz c4d_170728_065430_ooi_g_ls9-S9 g expnum 662893 exptime 200.0 propid 2014B-0404 seeing 1.30 MJD 57962.285 object DECaLS_40044_g decam/CP/V4.8.2a/CP20170727/c4d_170728_065430_ooi_g_ls9.fits.fz c4d_181017_010910_ooi_z_ls9-S9 z expnum 784206 exptime 250.0 propid 2014B-0404 seeing 1.45 MJD 58408.048 object DECaLS_40044_z decam/CP/V4.8.2a/CP20181016/c4d_181017_010910_ooi_z_ls9.fits.fz c4d_181102_010659_ooi_r_ls9-S9 r expnum 789879 exptime 70.0 propid 2014B-0404 seeing 1.29 MJD 58424.047 object DECaLS_40044_r decam/CP/V4.8.2a/CP20181101/c4d_181102_010659_ooi_r_ls9.fits.fz c4d_181103_005103_ooi_g_ls9-S17 g expnum 790198 exptime 185.0 propid 2014B-0404 seeing 1.58 MJD 58425.035 object DECaLS_8300_g decam/CP/V4.8.2a/CP20181102/c4d_181103_005103_ooi_g_ls9.fits.fz c4d_180917_022012_ooi_z_ls9-S17 z expnum 774632 exptime 120.0 propid 2014B-0404 seeing 1.05 MJD 58378.097 object DECaLS_8300_z decam/CP/V4.8.2a/CP20180916/c4d_180917_022012_ooi_z_ls9.fits.fz c4d_181003_014647_ooi_r_ls9-S17 r expnum 780156 exptime 115.0 propid 2014B-0404 seeing 1.46 MJD 58394.074 object DECaLS_8300_r decam/CP/V4.8.2a/CP20181002/c4d_181003_014647_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T010910_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T010659_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181003T025807_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171024T020207_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20180922T021450_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T020617_oi[S10,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T065018_oi[S9,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 123.30 s, CPU: 0.88 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.187376 MB Stage tims finished: 2020-08-07T09:52:10.326349 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T010659_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181103T005103_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T020617_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20180922T021450_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T010910_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9520b9e-g-20170728T065018_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536cb0-g-20181003T025807_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.846 s worker CPU, 847.703 s worker Wall, Wall: 123.306 s, Cores in use: 0.07, Total efficiency (on 16 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T014647_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T022012_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95202c1-z-20171024T020207_oi[S10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-07T09:52:10.367034 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03130.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/reference-custom-343793p30411.fits Stage refs : Wall: 22.71 s, CPU: 3.90 s, VmPeak: 1053 MB, VmSize: 1048 MB, VmRSS: 227 MB, VmData: 259 MB, maxrss: 0.232776 MB Stage refs finished: 2020-08-07T09:52:33.074543 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 22.709 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:52:37.885548 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/outlier-mask-custom-343793p30411.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/outliers-pre-custom-343793p30411.jpg Image c4d_181103_005103_ooi_g_ls9-S17 g : masking 165 positive outlier pixels and 0 negative outlier pixels Image c4d_181102_010659_ooi_r_ls9-S9 r : masking 350 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_022012_ooi_z_ls9-S11 z : masking 119 positive outlier pixels and 0 negative outlier pixels Image c4d_171024_020207_ooi_z_ls9-S10 z : masking 572 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_010910_ooi_z_ls9-S9 z : masking 556 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/outlier-mask-custom-343793p30411.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/outliers-post-custom-343793p30411.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/outliers-masked-pos-custom-343793p30411.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/outliers-masked-neg-custom-343793p30411.jpg Stage outliers : Wall: 1.60 s, CPU: 0.82 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 251 MB, VmData: 279 MB, maxrss: 0.257048 MB Stage outliers finished: 2020-08-07T09:52:39.482674 Resources for stage outliers : 1.285 s worker CPU, 1.354 s worker Wall, Wall: 1.599 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:52:39.522213 Stage halos : Wall: 0.62 s, CPU: 0.37 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 251 MB, VmData: 280 MB, maxrss: 0.257496 MB Stage halos finished: 2020-08-07T09:52:40.142416 Resources for stage halos : 1.167 s worker CPU, 2.360 s worker Wall, Wall: 0.622 s, Cores in use: 2.47, Total efficiency (on 16 cores): 15.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T09:52:40.482260 PSF sigmas in coadd pixels: ['2.56', '2.56', '2.11', '2.57'] Using average PSF sigma 2.449834173118967 Gaussian PSF norm 0.11514852509985758 vs pixelized 0.102805234 average tim pixel scale / coadd scale: 1.001345127121588 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.37', '1.97', '2.09', '2.38'] Using average PSF sigma 2.200028153621872 Gaussian PSF norm 0.128223264465716 vs pixelized 0.10971254 average tim pixel scale / coadd scale: 1.0013963393102763 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.86', '2.32', '1.56', '2.35', '1.70'] Using average PSF sigma 1.9578791734304783 Gaussian PSF norm 0.14408181853204383 vs pixelized 0.10791957 average tim pixel scale / coadd scale: 1.001384332313963 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.37 s, CPU: 0.25 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 253 MB, VmData: 280 MB, maxrss: 0.259116 MB Stage fit_on_coadds finished: 2020-08-07T09:52:40.849953 Resources for stage fit_on_coadds : 0.294 s worker CPU, 0.294 s worker Wall, Wall: 0.369 s, Cores in use: 1.48, Total efficiency (on 16 cores): 9.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:52:40.960178 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 47 potential peaks Of 47 potential peaks: 11 in veto map, 3 cut by saddle test, 1 cut by aper test, 32 kept SED z : 32 new peaks Found 49 potential peaks Of 49 potential peaks: 44 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 66 potential peaks Of 66 potential peaks: 52 in veto map, 7 cut by saddle test, 0 cut by aper test, 7 kept SED Flat : 7 new peaks Found 69 potential peaks Of 69 potential peaks: 62 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 45 new sources Median coadd sky for g : 1.6689432e-05 Median coadd sky for r : 0.00015257338 Median coadd sky for z : 0.00054231373 Stage srcs : Wall: 0.80 s, CPU: 0.75 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 254 MB, VmData: 280 MB, maxrss: 0.259636 MB Stage srcs finished: 2020-08-07T09:52:41.765090 Resources for stage srcs : 0.135 s worker CPU, 0.135 s worker Wall, Wall: 0.806 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:52:41.887508 Blob 1 of 29, id: 12, sources: 7, size: 191x102, npix 13451, brick X: 79,270, Y: 128,230, one pixel: 179 128 Blob 2 of 29, id: 13, sources: 3, size: 65x75, npix 2888, brick X: 17,82, Y: 136,211, one pixel: 47 136 Blob 3 of 29, id: 7, sources: 4, size: 73x58, npix 1798, brick X: 112,185, Y: 43,101, one pixel: 175 43 Blob 4 of 29, id: 22, sources: 3, size: 41x67, npix 1581, brick X: 15,56, Y: 274,341, one pixel: 33 274 Blob 5 of 29, id: 16, sources: 2, size: 43x59, npix 1430, brick X: 285,328, Y: 192,251, one pixel: 302 192 Blob 6 of 29, id: 25, sources: 1, size: 53x39, npix 1384, brick X: 80,133, Y: 313,352, one pixel: 122 313 Blob 7 of 29, id: 21, sources: 2, size: 35x53, npix 1245, brick X: 311,346, Y: 272,325, one pixel: 325 272 Blob 8 of 29, id: 20, sources: 2, size: 34x49, npix 1089, brick X: 280,314, Y: 251,300, one pixel: 296 251 Blob 9 of 29, id: 18, sources: 2, size: 47x33, npix 916, brick X: 7,54, Y: 228,261, one pixel: 19 228 Blob 10 of 29, id: 3, sources: 1, size: 32x33, npix 714, brick X: 160,192, Y: 2,35, one pixel: 175 2 Blob 11 of 29, id: 1, sources: 2, size: 28x40, npix 652, brick X: 115,143, Y: 0,40, one pixel: 126 0 Blob 12 of 29, id: 28, sources: 3, size: 20x40, npix 637, brick X: 0,20, Y: 329,369, one pixel: 4 329 Blob 13 of 29, id: 19, sources: 2, size: 30x41, npix 626, brick X: 192,222, Y: 228,269, one pixel: 210 228 Blob 14 of 29, id: 0, sources: 1, size: 31x26, npix 596, brick X: 7,38, Y: 0,26, one pixel: 14 0 Blob 15 of 29, id: 23, sources: 1, size: 30x30, npix 591, brick X: 100,130, Y: 281,311, one pixel: 112 281 Blob 16 of 29, id: 10, sources: 1, size: 30x29, npix 575, brick X: 300,330, Y: 95,124, one pixel: 311 95 Blob 17 of 29, id: 5, sources: 1, size: 26x26, npix 443, brick X: 206,232, Y: 17,43, one pixel: 217 17 Blob 15 finished, total: Wall: 0.86 s, CPU: 0.84 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.118092 MB Blob 18 of 29, id: 27, sources: 1, size: 26x26, npix 430, brick X: 151,177, Y: 323,349, one pixel: 162 323 Blob 16 finished, total: Wall: 1.10 s, CPU: 0.95 s, VmPeak: 941 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.146952 MB Blob 19 of 29, id: 14, sources: 1, size: 26x26, npix 427, brick X: 321,347, Y: 166,192, one pixel: 331 166 Blob 11 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.11708 MB Blob 20 of 29, id: 8, sources: 2, size: 17x33, npix 400, brick X: 352,369, Y: 54,87, one pixel: 362 54 Blob 13 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 956 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14856 MB Blob 21 of 29, id: 15, sources: 2, size: 17x28, npix 323, brick X: 352,369, Y: 187,215, one pixel: 362 187 Blob 10 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148008 MB Blob 19 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.117308 MB Blob 22 of 29, id: 6, sources: 1, size: 22x22, npix 284, brick X: 290,312, Y: 42,64, one pixel: 299 42 Blob 23 of 29, id: 9, sources: 1, size: 21x21, npix 261, brick X: 252,273, Y: 65,86, one pixel: 261 65 Measuring 1 iterative sources Blob 9 finished, total: Wall: 1.76 s, CPU: 1.76 s, VmPeak: 941 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14602 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.77597, 30.41305), pm (-5.1, -17.8), parallax 3.969 with NanoMaggies: g=16.8, r=16.3, z=14.5 Reset brightness to NanoMaggies: g=16.7, r=15.3, z=14.3 Blob 21 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148008 MB Blob 24 of 29, id: 4, sources: 1, size: 20x22, npix 249, brick X: 64,84, Y: 16,38, one pixel: 73 16 Blob 25 of 29, id: 24, sources: 1, size: 21x21, npix 241, brick X: 167,188, Y: 285,306, one pixel: 177 285 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.77677, 30.40371), pm (-24.3, -10.8), parallax 1.116 with NanoMaggies: g=18.6, r=17.1, z=16 Reset brightness to NanoMaggies: g=18.3, r=17, z=16.3 Blob 20 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 956 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14856 MB Blob 26 of 29, id: 11, sources: 1, size: 19x20, npix 209, brick X: 257,276, Y: 123,143, one pixel: 266 123 Blob 14 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147452 MB Blob 27 of 29, id: 2, sources: 1, size: 21x14, npix 197, brick X: 278,299, Y: 0,14, one pixel: 282 0 Measuring 1 iterative sources Blob 17 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.118232 MB Blob 28 of 29, id: 17, sources: 1, size: 18x18, npix 180, brick X: 327,345, Y: 223,241, one pixel: 335 223 Blob 8 finished, total: Wall: 2.03 s, CPU: 2.03 s, VmPeak: 946 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146764 MB Blob 29 of 29, id: 26, sources: 1, size: 17x17, npix 145, brick X: 59,76, Y: 316,333, one pixel: 67 316 Blob 26 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147452 MB Blob 18 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147068 MB Blob 28 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 946 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146764 MB Blob 29 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147452 MB Blob 23 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148008 MB Measuring 1 iterative sources Blob 24 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146224 MB Blob 22 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.117308 MB Blob 5 finished, total: Wall: 2.48 s, CPU: 2.48 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.146956 MB Measuring 3 iterative sources Blob 25 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 956 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14856 MB Blob 27 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 116 MB, VmData: 168 MB, maxrss: 0.118568 MB Blob 7 finished, total: Wall: 2.77 s, CPU: 2.77 s, VmPeak: 700 MB, VmSize: 700 MB, VmRSS: 118 MB, VmData: 171 MB, maxrss: 0.12114 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.81597, 30.45307), pm (-10.8, -4.9), parallax 2.549 with NanoMaggies: g=12, r=11.7, z=11.6 Reset brightness to NanoMaggies: g=12, r=11.7, z=11.6 Blob 12 finished, total: Wall: 2.82 s, CPU: 2.81 s, VmPeak: 940 MB, VmSize: 722 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143432 MB Blob 4 finished, total: Wall: 3.08 s, CPU: 2.98 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147012 MB Blob 6 finished, total: Wall: 3.10 s, CPU: 3.10 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147296 MB Blob 2 finished, total: Wall: 3.64 s, CPU: 3.64 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148236 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 4.08 s, CPU: 4.08 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148456 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.04136, ee1=-0.592347, ee2=0.13452 Measuring 2 iterative sources Blob 1 finished, total: Wall: 9.84 s, CPU: 9.84 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149576 MB Old catalog: 61 New catalog: 53 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/blobs-custom-343793p30411.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/metrics/cus/all-models-custom-343793p30411.fits Stage fitblobs : Wall: 10.32 s, CPU: 0.51 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 254 MB, VmData: 280 MB, maxrss: 0.259992 MB Stage fitblobs finished: 2020-08-07T09:52:52.206218 Resources for stage fitblobs : 50.276 s worker CPU, 50.685 s worker Wall, Wall: 10.320 s, Cores in use: 4.92, Total efficiency (on 16 cores): 30.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:52:52.275591 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/tmp-legacysurvey-custom-343793p30411-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/tmp-legacysurvey-custom-343793p30411-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/tmp-legacysurvey-custom-343793p30411-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/tmp-legacysurvey-custom-343793p30411-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-resid.jpg Stage coadds : Wall: 2.40 s, CPU: 0.77 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 257 MB, VmData: 285 MB, maxrss: 0.26268 MB Stage coadds finished: 2020-08-07T09:52:54.676405 Resources for stage coadds : 9.529 s worker CPU, 10.265 s worker Wall, Wall: 2.402 s, Cores in use: 4.29, Total efficiency (on 16 cores): 26.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:52:54.749936 Cut to 1 unWISE tiles Reading WISE tile 3443p302 band 1 Reading WISE tile 3443p302 band 3 Reading WISE tile 3443p302 band 2 Reading WISE tile 3443p302 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 940 MB, VmSize: 805 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.18956 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 941 MB, VmSize: 800 MB, VmRSS: 146 MB, VmData: 171 MB, maxrss: 0.210432 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 956 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205036 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3443p302/unwise-3443p302-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 802 MB, VmRSS: 151 MB, VmData: 174 MB, maxrss: 0.213332 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/tmp-legacysurvey-custom-343793p30411-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/tmp-legacysurvey-custom-343793p30411-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.08 s, CPU: 0.47 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 257 MB, VmData: 285 MB, maxrss: 0.263408 MB Stage wise_forced finished: 2020-08-07T09:52:56.834198 Resources for stage wise_forced : 3.393 s worker CPU, 4.845 s worker Wall, Wall: 2.086 s, Cores in use: 1.85, Total efficiency (on 16 cores): 11.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:52:56.852488 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/coadd/cus/custom-343793p30411/legacysurvey-custom-343793p30411-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/tractor-i/cus/tractor-custom-343793p30411.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/tractor/cus/tractor-custom-343793p30411.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/tractor/cus/brick-custom-343793p30411.sha256sum Stage writecat : Wall: 0.78 s, CPU: 0.60 s, VmPeak: 1192 MB, VmSize: 1064 MB, VmRSS: 259 MB, VmData: 285 MB, maxrss: 0.396268 MB Stage writecat finished: 2020-08-07T09:52:57.631787 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.781 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1902721/PGC1902721-largegalaxy-writecat.p All done: 73.929 s worker CPU, 917.643 s worker Wall, Wall: 170.727 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.1 % Finished galaxy PGC1902721 in 2.906 minutes.