Started working on galaxy PGC1993200 at Wed Aug 5 21:02:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.322951 32.3583717 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:02:13.210190 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.322951', '32.3583717', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.322951 32.3583717 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.322951 32.3583717 Starting process 56153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 56154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 56155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 56156 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 56157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 56158 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 56159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 56160 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 56161 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 56162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 56163 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 56164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 56165 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 56166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 56167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 56168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:02:14.601651 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: c4d_180812_013429_ooi_r_ls9-S16 r expnum 764514 exptime 54.0 propid 2014B-0404 seeing 1.10 MJD 58342.066 object DECaLS_34631_r decam/CP/V4.8.2a/CP20180811/c4d_180812_013429_ooi_r_ls9.fits.fz c4d_180907_004316_ooi_g_ls9-S16 g expnum 769921 exptime 161.0 propid 2014B-0404 seeing 1.46 MJD 58368.030 object DECaLS_34631_g decam/CP/V4.8.2a/CP20180906/c4d_180907_004316_ooi_g_ls9.fits.fz c4d_180905_235207_ooi_z_ls9-S16 z expnum 769448 exptime 112.0 propid 2014B-0404 seeing 0.88 MJD 58366.995 object DECaLS_34631_z decam/CP/V4.8.2a/CP20180905/c4d_180905_235207_ooi_z_ls9.fits.fz c4d_180619_045139_ooi_r_ls9-S18 r expnum 754036 exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58288.203 object DECaLS_47911_r decam/CP/V4.8.2a/CP20180618/c4d_180619_045139_ooi_r_ls9.fits.fz c4d_180619_044909_ooi_r_ls9-S18 r expnum 754035 exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58288.201 object DECaLS_47911_r decam/CP/V4.8.2a/CP20180618/c4d_180619_044909_ooi_r_ls9.fits.fz c4d_180907_235452_ooi_z_ls9-S18 z expnum 770493 exptime 121.0 propid 2014B-0404 seeing 0.97 MJD 58368.996 object DECaLS_47911_z decam/CP/V4.8.2a/CP20180907/c4d_180907_235452_ooi_z_ls9.fits.fz c4d_180518_065547_ooi_g_ls9-S18 g expnum 747434 exptime 200.0 propid 2014B-0404 seeing 1.72 MJD 58256.289 object DECaLS_47911_g decam/CP/V4.8.2a/CP20180517/c4d_180518_065547_ooi_g_ls9.fits.fz c4d_160408_090008_ooi_r_ls9-S17 r expnum 535316 exptime 142.0 propid 2014B-0404 seeing 1.60 MJD 57486.373 object DECaLS_18759_r decam/CP/V4.8.2a/CP20160407/c4d_160408_090008_ooi_r_ls9.fits.fz c4d_170822_010634_ooi_r_ls9-S18 r expnum 670243 exptime 85.0 propid 2014B-0404 seeing 1.20 MJD 57987.046 object DECaLS_2887_r decam/CP/V4.8.2a/CP20170821/c4d_170822_010634_ooi_r_ls9.fits.fz c4d_180911_232718_ooi_z_ls9-S17 z expnum 772203 exptime 180.0 propid 2014B-0404 seeing 1.44 MJD 58372.977 object DECaLS_18759_z decam/CP/V4.8.2a/CP20180911/c4d_180911_232718_ooi_z_ls9.fits.fz c4d_180812_004534_ooi_g_ls9-S17 g expnum 764485 exptime 122.0 propid 2014B-0404 seeing 1.24 MJD 58342.032 object DECaLS_18759_g decam/CP/V4.8.2a/CP20180811/c4d_180812_004534_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170822T010634_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180907T235452_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T013429_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T004534_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T004316_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T065547_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956f863-r-20160408T085655_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T232718_oi[S17,noinherit][2046,4094][real]: DECaLS_1875 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T235207_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T044909_oi[S18,noinherit][2046,4094][real]: DECaLS_ Clipping 1752 pixels with anomalously large oow values: max 0.0101493 vs median 0.00585201 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T045139_oi[S18,noinherit][2046,4094][real]: DECaLS_ Clipping 1871 pixels with anomalously large oow values: max 0.00983524 vs median 0.00573342 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 100.57 s, CPU: 1.40 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.185488 MB Stage tims finished: 2020-08-05T21:03:55.167224 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T004316_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180907T235452_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956f863-r-20160408T085655_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T065547_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T232718_oi[S17,noinherit][2046,4094][real]: DECaLS_1875 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T013429_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T044909_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.708 s worker CPU, 632.993 s worker Wall, Wall: 100.567 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170822T010634_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T004534_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:03:55.239255 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02848.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02977.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02849.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/reference-custom-272322p32358.fits Stage refs : Wall: 12.64 s, CPU: 7.60 s, VmPeak: 1101 MB, VmSize: 1095 MB, VmRSS: 268 MB, VmData: 297 MB, maxrss: 0.274736 MB Stage refs finished: 2020-08-05T21:04:07.881122 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T235207_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T045139_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.643 s, Cores in use: 0.60, Total efficiency (on 16 cores): 3.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:04:08.166529 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/outlier-mask-custom-272322p32358.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/outliers-pre-custom-272322p32358.jpg Image c4d_180518_065547_ooi_g_ls9-S18 g : masking 1030 positive outlier pixels and 0 negative outlier pixels Image c4d_180907_004316_ooi_g_ls9-S16 g : masking 1340 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_045139_ooi_r_ls9-S18 r : masking 1074 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_044909_ooi_r_ls9-S18 r : masking 539 positive outlier pixels and 0 negative outlier pixels Image c4d_160408_090008_ooi_r_ls9-S17 r : masking 177 positive outlier pixels and 0 negative outlier pixels Image c4d_180907_235452_ooi_z_ls9-S18 z : masking 439 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/outlier-mask-custom-272322p32358.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/outliers-post-custom-272322p32358.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/outliers-masked-pos-custom-272322p32358.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/outliers-masked-neg-custom-272322p32358.jpg Stage outliers : Wall: 1.85 s, CPU: 1.41 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 286 MB, VmData: 313 MB, maxrss: 0.292736 MB Stage outliers finished: 2020-08-05T21:04:10.018966 Resources for stage outliers : 1.213 s worker CPU, 1.309 s worker Wall, Wall: 1.854 s, Cores in use: 1.41, Total efficiency (on 16 cores): 8.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:04:10.515257 Stage halos : Wall: 0.43 s, CPU: 0.31 s, VmPeak: 1105 MB, VmSize: 1042 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.292928 MB Stage halos finished: 2020-08-05T21:04:10.944892 Resources for stage halos : 0.887 s worker CPU, 1.124 s worker Wall, Wall: 0.431 s, Cores in use: 2.79, Total efficiency (on 16 cores): 17.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:04:11.236001 PSF sigmas in coadd pixels: ['2.37', '2.79', '2.01'] Using average PSF sigma 2.3893588983119307 Gaussian PSF norm 0.11806296323803704 vs pixelized 0.11237079 average tim pixel scale / coadd scale: 1.0014108523463419 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.79', '2.52', '2.51', '2.60', '1.96'] Using average PSF sigma 2.2748253740337305 Gaussian PSF norm 0.12400722929939295 vs pixelized 0.10700416 average tim pixel scale / coadd scale: 1.0014305007643998 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.42', '1.58', '2.34'] Using average PSF sigma 1.7810846782409842 Gaussian PSF norm 0.15838370585079517 vs pixelized 0.129852 average tim pixel scale / coadd scale: 1.0012987470574222 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 1105 MB, VmSize: 1042 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.292928 MB Stage fit_on_coadds finished: 2020-08-05T21:04:11.495656 Resources for stage fit_on_coadds : 0.288 s worker CPU, 0.288 s worker Wall, Wall: 0.261 s, Cores in use: 2.06, Total efficiency (on 16 cores): 12.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:04:11.509103 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 54 potential peaks Of 54 potential peaks: 23 in veto map, 8 cut by saddle test, 0 cut by aper test, 23 kept SED z : 23 new peaks Found 45 potential peaks Of 45 potential peaks: 36 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 39 potential peaks Of 39 potential peaks: 31 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 49 potential peaks Of 49 potential peaks: 41 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 53 potential peaks Of 53 potential peaks: 43 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 31 new sources Median coadd sky for g : 2.9923882e-05 Median coadd sky for r : -5.526059e-05 Median coadd sky for z : 0.0005090639 Stage srcs : Wall: 0.75 s, CPU: 0.69 s, VmPeak: 1105 MB, VmSize: 1042 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.292928 MB Stage srcs finished: 2020-08-05T21:04:12.256520 Resources for stage srcs : 0.117 s worker CPU, 0.117 s worker Wall, Wall: 0.749 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:04:12.288203 Blob 1 of 20, id: 7, sources: 6, size: 125x173, npix 14077, brick X: 95,220, Y: 50,223, one pixel: 184 50 Blob 2 of 20, id: 8, sources: 7, size: 82x110, npix 4676, brick X: 205,287, Y: 62,172, one pixel: 278 62 Blob 3 of 20, id: 6, sources: 4, size: 88x72, npix 3425, brick X: 10,98, Y: 44,116, one pixel: 72 44 Blob 4 of 20, id: 16, sources: 4, size: 49x66, npix 2385, brick X: 116,165, Y: 221,287, one pixel: 137 221 Blob 5 of 20, id: 11, sources: 3, size: 46x78, npix 1972, brick X: 44,90, Y: 148,226, one pixel: 74 148 Blob 6 of 20, id: 18, sources: 5, size: 67x38, npix 1927, brick X: 217,284, Y: 249,287, one pixel: 264 249 Blob 7 of 20, id: 15, sources: 2, size: 45x43, npix 1145, brick X: 0,45, Y: 221,264, one pixel: 24 221 Blob 8 of 20, id: 2, sources: 3, size: 43x58, npix 1059, brick X: 134,177, Y: 1,59, one pixel: 144 1 Blob 9 of 20, id: 5, sources: 1, size: 30x46, npix 1025, brick X: 0,30, Y: 21,67, one pixel: 8 21 Blob 10 of 20, id: 4, sources: 2, size: 38x36, npix 888, brick X: 215,253, Y: 13,49, one pixel: 225 13 Blob 11 of 20, id: 3, sources: 1, size: 28x48, npix 875, brick X: 259,287, Y: 12,60, one pixel: 277 12 Blob 12 of 20, id: 12, sources: 1, size: 35x36, npix 854, brick X: 4,39, Y: 157,193, one pixel: 21 157 Blob 13 of 20, id: 0, sources: 3, size: 40x29, npix 729, brick X: 68,108, Y: 0,29, one pixel: 77 0 Blob 14 of 20, id: 19, sources: 2, size: 35x20, npix 528, brick X: 77,112, Y: 267,287, one pixel: 92 267 Blob 15 of 20, id: 1, sources: 1, size: 26x29, npix 505, brick X: 161,187, Y: 0,29, one pixel: 170 0 Blob 16 of 20, id: 13, sources: 1, size: 25x25, npix 401, brick X: 4,29, Y: 196,221, one pixel: 16 196 Blob 17 of 20, id: 9, sources: 1, size: 24x24, npix 360, brick X: 82,106, Y: 85,109, one pixel: 92 85 Blob 16 finished, total: Wall: 0.82 s, CPU: 0.77 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149868 MB Blob 18 of 20, id: 17, sources: 1, size: 22x22, npix 291, brick X: 77,99, Y: 230,252, one pixel: 86 230 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.32737, 32.34783), pm (0.7, -11.6), parallax 0.296 with NanoMaggies: g=20.1, r=19.3, z=18.9 Reset brightness to NanoMaggies: g=20, r=19.3, z=18.9 Blob 13 finished, total: Wall: 1.46 s, CPU: 1.41 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149848 MB Blob 19 of 20, id: 10, sources: 1, size: 19x18, npix 189, brick X: 46,65, Y: 119,137, one pixel: 55 119 Blob 15 finished, total: Wall: 1.62 s, CPU: 1.55 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.1495 MB Blob 20 of 20, id: 14, sources: 1, size: 17x17, npix 145, brick X: 247,264, Y: 218,235, one pixel: 255 218 Blob 11 finished, total: Wall: 1.75 s, CPU: 1.69 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.117072 MB Blob 20 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.117492 MB Blob 17 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149868 MB Blob 12 finished, total: Wall: 1.90 s, CPU: 1.83 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115312 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.32719, 32.36889), pm (1.4, -2.1), parallax 0.236 with NanoMaggies: g=20.6, r=19.3, z=18.8 Reset brightness to NanoMaggies: g=20, r=19.1, z=18.7 Blob 14 finished, total: Wall: 1.90 s, CPU: 1.90 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099 MB Blob 19 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150356 MB Blob 18 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150188 MB Blob 8 finished, total: Wall: 2.17 s, CPU: 2.13 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098744 MB Blob 10 finished, total: Wall: 2.64 s, CPU: 2.59 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149816 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 3.08 s, CPU: 3.08 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150328 MB Blob 7 finished, total: Wall: 3.29 s, CPU: 3.24 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151268 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 3.47 s, CPU: 3.44 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 181 MB, maxrss: 0.1521 MB Blob 4 finished, total: Wall: 3.54 s, CPU: 3.50 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.15134 MB Measuring 1 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.31384, 32.36895), pm (0.1, -4.8), parallax 0.293 with NanoMaggies: g=18.5, r=17.7, z=17.5 Reset brightness to NanoMaggies: g=18.4, r=17.7, z=17.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.31337, 32.37029), pm (-12.5, -7.6), parallax 1.510 with NanoMaggies: g=(flux -2.74e+03), r=(flux -1.44e+03), z=16.2 Reset brightness to NanoMaggies: g=21.6, r=20.2, z=18.6 Blob 6 finished, total: Wall: 4.88 s, CPU: 4.84 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150076 MB Blob 3 finished, total: Wall: 5.95 s, CPU: 5.90 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151872 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.30681, 32.35480), pm (-1.6, -9.3), parallax 1.570 with NanoMaggies: g=11.7, r=11.3, z=11.2 Reset brightness to NanoMaggies: g=11.7, r=11.3, z=11.2 Blob 2 finished, total: Wall: 6.28 s, CPU: 6.24 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 116 MB, VmData: 167 MB, maxrss: 0.119152 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.31915, ee1=-0.0347188, ee2=-0.0719256 Measuring 3 iterative sources Blob 1 finished, total: Wall: 13.20 s, CPU: 13.20 s, VmPeak: 962 MB, VmSize: 733 MB, VmRSS: 150 MB, VmData: 182 MB, maxrss: 0.15342 MB Old catalog: 53 New catalog: 53 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/blobs-custom-272322p32358.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/metrics/cus/all-models-custom-272322p32358.fits Stage fitblobs : Wall: 14.78 s, CPU: 1.51 s, VmPeak: 1105 MB, VmSize: 1042 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.292928 MB Stage fitblobs finished: 2020-08-05T21:04:27.072933 Resources for stage fitblobs : 59.798 s worker CPU, 61.447 s worker Wall, Wall: 14.786 s, Cores in use: 4.15, Total efficiency (on 16 cores): 25.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:04:27.089200 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-resid.jpg Stage coadds : Wall: 2.65 s, CPU: 0.69 s, VmPeak: 1105 MB, VmSize: 1042 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.292928 MB Stage coadds finished: 2020-08-05T21:04:29.741107 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 11.152 s worker CPU, 15.181 s worker Wall, Wall: 2.653 s, Cores in use: 4.46, Total efficiency (on 16 cores): 27.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T21:04:29.824715 Cut to 1 unWISE tiles Reading WISE tile 2717p318 band 2 Reading WISE tile 2717p318 band 1 Reading WISE tile 2717p318 band 3 Reading WISE tile 2717p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 950 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.2093 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 962 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.209992 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 962 MB, VmSize: 813 MB, VmRSS: 154 MB, VmData: 178 MB, maxrss: 0.19878 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.21138 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.56 s, CPU: 0.86 s, VmPeak: 1105 MB, VmSize: 1042 MB, VmRSS: 226 MB, VmData: 250 MB, maxrss: 0.292928 MB Stage wise_forced finished: 2020-08-05T21:04:32.389419 Resources for stage wise_forced : 3.654 s worker CPU, 5.668 s worker Wall, Wall: 2.566 s, Cores in use: 1.76, Total efficiency (on 16 cores): 11.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:04:32.479060 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/tractor-i/cus/tractor-custom-272322p32358.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/tractor/cus/tractor-custom-272322p32358.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/tractor/cus/brick-custom-272322p32358.sha256sum Stage writecat : Wall: 1.22 s, CPU: 1.06 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 228 MB, VmData: 250 MB, maxrss: 0.364256 MB Stage writecat finished: 2020-08-05T21:04:33.696372 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.219 s, Cores in use: 0.87, Total efficiency (on 16 cores): 5.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC1993200/PGC1993200-largegalaxy-writecat.p All done: 83.819 s worker CPU, 718.131 s worker Wall, Wall: 139.124 s, Cores in use: 0.72, Total efficiency (on 16 cores): 4.5 % Finished galaxy PGC1993200 in 2.378 minutes. Started working on galaxy PGC1993200 at Fri Aug 7 09:27:32 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3225714826088 32.358432989715965 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:27:33.260736 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.3225714826088', '32.358432989715965', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3225714826088 32.358432989715965 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.3225714826088 32.358432989715965 Starting process 34395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 34396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 34397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 34398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 34399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 34400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 34403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 34404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 34406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:27:33.784122 Keeping 11 CCDs: c4d_180812_013429_ooi_r_ls9-S16 r expnum 764514 exptime 54.0 propid 2014B-0404 seeing 1.10 MJD 58342.066 object DECaLS_34631_r decam/CP/V4.8.2a/CP20180811/c4d_180812_013429_ooi_r_ls9.fits.fz c4d_180907_004316_ooi_g_ls9-S16 g expnum 769921 exptime 161.0 propid 2014B-0404 seeing 1.46 MJD 58368.030 object DECaLS_34631_g decam/CP/V4.8.2a/CP20180906/c4d_180907_004316_ooi_g_ls9.fits.fz c4d_180905_235207_ooi_z_ls9-S16 z expnum 769448 exptime 112.0 propid 2014B-0404 seeing 0.88 MJD 58366.995 object DECaLS_34631_z decam/CP/V4.8.2a/CP20180905/c4d_180905_235207_ooi_z_ls9.fits.fz c4d_180619_045139_ooi_r_ls9-S18 r expnum 754036 exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58288.203 object DECaLS_47911_r decam/CP/V4.8.2a/CP20180618/c4d_180619_045139_ooi_r_ls9.fits.fz c4d_180619_044909_ooi_r_ls9-S18 r expnum 754035 exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58288.201 object DECaLS_47911_r decam/CP/V4.8.2a/CP20180618/c4d_180619_044909_ooi_r_ls9.fits.fz c4d_180907_235452_ooi_z_ls9-S18 z expnum 770493 exptime 121.0 propid 2014B-0404 seeing 0.97 MJD 58368.996 object DECaLS_47911_z decam/CP/V4.8.2a/CP20180907/c4d_180907_235452_ooi_z_ls9.fits.fz c4d_180518_065547_ooi_g_ls9-S18 g expnum 747434 exptime 200.0 propid 2014B-0404 seeing 1.72 MJD 58256.289 object DECaLS_47911_g decam/CP/V4.8.2a/CP20180517/c4d_180518_065547_ooi_g_ls9.fits.fz c4d_160408_090008_ooi_r_ls9-S17 r expnum 535316 exptime 142.0 propid 2014B-0404 seeing 1.60 MJD 57486.373 object DECaLS_18759_r decam/CP/V4.8.2a/CP20160407/c4d_160408_090008_ooi_r_ls9.fits.fz c4d_170822_010634_ooi_r_ls9-S18 r expnum 670243 exptime 85.0 propid 2014B-0404 seeing 1.20 MJD 57987.046 object DECaLS_2887_r decam/CP/V4.8.2a/CP20170821/c4d_170822_010634_ooi_r_ls9.fits.fz c4d_180911_232718_ooi_z_ls9-S17 z expnum 772203 exptime 180.0 propid 2014B-0404 seeing 1.44 MJD 58372.977 object DECaLS_18759_z decam/CP/V4.8.2a/CP20180911/c4d_180911_232718_ooi_z_ls9.fits.fz c4d_180812_004534_ooi_g_ls9-S17 g expnum 764485 exptime 122.0 propid 2014B-0404 seeing 1.24 MJD 58342.032 object DECaLS_18759_g decam/CP/V4.8.2a/CP20180811/c4d_180812_004534_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180907T235452_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170822T010634_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956f863-r-20160408T085655_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T004534_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T013429_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T004316_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T045139_oi[S18,noinherit][2046,4094][real]: DECaLS_ Clipping 1870 pixels with anomalously large oow values: max 0.00983524 vs median 0.00573342 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T044909_oi[S18,noinherit][2046,4094][real]: DECaLS_ Clipping 1741 pixels with anomalously large oow values: max 0.0101493 vs median 0.00585201 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T235207_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T065547_oi[S18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T232718_oi[S17,noinherit][2046,4094][real]: DECaLS_1875 Stage tims : Wall: 88.54 s, CPU: 0.91 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 179 MB, VmData: 213 MB, maxrss: 0.18374 MB Stage tims finished: 2020-08-07T09:29:02.325416 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180812T004534_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T235207_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T013429_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T004316_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T065547_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180911T232718_oi[S17,noinherit][2046,4094][real]: DECaLS_1875 [astropy.io.fits.card] Resources for stage tims : 5.975 s worker CPU, 217.295 s worker Wall, Wall: 88.543 s, Cores in use: 0.08, Total efficiency (on 16 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180907T235452_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956f863-r-20160408T085655_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T045139_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560feb-r-20180619T044909_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170822T010634_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-07T09:29:05.230206 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02848.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02977.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02849.fits Matched 1 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/reference-custom-272322p32358.fits Stage refs : Wall: 8.68 s, CPU: 7.42 s, VmPeak: 1095 MB, VmSize: 1089 MB, VmRSS: 266 MB, VmData: 297 MB, maxrss: 0.27258 MB Stage refs finished: 2020-08-07T09:29:13.908718 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.680 s, Cores in use: 0.85, Total efficiency (on 16 cores): 5.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:29:14.165056 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/outlier-mask-custom-272322p32358.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/outliers-pre-custom-272322p32358.jpg Image c4d_180907_004316_ooi_g_ls9-S16 g : masking 1464 positive outlier pixels and 0 negative outlier pixels Image c4d_180518_065547_ooi_g_ls9-S18 g : masking 1057 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_045139_ooi_r_ls9-S18 r : masking 1280 positive outlier pixels and 0 negative outlier pixels Image c4d_180619_044909_ooi_r_ls9-S18 r : masking 503 positive outlier pixels and 0 negative outlier pixels Image c4d_160408_090008_ooi_r_ls9-S17 r : masking 178 positive outlier pixels and 0 negative outlier pixels Image c4d_180907_235452_ooi_z_ls9-S18 z : masking 434 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/outlier-mask-custom-272322p32358.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/outliers-post-custom-272322p32358.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/outliers-masked-pos-custom-272322p32358.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/outliers-masked-neg-custom-272322p32358.jpg Stage outliers : Wall: 1.14 s, CPU: 0.75 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 283 MB, VmData: 312 MB, maxrss: 0.289896 MB Stage outliers finished: 2020-08-07T09:29:15.308516 Resources for stage outliers : 1.143 s worker CPU, 1.188 s worker Wall, Wall: 1.145 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:29:15.587389 Stage halos : Wall: 10.41 s, CPU: 0.30 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 283 MB, VmData: 312 MB, maxrss: 0.290292 MB Stage halos finished: 2020-08-07T09:29:25.998075 Resources for stage halos : 0.715 s worker CPU, 11.276 s worker Wall, Wall: 10.412 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T09:29:26.043749 PSF sigmas in coadd pixels: ['2.37', '2.79', '2.01'] Using average PSF sigma 2.3893588983119307 Gaussian PSF norm 0.11806296323803704 vs pixelized 0.11237123 average tim pixel scale / coadd scale: 1.0014108523463419 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.79', '2.52', '2.51', '2.60', '1.96'] Using average PSF sigma 2.2748253740337305 Gaussian PSF norm 0.12400722929939295 vs pixelized 0.10700432 average tim pixel scale / coadd scale: 1.0014305007643998 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.42', '1.58', '2.34'] Using average PSF sigma 1.7810846782409842 Gaussian PSF norm 0.15838370585079517 vs pixelized 0.12984875 average tim pixel scale / coadd scale: 1.0012987470574222 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.28 s, CPU: 0.21 s, VmPeak: 1099 MB, VmSize: 1099 MB, VmRSS: 287 MB, VmData: 314 MB, maxrss: 0.293976 MB Stage fit_on_coadds finished: 2020-08-07T09:29:26.322928 Resources for stage fit_on_coadds : 0.295 s worker CPU, 0.295 s worker Wall, Wall: 0.281 s, Cores in use: 1.80, Total efficiency (on 16 cores): 11.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:29:26.366918 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 51 potential peaks Of 51 potential peaks: 23 in veto map, 7 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 45 potential peaks Of 45 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 39 potential peaks Of 39 potential peaks: 29 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 50 potential peaks Of 50 potential peaks: 42 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 55 potential peaks Of 55 potential peaks: 45 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 29 new sources Median coadd sky for g : 4.40064e-05 Median coadd sky for r : -5.0401854e-05 Median coadd sky for z : 0.0005387988 Stage srcs : Wall: 0.81 s, CPU: 0.77 s, VmPeak: 1099 MB, VmSize: 1035 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.29452 MB Stage srcs finished: 2020-08-07T09:29:27.172434 Resources for stage srcs : 0.087 s worker CPU, 0.087 s worker Wall, Wall: 0.807 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:29:27.240060 Blob 1 of 18, id: 7, sources: 9, size: 124x238, npix 16517, brick X: 91,215, Y: 49,287, one pixel: 181 49 Blob 2 of 18, id: 3, sources: 8, size: 87x160, npix 6232, brick X: 200,287, Y: 11,171, one pixel: 273 11 Blob 3 of 18, id: 6, sources: 4, size: 88x72, npix 3399, brick X: 6,94, Y: 43,115, one pixel: 67 43 Blob 4 of 18, id: 10, sources: 3, size: 46x78, npix 1976, brick X: 40,86, Y: 147,225, one pixel: 70 147 Blob 5 of 18, id: 16, sources: 5, size: 66x39, npix 1971, brick X: 213,279, Y: 248,287, one pixel: 260 248 Blob 6 of 18, id: 2, sources: 3, size: 43x57, npix 1042, brick X: 129,172, Y: 1,58, one pixel: 138 1 Blob 7 of 18, id: 4, sources: 2, size: 39x35, npix 886, brick X: 210,249, Y: 13,48, one pixel: 220 13 Blob 8 of 18, id: 11, sources: 1, size: 35x36, npix 856, brick X: 0,35, Y: 156,192, one pixel: 17 156 Blob 9 of 18, id: 5, sources: 1, size: 25x43, npix 841, brick X: 0,25, Y: 21,64, one pixel: 5 21 Blob 10 of 18, id: 14, sources: 1, size: 34x36, npix 832, brick X: 6,40, Y: 220,256, one pixel: 20 220 Blob 11 of 18, id: 0, sources: 3, size: 40x29, npix 684, brick X: 63,103, Y: 0,29, one pixel: 73 0 Blob 12 of 18, id: 17, sources: 2, size: 36x20, npix 560, brick X: 72,108, Y: 267,287, one pixel: 86 267 Blob 13 of 18, id: 1, sources: 1, size: 27x28, npix 509, brick X: 156,183, Y: 0,28, one pixel: 165 0 Blob 14 of 18, id: 12, sources: 1, size: 25x25, npix 391, brick X: 0,25, Y: 195,220, one pixel: 12 195 Blob 15 of 18, id: 8, sources: 1, size: 25x23, npix 352, brick X: 77,102, Y: 85,108, one pixel: 87 85 Blob 16 of 18, id: 15, sources: 1, size: 22x23, npix 294, brick X: 73,95, Y: 229,252, one pixel: 81 229 Blob 17 of 18, id: 9, sources: 1, size: 18x19, npix 189, brick X: 42,60, Y: 118,137, one pixel: 50 118 Blob 14 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 957 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144224 MB Blob 18 of 18, id: 13, sources: 1, size: 17x17, npix 145, brick X: 243,260, Y: 217,234, one pixel: 251 217 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.32737, 32.34783), pm (0.7, -11.6), parallax 0.296 with NanoMaggies: g=19.8, r=19.2, z=18.9 Reset brightness to NanoMaggies: g=20, r=19.3, z=18.9 Blob 11 finished, total: Wall: 0.83 s, CPU: 0.82 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146452 MB Blob 18 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.1466 MB Blob 16 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 950 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145392 MB Blob 15 finished, total: Wall: 1.06 s, CPU: 1.04 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146232 MB Blob 17 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 957 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145912 MB Blob 13 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.117536 MB Blob 8 finished, total: Wall: 1.72 s, CPU: 1.72 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14636 MB Blob 6 finished, total: Wall: 1.88 s, CPU: 1.88 s, VmPeak: 962 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145648 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 2.34 s, CPU: 2.33 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.117292 MB Blob 12 finished, total: Wall: 2.45 s, CPU: 2.45 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.09996 MB Blob 7 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.1467 MB Blob 4 finished, total: Wall: 2.99 s, CPU: 2.99 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.116104 MB Blob 9 finished, total: Wall: 3.16 s, CPU: 3.15 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.116844 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.31384, 32.36895), pm (0.1, -4.8), parallax 0.293 with NanoMaggies: g=18.7, r=17.8, z=17.5 Reset brightness to NanoMaggies: g=18.4, r=17.7, z=17.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.31337, 32.37029), pm (-12.5, -7.6), parallax 1.510 with NanoMaggies: g=(flux -2.15e+03), r=(flux -1.22e+03), z=(flux -169) Reset brightness to NanoMaggies: g=21.6, r=20.2, z=18.6 Blob 5 finished, total: Wall: 4.56 s, CPU: 4.56 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146424 MB Measuring 1 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.30681, 32.35480), pm (-1.6, -9.3), parallax 1.570 with NanoMaggies: g=11.7, r=11.3, z=11.2 Reset brightness to NanoMaggies: g=11.7, r=11.3, z=11.2 Blob 2 finished, total: Wall: 4.92 s, CPU: 4.92 s, VmPeak: 950 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147672 MB Blob 3 finished, total: Wall: 5.71 s, CPU: 5.70 s, VmPeak: 956 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149312 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.930297, ee1=-0.0839645, ee2=-0.077438 Measuring 2 iterative sources Blob 1 finished, total: Wall: 11.93 s, CPU: 11.93 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149728 MB Old catalog: 51 New catalog: 47 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/blobs-custom-272322p32358.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/metrics/cus/all-models-custom-272322p32358.fits Stage fitblobs : Wall: 20.52 s, CPU: 0.36 s, VmPeak: 1099 MB, VmSize: 1035 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.29452 MB Stage fitblobs finished: 2020-08-07T09:29:47.757987 Resources for stage fitblobs : 49.944 s worker CPU, 50.093 s worker Wall, Wall: 20.520 s, Cores in use: 2.45, Total efficiency (on 16 cores): 15.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:29:47.839703 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-resid.jpg Stage coadds : Wall: 2.44 s, CPU: 0.64 s, VmPeak: 1099 MB, VmSize: 1035 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.29452 MB Stage coadds finished: 2020-08-07T09:29:50.278375 Resources for stage coadds : 10.092 s worker CPU, 10.729 s worker Wall, Wall: 2.440 s, Cores in use: 4.40, Total efficiency (on 16 cores): 27.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:29:50.389656 Cut to 1 unWISE tiles Reading WISE tile 2717p318 band 1 Reading WISE tile 2717p318 band 2 Reading WISE tile 2717p318 band 3 Reading WISE tile 2717p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 955 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.189232 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.212336 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.20512 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/271/2717p318/unwise-2717p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 950 MB, VmSize: 802 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210076 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/tmp-legacysurvey-custom-272322p32358-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 39.17 s, CPU: 0.46 s, VmPeak: 1099 MB, VmSize: 1035 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.29452 MB Stage wise_forced finished: 2020-08-07T09:30:29.562421 Resources for stage wise_forced : 2.961 s worker CPU, 35.838 s worker Wall, Wall: 39.174 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:30:29.675338 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/coadd/cus/custom-272322p32358/legacysurvey-custom-272322p32358-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/tractor-i/cus/tractor-custom-272322p32358.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/tractor/cus/tractor-custom-272322p32358.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/tractor/cus/brick-custom-272322p32358.sha256sum Stage writecat : Wall: 1.90 s, CPU: 0.62 s, VmPeak: 1167 MB, VmSize: 1039 MB, VmRSS: 227 MB, VmData: 250 MB, maxrss: 0.363104 MB Stage writecat finished: 2020-08-07T09:30:31.578607 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.905 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC1993200/PGC1993200-largegalaxy-writecat.p All done: 71.217 s worker CPU, 326.805 s worker Wall, Wall: 177.836 s, Cores in use: 0.47, Total efficiency (on 16 cores): 2.9 % Finished galaxy PGC1993200 in 3.004 minutes.