Started working on galaxy PGC1066682 at Wed Aug 5 20:13:23 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.91953549999994 -3.8019237 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:13:24.904167 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.91953549999994', '-3.8019237', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.91953549999994 -3.8019237 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.91953549999994 -3.8019237 Starting process 62915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 62916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 62919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 62920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 62921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 62922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 62923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 62924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 62925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 62926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 62927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 62930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:13:28.169276 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_180905_013602_ooi_g_ls9-S11 g expnum 768990 exptime 64.0 propid 2014B-0404 seeing 1.26 MJD 58366.067 object DECaLS_52273_g decam/CP/V4.8.2a/CP20180904/c4d_180905_013602_ooi_g_ls9.fits.fz c4d_160812_032407_ooi_z_ls9-N22 z expnum 563101 exptime 80.0 propid 2014B-0404 seeing 0.94 MJD 57612.140 object DECaLS_11778_z decam/CP/V4.8.2a/CP20160811/c4d_160812_032407_ooi_z_ls9.fits.fz c4d_140819_031214_ooi_g_ls9-N22 g expnum 349698 exptime 68.0 propid 2014B-0404 seeing 1.08 MJD 56888.132 object DECaLS_11778_g decam/CP/V4.8.2a/CP20140818/c4d_140819_031214_ooi_g_ls9.fits.fz c4d_140819_021429_ooi_r_ls9-N22 r expnum 349668 exptime 64.0 propid 2014B-0404 seeing 0.92 MJD 56888.092 object DECaLS_11778_r decam/CP/V4.8.2a/CP20140818/c4d_140819_021429_ooi_r_ls9.fits.fz c4d_181005_235712_ooi_z_ls9-S31 z expnum 780919 exptime 98.0 propid 2014B-0404 seeing 1.22 MJD 58396.998 object DECaLS_43503_z decam/CP/V4.8.2a/CP20181005/c4d_181005_235712_ooi_z_ls9.fits.fz c4d_170915_010700_ooi_r_ls9-S31 r expnum 677683 exptime 175.0 propid 2014B-0404 seeing 1.73 MJD 58011.047 object DECaLS_43503_r decam/CP/V4.8.2a/CP20170914/c4d_170915_010700_ooi_r_ls9.fits.fz c4d_180910_021336_ooi_r_ls9-S31 r expnum 771431 exptime 40.0 propid 2014B-0404 seeing 1.20 MJD 58371.093 object DECaLS_43503_r decam/CP/V4.8.2a/CP20180909/c4d_180910_021336_ooi_r_ls9.fits.fz c4d_170721_040940_ooi_r_ls9-N25 r expnum 660430 exptime 60.0 propid 2014B-0404 seeing 1.09 MJD 57955.172 object DECaLS_43522_r decam/CP/V4.8.2/CP20170720/c4d_170721_040940_ooi_r_ls9.fits.fz c4d_140815_045358_ooi_z_ls9-N25 z expnum 347989 exptime 133.0 propid 2014B-0404 seeing 0.95 MJD 56884.202 object DECaLS_43522_z decam/CP/V4.8.2a/CP20140814/c4d_140815_045358_ooi_z_ls9.fits.fz c4d_180808_032133_ooi_g_ls9-N25 g expnum 762852 exptime 200.0 propid 2014B-0404 seeing 1.98 MJD 58338.140 object DECaLS_43522_g decam/CP/V4.8.2a/CP20180807/c4d_180808_032133_ooi_g_ls9.fits.fz c4d_140817_020238_ooi_r_ls9-N25 r expnum 348735 exptime 63.0 propid 2014B-0404 seeing 1.44 MJD 56886.084 object DECaLS_43522_r decam/CP/V4.8.2a/CP20140816/c4d_140817_020238_ooi_r_ls9.fits.fz c4d_160804_040814_ooi_g_ls9-N25 g expnum 559124 exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57604.170 object DECaLS_43522_g decam/CP/V4.8.2a/CP20160803/c4d_160804_040814_ooi_g_ls9.fits.fz c4d_160609_061951_ooi_r_ls9-N26 r expnum 548375 exptime 75.0 propid 2014B-0404 seeing 1.41 MJD 57548.262 object DECaLS_27650_r decam/CP/V4.8.2a/CP20160608/c4d_160609_061951_ooi_r_ls9.fits.fz c4d_160814_032315_ooi_z_ls9-N26 z expnum 563869 exptime 80.0 propid 2014B-0404 seeing 1.15 MJD 57614.140 object DECaLS_27650_z decam/CP/V4.8.2a/CP20160813/c4d_160814_032315_ooi_z_ls9.fits.fz c4d_160804_032750_ooi_g_ls9-N26 g expnum 559111 exptime 137.0 propid 2014B-0404 seeing 1.45 MJD 57604.142 object DECaLS_27650_g decam/CP/V4.8.2a/CP20160803/c4d_160804_032750_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522538-r-20170915T010700_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T032104_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 31 pixels with anomalously large oow values: max 0.0266948 vs median 0.00234675 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013602_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T021336_oi[S31,noinherit][2046,4094][real]: DECaLS_4350 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530bc0-z-20181005T235712_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032159_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954ab5b-g-20140819T031012_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T040747_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180808T032133_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T032442_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 34 pixels with anomalously large oow values: max 1.18928 vs median 0.0221563 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T040432_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140819T021233_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T061746_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 17 pixels with anomalously large oow values: max 0.671198 vs median 0.0162697 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T020043_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T045053_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 49.24 s, CPU: 2.36 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 185 MB, VmData: 217 MB, maxrss: 0.189012 MB Stage tims finished: 2020-08-05T20:14:17.405486 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140819T021233_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954ab5b-g-20140819T031012_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T045053_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180808T032133_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530bc0-z-20181005T235712_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T040432_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T032442_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T040747_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T061746_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T021336_oi[S31,noinherit][2046,4094][real]: DECaLS_4350 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522538-r-20170915T010700_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 11.045 s worker CPU, 350.964 s worker Wall, Wall: 49.238 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013602_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T032104_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:14:17.439803 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06707.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06579.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/reference-custom-323919m03801.fits Stage refs : Wall: 8.02 s, CPU: 3.61 s, VmPeak: 1051 MB, VmSize: 1045 MB, VmRSS: 218 MB, VmData: 250 MB, maxrss: 0.223676 MB Stage refs finished: 2020-08-05T20:14:25.459141 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T020043_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032159_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.021 s, Cores in use: 0.45, Total efficiency (on 16 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:14:25.808858 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outlier-mask-custom-323919m03801.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-pre-custom-323919m03801.jpg Image c4d_160804_040814_ooi_g_ls9-N25 g : masking 2018 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_013602_ooi_g_ls9-S11 g : masking 14265 positive outlier pixels and 0 negative outlier pixels Image c4d_180808_032133_ooi_g_ls9-N25 g : masking 2708 positive outlier pixels and 0 negative outlier pixels Image c4d_170915_010700_ooi_r_ls9-S31 r : masking 6359 positive outlier pixels and 0 negative outlier pixels Image c4d_180910_021336_ooi_r_ls9-S31 r : masking 0 positive outlier pixels and 69 negative outlier pixels Image c4d_170721_040940_ooi_r_ls9-N25 r : masking 249 positive outlier pixels and 0 negative outlier pixels Image c4d_140817_020238_ooi_r_ls9-N25 r : masking 6884 positive outlier pixels and 0 negative outlier pixels Image c4d_160812_032407_ooi_z_ls9-N22 z : masking 0 positive outlier pixels and 133 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outlier-mask-custom-323919m03801.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-post-custom-323919m03801.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-masked-pos-custom-323919m03801.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-masked-neg-custom-323919m03801.jpg Stage outliers : Wall: 3.31 s, CPU: 2.86 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.244984 MB Stage outliers finished: 2020-08-05T20:14:29.117703 Resources for stage outliers : 1.501 s worker CPU, 1.556 s worker Wall, Wall: 3.310 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:14:29.500606 Stage halos : Wall: 1.98 s, CPU: 1.69 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.245352 MB Stage halos finished: 2020-08-05T20:14:31.477307 Resources for stage halos : 0.467 s worker CPU, 2.609 s worker Wall, Wall: 1.978 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:14:31.516712 PSF sigmas in coadd pixels: ['2.04', '1.75', '3.22', '2.55', '2.36'] Using average PSF sigma 2.383310788356856 Gaussian PSF norm 0.11836257073646904 vs pixelized 0.080868274 average tim pixel scale / coadd scale: 1.001115419585542 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.49', '2.82', '1.95', '1.76', '2.34', '2.28'] Using average PSF sigma 2.1077098561569367 Gaussian PSF norm 0.1338394803012554 vs pixelized 0.09392301 average tim pixel scale / coadd scale: 1.0011664134955018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.53', '1.98', '1.54', '1.86'] Using average PSF sigma 1.72946054070394 Gaussian PSF norm 0.16311143569604514 vs pixelized 0.14008646 average tim pixel scale / coadd scale: 1.0010344548397947 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.25 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.247124 MB Stage fit_on_coadds finished: 2020-08-05T20:14:31.802759 Resources for stage fit_on_coadds : 0.490 s worker CPU, 0.490 s worker Wall, Wall: 0.288 s, Cores in use: 2.58, Total efficiency (on 16 cores): 16.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:14:31.818961 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 42 potential peaks Of 42 potential peaks: 9 in veto map, 5 cut by saddle test, 0 cut by aper test, 28 kept SED z : 28 new peaks Found 36 potential peaks Of 36 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 31 potential peaks Of 31 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 48 potential peaks Of 48 potential peaks: 40 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 55 potential peaks Of 55 potential peaks: 43 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 40 new sources Median coadd sky for g : -3.1421085e-05 Median coadd sky for r : -3.3850956e-06 Median coadd sky for z : 0.00045527585 Stage srcs : Wall: 1.65 s, CPU: 1.59 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 242 MB, VmData: 267 MB, maxrss: 0.247656 MB Stage srcs finished: 2020-08-05T20:14:33.467630 Resources for stage srcs : 0.082 s worker CPU, 0.082 s worker Wall, Wall: 1.650 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:14:33.487137 Blob 1 of 15, id: 0, sources: 15, size: 174x210, npix 18845, brick X: 39,213, Y: 0,210, one pixel: 141 0 Blob 2 of 15, id: 12, sources: 4, size: 90x66, npix 3016, brick X: 163,253, Y: 209,275, one pixel: 204 209 Blob 3 of 15, id: 3, sources: 4, size: 95x59, npix 2998, brick X: 179,274, Y: 14,73, one pixel: 239 14 Blob 4 of 15, id: 1, sources: 5, size: 46x93, npix 2405, brick X: 0,46, Y: 2,95, one pixel: 31 2 Blob 5 of 15, id: 2, sources: 3, size: 54x65, npix 2289, brick X: 63,117, Y: 4,69, one pixel: 83 4 Blob 6 of 15, id: 6, sources: 4, size: 64x67, npix 2085, brick X: 211,275, Y: 99,166, one pixel: 266 99 Blob 7 of 15, id: 13, sources: 3, size: 81x32, npix 1626, brick X: 80,161, Y: 243,275, one pixel: 90 243 Blob 8 of 15, id: 5, sources: 1, size: 41x43, npix 1104, brick X: 200,241, Y: 74,117, one pixel: 218 74 Blob 9 of 15, id: 9, sources: 2, size: 41x39, npix 822, brick X: 205,246, Y: 182,221, one pixel: 215 182 Blob 10 of 15, id: 10, sources: 2, size: 31x37, npix 698, brick X: 17,48, Y: 199,236, one pixel: 33 199 Blob 11 of 15, id: 8, sources: 1, size: 25x28, npix 451, brick X: 30,55, Y: 141,169, one pixel: 41 141 Blob 12 of 15, id: 11, sources: 1, size: 21x21, npix 269, brick X: 244,265, Y: 205,226, one pixel: 252 205 Blob 13 of 15, id: 14, sources: 1, size: 23x15, npix 234, brick X: 8,31, Y: 260,275, one pixel: 18 260 Blob 14 of 15, id: 7, sources: 1, size: 14x22, npix 206, brick X: 0,14, Y: 101,123, one pixel: 1 101 Blob 15 of 15, id: 4, sources: 1, size: 18x18, npix 171, brick X: 34,52, Y: 49,67, one pixel: 42 49 Blob 15 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150324 MB Blob 12 finished, total: Wall: 0.46 s, CPU: 0.43 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150296 MB Blob 14 finished, total: Wall: 0.82 s, CPU: 0.81 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150184 MB Blob 13 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150252 MB Blob 11 finished, total: Wall: 1.10 s, CPU: 1.08 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150316 MB Blob 9 finished, total: Wall: 1.36 s, CPU: 1.33 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150292 MB Blob 10 finished, total: Wall: 1.70 s, CPU: 1.67 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.151008 MB Blob 8 finished, total: Wall: 2.00 s, CPU: 2.00 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150656 MB Blob 7 finished, total: Wall: 2.25 s, CPU: 2.23 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151488 MB Measuring 2 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.79 s, CPU: 2.76 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.152036 MB Blob 6 finished, total: Wall: 3.29 s, CPU: 3.27 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.11568 MB Measuring 3 iterative sources Measuring 1 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.93005, -3.80845), pm (-4.6, -6.4), parallax 0.696 with NanoMaggies: g=17.2, r=17.3, z=16.2 Reset brightness to NanoMaggies: g=17.1, r=16.4, z=16.1 Blob 4 finished, total: Wall: 3.81 s, CPU: 3.81 s, VmPeak: 953 MB, VmSize: 738 MB, VmRSS: 154 MB, VmData: 187 MB, maxrss: 0.157804 MB Blob 3 finished, total: Wall: 3.81 s, CPU: 3.78 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151756 MB Blob 2 finished, total: Wall: 4.49 s, CPU: 4.47 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150836 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.72047, ee1=-0.532658, ee2=-0.493152 Measuring 6 iterative sources Blob 1 finished, total: Wall: 17.57 s, CPU: 17.56 s, VmPeak: 951 MB, VmSize: 736 MB, VmRSS: 157 MB, VmData: 185 MB, maxrss: 0.16094 MB Old catalog: 51 New catalog: 56 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/blobs-custom-323919m03801.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/all-models-custom-323919m03801.fits Stage fitblobs : Wall: 19.29 s, CPU: 1.56 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 242 MB, VmData: 267 MB, maxrss: 0.248076 MB Stage fitblobs finished: 2020-08-05T20:14:52.779545 Resources for stage fitblobs : 46.530 s worker CPU, 47.947 s worker Wall, Wall: 19.294 s, Cores in use: 2.49, Total efficiency (on 16 cores): 15.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:14:52.793472 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-resid.jpg Stage coadds : Wall: 2.52 s, CPU: 0.60 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 243 MB, VmData: 267 MB, maxrss: 0.248528 MB Stage coadds finished: 2020-08-05T20:14:55.315899 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.954 s worker CPU, 10.327 s worker Wall, Wall: 2.524 s, Cores in use: 3.79, Total efficiency (on 16 cores): 23.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T20:14:55.346018 Cut to 2 unWISE tiles Reading WISE tile 3235m046 band 3 Reading WISE tile 3235m046 band 2 Reading WISE tile 3235m046 band 4 Reading WISE tile 3235m046 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.18 s, CPU: 0.18 s, VmPeak: 951 MB, VmSize: 819 MB, VmRSS: 165 MB, VmData: 183 MB, maxrss: 0.207008 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 952 MB, VmSize: 810 MB, VmRSS: 152 MB, VmData: 175 MB, maxrss: 0.214256 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 957 MB, VmSize: 808 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.21078 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 940 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.207948 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.90 s, CPU: 2.72 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 243 MB, VmData: 267 MB, maxrss: 0.249232 MB Stage wise_forced finished: 2020-08-05T20:15:04.245188 Resources for stage wise_forced : 6.494 s worker CPU, 16.495 s worker Wall, Wall: 8.901 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:15:04.270658 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/tractor-i/cus/tractor-custom-323919m03801.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/tractor/cus/tractor-custom-323919m03801.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/tractor/cus/brick-custom-323919m03801.sha256sum Stage writecat : Wall: 2.63 s, CPU: 1.85 s, VmPeak: 1188 MB, VmSize: 1060 MB, VmRSS: 245 MB, VmData: 267 MB, maxrss: 0.382108 MB Stage writecat finished: 2020-08-05T20:15:06.901827 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.633 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-writecat.p All done: 75.567 s worker CPU, 430.475 s worker Wall, Wall: 98.770 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Finished galaxy PGC1066682 in 1.725 minutes. Started working on galaxy PGC1066682 at Wed Aug 5 22:09:37 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.91953549999994 -3.8019237 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:09:38.071719 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.91953549999994', '-3.8019237', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.91953549999994 -3.8019237 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.91953549999994 -3.8019237 Starting process 21151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21152 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 21153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21154 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 21155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 21156 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059348 MB Starting process 21157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 21158 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 21159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 21160 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21161 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 21162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21163 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 21165 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 21166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 21167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 21168 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 21169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 21170 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 21171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 21172 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 21173 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 21174 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 21175 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 21176 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 21177 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 21178 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 21179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 21180 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 21181 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 21182 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:09:39.157673 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_180905_013602_ooi_g_ls9-S11 g expnum 768990 exptime 64.0 propid 2014B-0404 seeing 1.26 MJD 58366.067 object DECaLS_52273_g decam/CP/V4.8.2a/CP20180904/c4d_180905_013602_ooi_g_ls9.fits.fz c4d_160812_032407_ooi_z_ls9-N22 z expnum 563101 exptime 80.0 propid 2014B-0404 seeing 0.94 MJD 57612.140 object DECaLS_11778_z decam/CP/V4.8.2a/CP20160811/c4d_160812_032407_ooi_z_ls9.fits.fz c4d_140819_031214_ooi_g_ls9-N22 g expnum 349698 exptime 68.0 propid 2014B-0404 seeing 1.08 MJD 56888.132 object DECaLS_11778_g decam/CP/V4.8.2a/CP20140818/c4d_140819_031214_ooi_g_ls9.fits.fz c4d_140819_021429_ooi_r_ls9-N22 r expnum 349668 exptime 64.0 propid 2014B-0404 seeing 0.92 MJD 56888.092 object DECaLS_11778_r decam/CP/V4.8.2a/CP20140818/c4d_140819_021429_ooi_r_ls9.fits.fz c4d_181005_235712_ooi_z_ls9-S31 z expnum 780919 exptime 98.0 propid 2014B-0404 seeing 1.22 MJD 58396.998 object DECaLS_43503_z decam/CP/V4.8.2a/CP20181005/c4d_181005_235712_ooi_z_ls9.fits.fz c4d_170915_010700_ooi_r_ls9-S31 r expnum 677683 exptime 175.0 propid 2014B-0404 seeing 1.73 MJD 58011.047 object DECaLS_43503_r decam/CP/V4.8.2a/CP20170914/c4d_170915_010700_ooi_r_ls9.fits.fz c4d_180910_021336_ooi_r_ls9-S31 r expnum 771431 exptime 40.0 propid 2014B-0404 seeing 1.20 MJD 58371.093 object DECaLS_43503_r decam/CP/V4.8.2a/CP20180909/c4d_180910_021336_ooi_r_ls9.fits.fz c4d_170721_040940_ooi_r_ls9-N25 r expnum 660430 exptime 60.0 propid 2014B-0404 seeing 1.09 MJD 57955.172 object DECaLS_43522_r decam/CP/V4.8.2/CP20170720/c4d_170721_040940_ooi_r_ls9.fits.fz c4d_140815_045358_ooi_z_ls9-N25 z expnum 347989 exptime 133.0 propid 2014B-0404 seeing 0.95 MJD 56884.202 object DECaLS_43522_z decam/CP/V4.8.2a/CP20140814/c4d_140815_045358_ooi_z_ls9.fits.fz c4d_180808_032133_ooi_g_ls9-N25 g expnum 762852 exptime 200.0 propid 2014B-0404 seeing 1.98 MJD 58338.140 object DECaLS_43522_g decam/CP/V4.8.2a/CP20180807/c4d_180808_032133_ooi_g_ls9.fits.fz c4d_140817_020238_ooi_r_ls9-N25 r expnum 348735 exptime 63.0 propid 2014B-0404 seeing 1.44 MJD 56886.084 object DECaLS_43522_r decam/CP/V4.8.2a/CP20140816/c4d_140817_020238_ooi_r_ls9.fits.fz c4d_160804_040814_ooi_g_ls9-N25 g expnum 559124 exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57604.170 object DECaLS_43522_g decam/CP/V4.8.2a/CP20160803/c4d_160804_040814_ooi_g_ls9.fits.fz c4d_160609_061951_ooi_r_ls9-N26 r expnum 548375 exptime 75.0 propid 2014B-0404 seeing 1.41 MJD 57548.262 object DECaLS_27650_r decam/CP/V4.8.2a/CP20160608/c4d_160609_061951_ooi_r_ls9.fits.fz c4d_160814_032315_ooi_z_ls9-N26 z expnum 563869 exptime 80.0 propid 2014B-0404 seeing 1.15 MJD 57614.140 object DECaLS_27650_z decam/CP/V4.8.2a/CP20160813/c4d_160814_032315_ooi_z_ls9.fits.fz c4d_160804_032750_ooi_g_ls9-N26 g expnum 559111 exptime 137.0 propid 2014B-0404 seeing 1.45 MJD 57604.142 object DECaLS_27650_g decam/CP/V4.8.2a/CP20160803/c4d_160804_032750_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522538-r-20170915T010700_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T021336_oi[S31,noinherit][2046,4094][real]: DECaLS_4350 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530bc0-z-20181005T235712_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013602_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032159_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T032104_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 31 pixels with anomalously large oow values: max 0.0266948 vs median 0.00234675 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180808T032133_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140819T021233_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T045053_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T040747_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T032442_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 34 pixels with anomalously large oow values: max 1.18928 vs median 0.0221563 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T061746_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 17 pixels with anomalously large oow values: max 0.671198 vs median 0.0162697 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T040432_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954ab5b-g-20140819T031012_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T020043_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 84.58 s, CPU: 1.61 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.188852 MB Stage tims finished: 2020-08-05T22:11:03.741422 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140819T021233_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180808T032133_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T040432_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T020043_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T032442_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T061746_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 9.275 s worker CPU, 565.652 s worker Wall, Wall: 84.587 s, Cores in use: 0.13, Total efficiency (on 32 cores): 0.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522538-r-20170915T010700_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530bc0-z-20181005T235712_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T021336_oi[S31,noinherit][2046,4094][real]: DECaLS_4350 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013602_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T032104_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032159_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T22:11:04.381705 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06707.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06579.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/reference-custom-323919m03801.fits Stage refs : Wall: 11.03 s, CPU: 3.94 s, VmPeak: 1051 MB, VmSize: 1045 MB, VmRSS: 218 MB, VmData: 250 MB, maxrss: 0.223712 MB Stage refs finished: 2020-08-05T22:11:15.406818 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954ab5b-g-20140819T031012_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 11.028 s, Cores in use: 0.36, Total efficiency (on 32 cores): 1.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T22:11:15.756654 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outlier-mask-custom-323919m03801.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-pre-custom-323919m03801.jpg Image c4d_160804_040814_ooi_g_ls9-N25 g : masking 2018 positive outlier pixels and 0 negative outlier pixels Image c4d_180808_032133_ooi_g_ls9-N25 g : masking 2708 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_013602_ooi_g_ls9-S11 g : masking 14265 positive outlier pixels and 0 negative outlier pixels Image c4d_170915_010700_ooi_r_ls9-S31 r : masking 6359 positive outlier pixels and 0 negative outlier pixels Image c4d_180910_021336_ooi_r_ls9-S31 r : masking 0 positive outlier pixels and 69 negative outlier pixels Image c4d_170721_040940_ooi_r_ls9-N25 r : masking 249 positive outlier pixels and 0 negative outlier pixels Image c4d_140817_020238_ooi_r_ls9-N25 r : masking 6884 positive outlier pixels and 0 negative outlier pixels Image c4d_160812_032407_ooi_z_ls9-N22 z : masking 0 positive outlier pixels and 133 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outlier-mask-custom-323919m03801.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-post-custom-323919m03801.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-masked-pos-custom-323919m03801.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/outliers-masked-neg-custom-323919m03801.jpg Stage outliers : Wall: 1.62 s, CPU: 1.25 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.244988 MB Stage outliers finished: 2020-08-05T22:11:17.374642 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T040747_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T045053_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage outliers : 1.686 s worker CPU, 2.088 s worker Wall, Wall: 1.620 s, Cores in use: 1.82, Total efficiency (on 32 cores): 5.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:11:17.711602 Stage halos : Wall: 1.64 s, CPU: 0.38 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.245428 MB Stage halos finished: 2020-08-05T22:11:19.354342 Resources for stage halos : 0.565 s worker CPU, 4.090 s worker Wall, Wall: 1.645 s, Cores in use: 0.58, Total efficiency (on 32 cores): 1.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T22:11:19.731401 PSF sigmas in coadd pixels: ['2.04', '1.75', '3.22', '2.55', '2.36'] Using average PSF sigma 2.383310788356856 Gaussian PSF norm 0.11836257073646904 vs pixelized 0.080868274 average tim pixel scale / coadd scale: 1.001115419585542 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.49', '2.82', '1.95', '1.76', '2.34', '2.28'] Using average PSF sigma 2.1077098561569367 Gaussian PSF norm 0.1338394803012554 vs pixelized 0.09392301 average tim pixel scale / coadd scale: 1.0011664134955018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.53', '1.98', '1.54', '1.86'] Using average PSF sigma 1.72946054070394 Gaussian PSF norm 0.16311143569604514 vs pixelized 0.14008643 average tim pixel scale / coadd scale: 1.0010344548397947 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.30 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 242 MB, VmData: 268 MB, maxrss: 0.247984 MB Stage fit_on_coadds finished: 2020-08-05T22:11:20.067282 Resources for stage fit_on_coadds : 0.490 s worker CPU, 0.490 s worker Wall, Wall: 0.338 s, Cores in use: 2.33, Total efficiency (on 32 cores): 7.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:11:20.092424 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 42 potential peaks Of 42 potential peaks: 9 in veto map, 5 cut by saddle test, 0 cut by aper test, 28 kept SED z : 28 new peaks Found 36 potential peaks Of 36 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 31 potential peaks Of 31 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 48 potential peaks Of 48 potential peaks: 40 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 55 potential peaks Of 55 potential peaks: 43 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 40 new sources Median coadd sky for g : -3.1421085e-05 Median coadd sky for r : -3.3850495e-06 Median coadd sky for z : 0.000455276 Stage srcs : Wall: 2.06 s, CPU: 2.01 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 243 MB, VmData: 268 MB, maxrss: 0.24868 MB Stage srcs finished: 2020-08-05T22:11:22.155923 Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 2.066 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:11:22.250755 Blob 1 of 15, id: 0, sources: 15, size: 174x210, npix 18845, brick X: 39,213, Y: 0,210, one pixel: 141 0 Blob 2 of 15, id: 12, sources: 4, size: 90x66, npix 3016, brick X: 163,253, Y: 209,275, one pixel: 204 209 Blob 3 of 15, id: 3, sources: 4, size: 95x59, npix 2998, brick X: 179,274, Y: 14,73, one pixel: 239 14 Blob 4 of 15, id: 1, sources: 5, size: 46x93, npix 2405, brick X: 0,46, Y: 2,95, one pixel: 31 2 Blob 5 of 15, id: 2, sources: 3, size: 54x65, npix 2289, brick X: 63,117, Y: 4,69, one pixel: 83 4 Blob 6 of 15, id: 6, sources: 4, size: 64x67, npix 2085, brick X: 211,275, Y: 99,166, one pixel: 266 99 Blob 7 of 15, id: 13, sources: 3, size: 81x32, npix 1626, brick X: 80,161, Y: 243,275, one pixel: 90 243 Blob 8 of 15, id: 5, sources: 1, size: 41x43, npix 1104, brick X: 200,241, Y: 74,117, one pixel: 218 74 Blob 9 of 15, id: 9, sources: 2, size: 41x39, npix 822, brick X: 205,246, Y: 182,221, one pixel: 215 182 Blob 10 of 15, id: 10, sources: 2, size: 31x37, npix 698, brick X: 17,48, Y: 199,236, one pixel: 33 199 Blob 11 of 15, id: 8, sources: 1, size: 25x28, npix 451, brick X: 30,55, Y: 141,169, one pixel: 41 141 Blob 12 of 15, id: 11, sources: 1, size: 21x21, npix 269, brick X: 244,265, Y: 205,226, one pixel: 252 205 Blob 13 of 15, id: 14, sources: 1, size: 23x15, npix 234, brick X: 8,31, Y: 260,275, one pixel: 18 260 Blob 14 of 15, id: 7, sources: 1, size: 14x22, npix 206, brick X: 0,14, Y: 101,123, one pixel: 1 101 Blob 15 of 15, id: 4, sources: 1, size: 18x18, npix 171, brick X: 34,52, Y: 49,67, one pixel: 42 49 Blob 15 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150564 MB Blob 12 finished, total: Wall: 0.33 s, CPU: 0.32 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150296 MB Blob 14 finished, total: Wall: 0.53 s, CPU: 0.51 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149308 MB Blob 11 finished, total: Wall: 0.76 s, CPU: 0.74 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.095764 MB Blob 13 finished, total: Wall: 0.77 s, CPU: 0.76 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.11562 MB Blob 10 finished, total: Wall: 1.34 s, CPU: 1.32 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149644 MB Blob 8 finished, total: Wall: 1.38 s, CPU: 1.36 s, VmPeak: 952 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156584 MB Blob 9 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099156 MB Blob 7 finished, total: Wall: 1.84 s, CPU: 1.83 s, VmPeak: 958 MB, VmSize: 738 MB, VmRSS: 154 MB, VmData: 187 MB, maxrss: 0.15738 MB Measuring 2 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.74 s, CPU: 2.73 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.10058 MB Blob 6 finished, total: Wall: 3.03 s, CPU: 3.02 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151356 MB Measuring 1 iterative sources Measuring 3 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.93005, -3.80845), pm (-4.6, -6.4), parallax 0.696 with NanoMaggies: g=17.2, r=17.3, z=16.2 Reset brightness to NanoMaggies: g=17.1, r=16.4, z=16.1 Blob 4 finished, total: Wall: 3.23 s, CPU: 3.21 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.117272 MB Blob 3 finished, total: Wall: 3.38 s, CPU: 3.36 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.116684 MB Blob 2 finished, total: Wall: 4.18 s, CPU: 4.16 s, VmPeak: 922 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14944 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.72047, ee1=-0.532658, ee2=-0.493152 Measuring 6 iterative sources Blob 1 finished, total: Wall: 17.29 s, CPU: 17.29 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 160 MB, VmData: 187 MB, maxrss: 0.163444 MB Old catalog: 51 New catalog: 56 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/blobs-custom-323919m03801.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/metrics/cus/all-models-custom-323919m03801.fits Stage fitblobs : Wall: 18.64 s, CPU: 1.26 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 243 MB, VmData: 268 MB, maxrss: 0.2491 MB Stage fitblobs finished: 2020-08-05T22:11:40.889288 Resources for stage fitblobs : 42.315 s worker CPU, 43.010 s worker Wall, Wall: 18.641 s, Cores in use: 2.34, Total efficiency (on 32 cores): 7.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:11:40.906965 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-resid.jpg Stage coadds : Wall: 4.25 s, CPU: 1.30 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 244 MB, VmData: 268 MB, maxrss: 0.249552 MB Stage coadds finished: 2020-08-05T22:11:45.156894 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 28.953 s worker CPU, 54.586 s worker Wall, Wall: 4.252 s, Cores in use: 7.11, Total efficiency (on 32 cores): 22.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T22:11:45.172118 Cut to 2 unWISE tiles Reading WISE tile 3235m046 band 2 Reading WISE tile 3235m046 band 1 Reading WISE tile 3235m046 band 3 Reading WISE tile 3235m046 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 956 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.203776 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 953 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.203452 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.17 s, VmPeak: 952 MB, VmSize: 811 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.18854 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 956 MB, VmSize: 804 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.205648 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.37 s, CPU: 0.48 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 244 MB, VmData: 268 MB, maxrss: 0.250256 MB Stage wise_forced finished: 2020-08-05T22:11:49.546161 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 6.217 s worker CPU, 10.969 s worker Wall, Wall: 4.376 s, Cores in use: 1.53, Total efficiency (on 32 cores): 4.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:11:49.587255 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/tractor-i/cus/tractor-custom-323919m03801.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/tractor/cus/tractor-custom-323919m03801.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/tractor/cus/brick-custom-323919m03801.sha256sum Stage writecat : Wall: 0.93 s, CPU: 0.70 s, VmPeak: 1188 MB, VmSize: 1060 MB, VmRSS: 246 MB, VmData: 268 MB, maxrss: 0.383132 MB Stage writecat finished: 2020-08-05T22:11:50.516975 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.932 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1066682/PGC1066682-largegalaxy-writecat.p All done: 89.593 s worker CPU, 680.978 s worker Wall, Wall: 131.384 s, Cores in use: 0.78, Total efficiency (on 32 cores): 2.5 % Finished galaxy PGC1066682 in 2.228 minutes. Started working on galaxy PGC1066682 at Mon Aug 10 09:13:58 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.9190262669082 -3.801636026787958 --width 275 --height 275 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T09:13:59.672666 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.9190262669082', '-3.801636026787958', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.9190262669082 -3.801636026787958 --width 275 --height 275 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.9190262669082 -3.801636026787958 Starting process 55536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 55537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 55538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 55539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 55540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 55541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 55542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 55543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T09:14:00.296098 Keeping 15 CCDs: c4d_180905_013602_ooi_g_ls9-S11 g expnum 768990 exptime 64.0 propid 2014B-0404 seeing 1.26 MJD 58366.067 object DECaLS_52273_g decam/CP/V4.8.2a/CP20180904/c4d_180905_013602_ooi_g_ls9.fits.fz c4d_160812_032407_ooi_z_ls9-N22 z expnum 563101 exptime 80.0 propid 2014B-0404 seeing 0.94 MJD 57612.140 object DECaLS_11778_z decam/CP/V4.8.2a/CP20160811/c4d_160812_032407_ooi_z_ls9.fits.fz c4d_140819_031214_ooi_g_ls9-N22 g expnum 349698 exptime 68.0 propid 2014B-0404 seeing 1.08 MJD 56888.132 object DECaLS_11778_g decam/CP/V4.8.2a/CP20140818/c4d_140819_031214_ooi_g_ls9.fits.fz c4d_140819_021429_ooi_r_ls9-N22 r expnum 349668 exptime 64.0 propid 2014B-0404 seeing 0.92 MJD 56888.092 object DECaLS_11778_r decam/CP/V4.8.2a/CP20140818/c4d_140819_021429_ooi_r_ls9.fits.fz c4d_181005_235712_ooi_z_ls9-S31 z expnum 780919 exptime 98.0 propid 2014B-0404 seeing 1.22 MJD 58396.998 object DECaLS_43503_z decam/CP/V4.8.2a/CP20181005/c4d_181005_235712_ooi_z_ls9.fits.fz c4d_170915_010700_ooi_r_ls9-S31 r expnum 677683 exptime 175.0 propid 2014B-0404 seeing 1.73 MJD 58011.047 object DECaLS_43503_r decam/CP/V4.8.2a/CP20170914/c4d_170915_010700_ooi_r_ls9.fits.fz c4d_180910_021336_ooi_r_ls9-S31 r expnum 771431 exptime 40.0 propid 2014B-0404 seeing 1.20 MJD 58371.093 object DECaLS_43503_r decam/CP/V4.8.2a/CP20180909/c4d_180910_021336_ooi_r_ls9.fits.fz c4d_170721_040940_ooi_r_ls9-N25 r expnum 660430 exptime 60.0 propid 2014B-0404 seeing 1.09 MJD 57955.172 object DECaLS_43522_r decam/CP/V4.8.2/CP20170720/c4d_170721_040940_ooi_r_ls9.fits.fz c4d_140815_045358_ooi_z_ls9-N25 z expnum 347989 exptime 133.0 propid 2014B-0404 seeing 0.95 MJD 56884.202 object DECaLS_43522_z decam/CP/V4.8.2a/CP20140814/c4d_140815_045358_ooi_z_ls9.fits.fz c4d_180808_032133_ooi_g_ls9-N25 g expnum 762852 exptime 200.0 propid 2014B-0404 seeing 1.98 MJD 58338.140 object DECaLS_43522_g decam/CP/V4.8.2a/CP20180807/c4d_180808_032133_ooi_g_ls9.fits.fz c4d_140817_020238_ooi_r_ls9-N25 r expnum 348735 exptime 63.0 propid 2014B-0404 seeing 1.44 MJD 56886.084 object DECaLS_43522_r decam/CP/V4.8.2a/CP20140816/c4d_140817_020238_ooi_r_ls9.fits.fz c4d_160804_040814_ooi_g_ls9-N25 g expnum 559124 exptime 175.0 propid 2014B-0404 seeing 1.57 MJD 57604.170 object DECaLS_43522_g decam/CP/V4.8.2a/CP20160803/c4d_160804_040814_ooi_g_ls9.fits.fz c4d_160609_061951_ooi_r_ls9-N26 r expnum 548375 exptime 75.0 propid 2014B-0404 seeing 1.41 MJD 57548.262 object DECaLS_27650_r decam/CP/V4.8.2a/CP20160608/c4d_160609_061951_ooi_r_ls9.fits.fz c4d_160814_032315_ooi_z_ls9-N26 z expnum 563869 exptime 80.0 propid 2014B-0404 seeing 1.15 MJD 57614.140 object DECaLS_27650_z decam/CP/V4.8.2a/CP20160813/c4d_160814_032315_ooi_z_ls9.fits.fz c4d_160804_032750_ooi_g_ls9-N26 g expnum 559111 exptime 137.0 propid 2014B-0404 seeing 1.45 MJD 57604.142 object DECaLS_27650_g decam/CP/V4.8.2a/CP20160803/c4d_160804_032750_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522538-r-20170915T010700_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T021336_oi[S31,noinherit][2046,4094][real]: DECaLS_4350 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013602_oi[S11,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032159_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530bc0-z-20181005T235712_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T040747_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140819T021233_oi[N22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954ab5b-g-20140819T031012_oi[N22,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T045053_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180808T032133_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T020043_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T032104_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 31 pixels with anomalously large oow values: max 0.0229487 vs median 0.00234675 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T061746_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 17 pixels with anomalously large oow values: max 0.671198 vs median 0.0162697 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T040432_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T032442_oi[N26,noinherit][2046,4094][real]: DECaLS_ Clipping 35 pixels with anomalously large oow values: max 0.873399 vs median 0.0221563 Stage tims : Wall: 79.48 s, CPU: 1.08 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 183 MB, VmData: 216 MB, maxrss: 0.186904 MB Stage tims finished: 2020-08-10T09:15:19.780432 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954ab5b-g-20140819T031012_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954cb27-z-20140815T045053_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140819T021233_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180808T032133_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530bc0-z-20181005T235712_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T020043_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180910T021336_oi[S31,noinherit][2046,4094][real]: DECaLS_4350 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95488c8-z-20160814T032104_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032159_oi[N22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T040432_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170721T040747_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95694a0-r-20160609T061746_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013602_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160804T032442_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.069 s worker CPU, 503.988 s worker Wall, Wall: 79.486 s, Cores in use: 0.10, Total efficiency (on 8 cores): 1.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522538-r-20170915T010700_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T09:15:19.816533 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06707.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06579.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/reference-custom-323919m03801.fits Stage refs : Wall: 9.77 s, CPU: 3.42 s, VmPeak: 1045 MB, VmSize: 1039 MB, VmRSS: 217 MB, VmData: 249 MB, maxrss: 0.221784 MB Stage refs finished: 2020-08-10T09:15:29.581783 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.766 s, Cores in use: 0.35, Total efficiency (on 8 cores): 4.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T09:15:29.616487 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/outlier-mask-custom-323919m03801.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/outliers-pre-custom-323919m03801.jpg Image c4d_180905_013602_ooi_g_ls9-S11 g : masking 13500 positive outlier pixels and 160 negative outlier pixels Image c4d_160804_040814_ooi_g_ls9-N25 g : masking 2179 positive outlier pixels and 0 negative outlier pixels Image c4d_180808_032133_ooi_g_ls9-N25 g : masking 3405 positive outlier pixels and 0 negative outlier pixels Image c4d_170721_040940_ooi_r_ls9-N25 r : masking 183 positive outlier pixels and 0 negative outlier pixels Image c4d_170915_010700_ooi_r_ls9-S31 r : masking 5879 positive outlier pixels and 0 negative outlier pixels Image c4d_140817_020238_ooi_r_ls9-N25 r : masking 6282 positive outlier pixels and 0 negative outlier pixels Image c4d_160812_032407_ooi_z_ls9-N22 z : masking 0 positive outlier pixels and 144 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/outlier-mask-custom-323919m03801.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/outliers-post-custom-323919m03801.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/outliers-masked-pos-custom-323919m03801.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/outliers-masked-neg-custom-323919m03801.jpg Stage outliers : Wall: 1.37 s, CPU: 1.08 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 236 MB, VmData: 266 MB, maxrss: 0.242024 MB Stage outliers finished: 2020-08-10T09:15:30.982040 Resources for stage outliers : 1.627 s worker CPU, 1.635 s worker Wall, Wall: 1.367 s, Cores in use: 1.98, Total efficiency (on 8 cores): 24.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T09:15:31.195882 Stage halos : Wall: 1.31 s, CPU: 0.34 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 237 MB, VmData: 266 MB, maxrss: 0.242616 MB Stage halos finished: 2020-08-10T09:15:32.510544 Resources for stage halos : 0.409 s worker CPU, 3.167 s worker Wall, Wall: 1.316 s, Cores in use: 0.57, Total efficiency (on 8 cores): 7.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T09:15:32.839995 PSF sigmas in coadd pixels: ['2.04', '1.75', '3.22', '2.55', '2.36'] Using average PSF sigma 2.383310788356856 Gaussian PSF norm 0.11836257073646904 vs pixelized 0.08086807 average tim pixel scale / coadd scale: 1.001115419585542 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.49', '2.82', '1.95', '1.76', '2.34', '2.28'] Using average PSF sigma 2.1077098561569367 Gaussian PSF norm 0.1338394803012554 vs pixelized 0.09392171 average tim pixel scale / coadd scale: 1.0011664134955018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.53', '1.98', '1.54', '1.86'] Using average PSF sigma 1.72946054070394 Gaussian PSF norm 0.16311143569604514 vs pixelized 0.1400847 average tim pixel scale / coadd scale: 1.0010344548397947 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.56 s, CPU: 0.27 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.245312 MB Stage fit_on_coadds finished: 2020-08-10T09:15:34.397707 Resources for stage fit_on_coadds : 0.482 s worker CPU, 0.492 s worker Wall, Wall: 1.559 s, Cores in use: 0.48, Total efficiency (on 8 cores): 6.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T09:15:34.413011 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 43 potential peaks Of 43 potential peaks: 10 in veto map, 6 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 35 potential peaks Of 35 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 32 potential peaks Of 32 potential peaks: 25 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 48 potential peaks Of 48 potential peaks: 39 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 59 potential peaks Of 59 potential peaks: 44 in veto map, 11 cut by saddle test, 0 cut by aper test, 4 kept SED Red : 4 new peaks Adding 40 new sources Median coadd sky for g : -4.1252013e-05 Median coadd sky for r : -1.3542671e-05 Median coadd sky for z : 0.00041128916 Stage srcs : Wall: 0.68 s, CPU: 0.63 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.246032 MB Stage srcs finished: 2020-08-10T09:15:35.091167 Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 0.679 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T09:15:35.119025 Blob 1 of 16, id: 1, sources: 14, size: 174x207, npix 18591, brick X: 32,206, Y: 0,207, one pixel: 133 0 Blob 2 of 16, id: 3, sources: 4, size: 95x59, npix 2996, brick X: 172,267, Y: 10,69, one pixel: 233 10 Blob 3 of 16, id: 12, sources: 4, size: 90x67, npix 2993, brick X: 156,246, Y: 205,272, one pixel: 197 205 Blob 4 of 16, id: 7, sources: 5, size: 71x83, npix 2401, brick X: 204,275, Y: 79,162, one pixel: 263 79 Blob 5 of 16, id: 2, sources: 3, size: 54x64, npix 2288, brick X: 56,110, Y: 1,65, one pixel: 74 1 Blob 6 of 16, id: 13, sources: 3, size: 82x36, npix 1849, brick X: 73,155, Y: 239,275, one pixel: 83 239 Blob 7 of 16, id: 0, sources: 4, size: 39x61, npix 1268, brick X: 0,39, Y: 0,61, one pixel: 23 0 Blob 8 of 16, id: 6, sources: 1, size: 41x43, npix 1103, brick X: 193,234, Y: 70,113, one pixel: 211 70 Blob 9 of 16, id: 9, sources: 2, size: 41x39, npix 822, brick X: 198,239, Y: 178,217, one pixel: 208 178 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.93005, -3.80845), pm (-4.6, -6.4), parallax 0.696 with NanoMaggies: g=17.7, r=17.8, z=16.3 Reset brightness to NanoMaggies: g=17.1, r=16.4, z=16.1 Blob 8 finished, total: Wall: 2.01 s, CPU: 2.00 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148132 MB Blob 10 of 16, id: 10, sources: 2, size: 31x37, npix 707, brick X: 10,41, Y: 195,232, one pixel: 26 195 Blob 6 finished, total: Wall: 2.14 s, CPU: 1.98 s, VmPeak: 958 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148332 MB Blob 11 of 16, id: 5, sources: 1, size: 24x29, npix 514, brick X: 0,24, Y: 62,91, one pixel: 7 62 Blob 7 finished, total: Wall: 2.71 s, CPU: 2.57 s, VmPeak: 964 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145452 MB Blob 12 of 16, id: 8, sources: 1, size: 25x28, npix 460, brick X: 23,48, Y: 137,165, one pixel: 34 137 Measuring 2 iterative sources Measuring 1 iterative sources Blob 10 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 958 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148332 MB Blob 13 of 16, id: 14, sources: 1, size: 31x19, npix 404, brick X: 0,31, Y: 256,275, one pixel: 10 256 Blob 9 finished, total: Wall: 1.90 s, CPU: 1.90 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148132 MB Blob 14 of 16, id: 11, sources: 1, size: 21x21, npix 270, brick X: 237,258, Y: 201,222, one pixel: 245 201 Measuring 3 iterative sources Blob 5 finished, total: Wall: 4.13 s, CPU: 4.11 s, VmPeak: 968 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15082 MB Blob 15 of 16, id: 15, sources: 1, size: 18x18, npix 203, brick X: 64,82, Y: 257,275, one pixel: 72 257 Blob 4 finished, total: Wall: 4.37 s, CPU: 4.37 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148392 MB Blob 16 of 16, id: 4, sources: 1, size: 18x18, npix 171, brick X: 27,45, Y: 45,63, one pixel: 35 45 Blob 12 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 958 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148332 MB Blob 11 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 964 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14724 MB Blob 14 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 968 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15082 MB Blob 16 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 958 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148332 MB Blob 15 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148392 MB Blob 13 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148132 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 5.23 s, CPU: 5.23 s, VmPeak: 964 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14538 MB Blob 3 finished, total: Wall: 5.36 s, CPU: 5.36 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.1457 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.55941, ee1=-0.489866, ee2=-0.452624 Measuring 4 iterative sources Blob 1 finished, total: Wall: 17.58 s, CPU: 17.57 s, VmPeak: 968 MB, VmSize: 727 MB, VmRSS: 151 MB, VmData: 182 MB, maxrss: 0.154384 MB Old catalog: 51 New catalog: 53 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/blobs-custom-323919m03801.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/metrics/cus/all-models-custom-323919m03801.fits Stage fitblobs : Wall: 18.03 s, CPU: 0.45 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.246452 MB Stage fitblobs finished: 2020-08-10T09:15:53.152158 Resources for stage fitblobs : 50.879 s worker CPU, 51.304 s worker Wall, Wall: 18.034 s, Cores in use: 2.85, Total efficiency (on 8 cores): 35.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T09:15:53.167680 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-resid.jpg Stage coadds : Wall: 1.52 s, CPU: 0.68 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.246904 MB Stage coadds finished: 2020-08-10T09:15:54.690044 Resources for stage coadds : 4.356 s worker CPU, 4.725 s worker Wall, Wall: 1.523 s, Cores in use: 3.31, Total efficiency (on 8 cores): 41.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T09:15:54.703772 Cut to 2 unWISE tiles Reading WISE tile 3235m046 band 1 Reading WISE tile 3235m046 band 2 Reading WISE tile 3235m046 band 3 Reading WISE tile 3235m046 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 965 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 172 MB, maxrss: 0.20566 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m046/unwise-3235m046-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 3236m031 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.16 s, VmPeak: 968 MB, VmSize: 809 MB, VmRSS: 154 MB, VmData: 180 MB, maxrss: 0.192388 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 958 MB, VmSize: 802 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.208688 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3236m031/unwise-3236m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 964 MB, VmSize: 802 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.208344 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/tmp-legacysurvey-custom-323919m03801-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.81 s, CPU: 0.62 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 242 MB, VmData: 267 MB, maxrss: 0.247608 MB Stage wise_forced finished: 2020-08-10T09:15:58.512680 Resources for stage wise_forced : 6.429 s worker CPU, 9.355 s worker Wall, Wall: 3.810 s, Cores in use: 1.85, Total efficiency (on 8 cores): 23.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T09:15:58.530403 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/coadd/cus/custom-323919m03801/legacysurvey-custom-323919m03801-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/tractor-i/cus/tractor-custom-323919m03801.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/tractor/cus/tractor-custom-323919m03801.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/tractor/cus/brick-custom-323919m03801.sha256sum Stage writecat : Wall: 1.08 s, CPU: 0.84 s, VmPeak: 1181 MB, VmSize: 1053 MB, VmRSS: 244 MB, VmData: 267 MB, maxrss: 0.380468 MB Stage writecat finished: 2020-08-10T09:15:59.610921 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.082 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1066682/PGC1066682-largegalaxy-writecat.p All done: 71.347 s worker CPU, 574.764 s worker Wall, Wall: 119.467 s, Cores in use: 0.68, Total efficiency (on 8 cores): 8.5 % Finished galaxy PGC1066682 in 2.032 minutes.