Started working on galaxy PGC540647 at Wed Aug 5 19:31:21 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.085359000000004 -44.1230048 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:31:22.616823 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '33.085359000000004', '-44.1230048', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.085359000000004 -44.1230048 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 33.085359000000004 -44.1230048 Starting process 53279 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 53280 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 53281 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 53282 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 53283 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB Starting process 53284 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 53285 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 53286 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 53287 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 53288 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 53289 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 53290 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 53291 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 53292 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 53293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 53294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:31:23.385633 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 27 CCDs: c4d_180105_033253_ooi_z_v1-S23 z expnum 709556 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58123.148 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20180104/c4d_180105_033253_ooi_z_v1.fits.fz c4d_131123_061830_ooi_z_ls9-S26 z expnum 257595 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56619.263 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131122/c4d_131123_061830_ooi_z_ls9.fits.fz c4d_131028_040654_ooi_g_ls9-S26 g expnum 247570 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 56593.171 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131027/c4d_131028_040654_ooi_g_ls9.fits.fz c4d_131203_034718_ooi_r_ls9-S26 r expnum 259863 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56629.156 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131202/c4d_131203_034718_ooi_r_ls9.fits.fz c4d_180105_033253_ooi_z_v1-S17 z expnum 709556 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58123.148 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20180104/c4d_180105_033253_ooi_z_v1.fits.fz c4d_171215_043459_ooi_g_v1-S17 g expnum 705233 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58102.191 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20171214/c4d_171215_043459_ooi_g_v1.fits.fz c4d_171215_043301_ooi_r_v1-S17 r expnum 705232 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58102.190 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20171214/c4d_171215_043301_ooi_r_v1.fits.fz c4d_131015_043103_ooi_z_ls9-N1 z expnum 244257 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56580.188 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20131014/c4d_131015_043103_ooi_z_ls9.fits.fz c4d_140102_031617_ooi_r_ls9-N1 r expnum 270625 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56659.135 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20140101/c4d_140102_031617_ooi_r_ls9.fits.fz c4d_131207_053327_ooi_g_ls9-N1 g expnum 261275 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 56633.230 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20131206/c4d_131207_053327_ooi_g_ls9.fits.fz c4d_160901_075622_ooi_g_ls9-N14 g expnum 569919 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57632.329 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160831/c4d_160901_075622_ooi_g_ls9.fits.fz c4d_160901_075425_ooi_r_ls9-N14 r expnum 569918 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 57632.328 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160831/c4d_160901_075425_ooi_r_ls9.fits.fz c4d_160816_060422_ooi_z_ls9-N14 z expnum 565108 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57616.251 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160815/c4d_160816_060422_ooi_z_ls9.fits.fz c4d_131112_055509_ooi_z_ls9-S7 z expnum 253206 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56608.247 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131111/c4d_131112_055509_ooi_z_ls9.fits.fz c4d_131004_073639_ooi_r_ls9-S7 r expnum 241202 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56569.317 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131003/c4d_131004_073639_ooi_r_ls9.fits.fz c4d_131004_073440_ooi_g_ls9-S7 g expnum 241201 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 56569.316 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131003/c4d_131004_073440_ooi_g_ls9.fits.fz c4d_140113_024107_ooi_z_ls9-N22 z expnum 273683 exptime 90.0 propid 2012B-0001 seeing 0.75 MJD 56670.110 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20140112/c4d_140113_024107_ooi_z_ls9.fits.fz c4d_140122_022529_ooi_r_ls9-N22 r expnum 276711 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56679.099 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20140121/c4d_140122_022529_ooi_r_ls9.fits.fz c4d_131012_082858_ooi_g_ls9-N22 g expnum 243267 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56577.353 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20131011/c4d_131012_082858_ooi_g_ls9.fits.fz c4d_161006_022724_ooi_r_ls9-N21 r expnum 581247 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57667.101 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2a/CP20161005/c4d_161006_022724_ooi_r_ls9.fits.fz c4d_161006_022527_ooi_z_ls9-N21 z expnum 581246 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57667.099 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2a/CP20161005/c4d_161006_022527_ooi_z_ls9.fits.fz c4d_161107_062136_ooi_g_ls9-N21 g expnum 590684 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57699.263 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2/CP20161106/c4d_161107_062136_ooi_g_ls9.fits.fz c4d_171013_074328_ooi_z_v1-S22 z expnum 686592 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 58039.322 object DES survey hex 317-450 tiling 7 decam/CP/V4.1/CP20171012/c4d_171013_074328_ooi_z_v1.fits.fz c4d_161230_015300_ooi_g_ls9-S22 g expnum 605249 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57752.077 object DES survey hex 317-450 tiling 7 decam/CP/V4.8.2/CP20161229/c4d_161230_015300_ooi_g_ls9.fits.fz c4d_161230_015106_ooi_r_ls9-S22 r expnum 605248 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57752.076 object DES survey hex 317-450 tiling 7 decam/CP/V4.8.2/CP20161229/c4d_161230_015106_ooi_r_ls9.fits.fz c4d_171209_041247_ooi_g_v1-S2 g expnum 703167 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58096.176 object DES survey hex 342-440 tiling 8 decam/CP/V4.1/CP20171208/c4d_171209_041247_ooi_g_v1.fits.fz c4d_171128_041326_ooi_z_v1-S2 z expnum 700652 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 58085.176 object DES survey hex 342-440 tiling 8 decam/CP/V4.1/CP20171127/c4d_171128_041326_ooi_z_v1.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_963601c-z-20131123T061830_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635a72-r-20131203T034451_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131004T073440_oi[S7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-g-20171215T043459_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9637808-g-20131207T053105_oi[N1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633ba2-r-20131004T073639_oi[S7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20180103_908c72f-z-20180105T033253_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-r-20171215T043301_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T031355_oi[N1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T043103_oi[N1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633f34-z-20131112T055509_oi[S7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9629c28-r-20160901T075204_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160901T075403_oi[N14,noinherit][2046,4094][real]: DES sur Clipping 2 pixels with anomalously large oow values: max 0.062045 vs median 0.0469693 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612fa3-z-20140113T023843_oi[N22,noinherit][2046,4094][real]: DES sur Zeroing out 3430 weight-map pixels below quantization error (= median 7.36e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3416 weight-map pixels below quantization error (= median 4.01e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3430 weight-map pixels below quantization error (= median 0.000303) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131012T082858_oi[N22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962efdd-r-20161006T022506_oi[N21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961262c-r-20140122T022307_oi[N22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161107T061919_oi[N21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d18b-z-20161006T022307_oi[N21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171009_8fce7df-z-20171013T074328_oi[S22,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T041247_oi[S2,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9507868-r-20161230T014844_oi[S22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171128T041326_oi[S2,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950820e-g-20161230T015043_oi[S22,noinherit][2046,4094][real]: DES sur Clipping 4 pixels with anomalously large oow values: max 0.0605492 vs median 0.0448317 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131028T040654_oi[S26,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T060204_oi[N14,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 88.39 s, CPU: 1.67 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 192 MB, VmData: 224 MB, maxrss: 0.196176 MB Stage tims finished: 2020-08-05T19:32:51.776027 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T031355_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633ba2-r-20131004T073639_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9629c28-r-20160901T075204_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612fa3-z-20140113T023843_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-r-20171215T043301_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961262c-r-20140122T022307_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Zeroing out 3416 weight-map pixels below quantization error (= median 3.96e-06) Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635a72-r-20131203T034451_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171009_8fce7df-z-20171013T074328_oi[S22,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20180103_908c72f-z-20180105T033253_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131012T082858_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Zeroing out 1 weight-map pixels below quantization error (= median 0.000226) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T043103_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T041247_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Zeroing out 1 weight-map pixels below quantization error (= median 2.9e-06) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131004T073440_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171128T041326_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_963601c-z-20131123T061830_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161107T061919_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-g-20171215T043459_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962efdd-r-20161006T022506_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633f34-z-20131112T055509_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950820e-g-20161230T015043_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160901T075403_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9507868-r-20161230T014844_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131028T040654_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 13.500 s worker CPU, 1010.060 s worker Wall, Wall: 88.392 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T060204_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9637808-g-20131207T053105_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d18b-z-20161006T022307_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Running stage refs at 2020-08-05T19:32:52.140674 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10315.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10438.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10439.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/reference-custom-033085m44123.fits Stage refs : Wall: 5.85 s, CPU: 1.73 s, VmPeak: 1046 MB, VmSize: 1028 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.210436 MB Stage refs finished: 2020-08-05T19:32:57.995203 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.856 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:32:58.046040 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outlier-mask-custom-033085m44123.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-pre-custom-033085m44123.jpg Image c4d_171215_043459_ooi_g_v1-S17 g : masking 423 positive outlier pixels and 0 negative outlier pixels Image c4d_131028_040654_ooi_g_ls9-S26 g : masking 0 positive outlier pixels and 143 negative outlier pixels Image c4d_160901_075622_ooi_g_ls9-N14 g : masking 0 positive outlier pixels and 55 negative outlier pixels Image c4d_131203_034718_ooi_r_ls9-S26 r : masking 2223 positive outlier pixels and 111 negative outlier pixels Image c4d_161230_015106_ooi_r_ls9-S22 r : masking 0 positive outlier pixels and 101 negative outlier pixels Image c4d_160901_075425_ooi_r_ls9-N14 r : masking 155 positive outlier pixels and 0 negative outlier pixels Image c4d_131004_073639_ooi_r_ls9-S7 r : masking 625 positive outlier pixels and 189 negative outlier pixels Image c4d_140113_024107_ooi_z_ls9-N22 z : masking 283 positive outlier pixels and 0 negative outlier pixels Image c4d_171013_074328_ooi_z_v1-S22 z : masking 0 positive outlier pixels and 48 negative outlier pixels Image c4d_160816_060422_ooi_z_ls9-N14 z : masking 261 positive outlier pixels and 0 negative outlier pixels Image c4d_171128_041326_ooi_z_v1-S2 z : masking 563 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outlier-mask-custom-033085m44123.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-post-custom-033085m44123.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-masked-pos-custom-033085m44123.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-masked-neg-custom-033085m44123.jpg Stage outliers : Wall: 1.77 s, CPU: 1.58 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 229 MB, VmData: 258 MB, maxrss: 0.234928 MB Stage outliers finished: 2020-08-05T19:32:59.817835 Resources for stage outliers : 1.780 s worker CPU, 1.780 s worker Wall, Wall: 1.773 s, Cores in use: 1.89, Total efficiency (on 16 cores): 11.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:32:59.923910 Stage halos : Wall: 0.66 s, CPU: 0.66 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235356 MB Stage halos finished: 2020-08-05T19:33:00.581824 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.659 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:33:00.631381 PSF sigmas in coadd pixels: ['2.42', '2.02', '1.95', '1.81', '1.90', '1.71', '1.81', '2.20', '2.01'] Using average PSF sigma 1.9801649423466425 Gaussian PSF norm 0.14246024951819158 vs pixelized 0.123396955 average tim pixel scale / coadd scale: 1.001060473330973 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.54', '1.94', '1.79', '1.90', '1.79', '1.77', '1.80', '2.18'] Using average PSF sigma 1.9622684586171428 Gaussian PSF norm 0.1437595302187536 vs pixelized 0.13142802 average tim pixel scale / coadd scale: 1.0010799309634248 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.51', '1.59', '1.67', '1.79', '1.23', '1.64', '1.86', '1.82'] Using average PSF sigma 1.6393292909160833 Gaussian PSF norm 0.17207939450422383 vs pixelized 0.15406284 average tim pixel scale / coadd scale: 1.0010372791332653 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.237192 MB Stage fit_on_coadds finished: 2020-08-05T19:33:00.965947 Resources for stage fit_on_coadds : 0.404 s worker CPU, 0.404 s worker Wall, Wall: 0.336 s, Cores in use: 2.16, Total efficiency (on 16 cores): 13.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:33:00.979482 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 2 in veto map, 4 cut by saddle test, 0 cut by aper test, 26 kept SED z : 26 new peaks Found 43 potential peaks Of 43 potential peaks: 28 in veto map, 4 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 39 potential peaks Of 39 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 50 potential peaks Of 50 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 51 potential peaks Of 51 potential peaks: 47 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 45 new sources Median coadd sky for g : -0.00010364413 Median coadd sky for r : -9.891669e-05 Median coadd sky for z : -2.454544e-05 Stage srcs : Wall: 1.57 s, CPU: 1.52 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.237796 MB Stage srcs finished: 2020-08-05T19:33:02.552490 Resources for stage srcs : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 1.574 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:33:02.570127 Blob 1 of 12, id: 4, sources: 17, size: 173x195, npix 13858, brick X: 51,224, Y: 48,243, one pixel: 133 48 Blob 2 of 12, id: 0, sources: 11, size: 115x89, npix 5346, brick X: 0,115, Y: 0,89, one pixel: 1 0 Blob 3 of 12, id: 9, sources: 6, size: 57x92, npix 2680, brick X: 184,241, Y: 151,243, one pixel: 194 151 Blob 4 of 12, id: 5, sources: 3, size: 40x63, npix 1688, brick X: 205,245, Y: 59,122, one pixel: 224 59 Blob 5 of 12, id: 1, sources: 1, size: 43x40, npix 1093, brick X: 126,169, Y: 2,42, one pixel: 134 2 Blob 6 of 12, id: 6, sources: 3, size: 55x36, npix 1014, brick X: 0,55, Y: 83,119, one pixel: 43 83 Blob 7 of 12, id: 8, sources: 2, size: 33x35, npix 573, brick X: 52,85, Y: 131,166, one pixel: 73 131 Blob 8 of 12, id: 7, sources: 1, size: 22x35, npix 553, brick X: 0,22, Y: 122,157, one pixel: 4 122 Blob 9 of 12, id: 2, sources: 1, size: 25x25, npix 411, brick X: 169,194, Y: 25,50, one pixel: 179 25 Blob 10 of 12, id: 3, sources: 1, size: 25x25, npix 367, brick X: 188,213, Y: 46,71, one pixel: 200 46 Blob 11 of 12, id: 11, sources: 1, size: 23x25, npix 363, brick X: 39,62, Y: 202,227, one pixel: 49 202 Blob 12 of 12, id: 10, sources: 1, size: 23x22, npix 292, brick X: 3,26, Y: 165,187, one pixel: 15 165 Blob 7 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 995 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150384 MB Blob 9 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 970 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.146988 MB Measuring 1 iterative sources Blob 12 finished, total: Wall: 0.81 s, CPU: 0.80 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147588 MB Blob 10 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 1034 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148212 MB Blob 11 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 1027 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148308 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.34 s, CPU: 1.33 s, VmPeak: 999 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150292 MB Blob 8 finished, total: Wall: 1.35 s, CPU: 1.34 s, VmPeak: 994 MB, VmSize: 734 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148564 MB Blob 6 finished, total: Wall: 1.62 s, CPU: 1.61 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148012 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.94 s, CPU: 2.94 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148132 MB Blob 3 finished, total: Wall: 4.33 s, CPU: 4.32 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149316 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 9.06 s, CPU: 9.05 s, VmPeak: 970 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155776 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.50083, ee1=0.431338, ee2=-0.972671 Measuring 7 iterative sources Blob 1 finished, total: Wall: 18.12 s, CPU: 18.11 s, VmPeak: 956 MB, VmSize: 733 MB, VmRSS: 153 MB, VmData: 182 MB, maxrss: 0.156764 MB Old catalog: 49 New catalog: 57 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/blobs-custom-033085m44123.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/all-models-custom-033085m44123.fits Stage fitblobs : Wall: 19.43 s, CPU: 1.24 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 233 MB, VmData: 258 MB, maxrss: 0.238152 MB Stage fitblobs finished: 2020-08-05T19:33:22.003313 Resources for stage fitblobs : 42.581 s worker CPU, 43.019 s worker Wall, Wall: 19.435 s, Cores in use: 2.25, Total efficiency (on 16 cores): 14.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:33:22.017283 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-resid.jpg Stage coadds : Wall: 2.74 s, CPU: 0.66 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 233 MB, VmData: 258 MB, maxrss: 0.238668 MB Stage coadds finished: 2020-08-05T19:33:24.754475 Resources for stage coadds : 8.031 s worker CPU, 8.856 s worker Wall, Wall: 2.738 s, Cores in use: 3.18, Total efficiency (on 16 cores): 19.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T19:33:24.767390 Cut to 1 unWISE tiles Reading WISE tile 0332m440 band 4 Reading WISE tile 0332m440 band 2 Reading WISE tile 0332m440 band 3 Reading WISE tile 0332m440 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 956 MB, VmSize: 813 MB, VmRSS: 153 MB, VmData: 178 MB, maxrss: 0.196824 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 995 MB, VmSize: 811 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.212808 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 970 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.213668 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.21126 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.49 s, CPU: 1.98 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 234 MB, VmData: 258 MB, maxrss: 0.239372 MB Stage wise_forced finished: 2020-08-05T19:33:29.255723 Resources for stage wise_forced : 3.224 s worker CPU, 6.604 s worker Wall, Wall: 4.490 s, Cores in use: 1.16, Total efficiency (on 16 cores): 7.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:33:29.288003 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/tractor-i/cus/tractor-custom-033085m44123.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/tractor/cus/tractor-custom-033085m44123.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/tractor/cus/brick-custom-033085m44123.sha256sum Stage writecat : Wall: 1.62 s, CPU: 1.33 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 236 MB, VmData: 258 MB, maxrss: 0.372248 MB Stage writecat finished: 2020-08-05T19:33:30.911676 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.625 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-writecat.p All done: 69.585 s worker CPU, 1070.790 s worker Wall, Wall: 127.564 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.0 % Finished galaxy PGC540647 in 2.168 minutes. Started working on galaxy PGC540647 at Wed Aug 5 20:20:15 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.085359000000004 -44.1230048 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:20:19.196546 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '33.085359000000004', '-44.1230048', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.085359000000004 -44.1230048 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 33.085359000000004 -44.1230048 Starting process 64235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 64237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 64238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 64240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 64242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 64244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 64248 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 64249 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 64250 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 64251 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 64252 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 64253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 64254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 64255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 64256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 64257 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 64258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 64259 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 64260 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 64262 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 64263 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 64264 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 64265 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 64266 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 64267 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 64269 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 64270 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 64271 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 64272 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 64273 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 64274 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 64275 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:20:21.020833 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 27 CCDs: c4d_180105_033253_ooi_z_v1-S23 z expnum 709556 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58123.148 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20180104/c4d_180105_033253_ooi_z_v1.fits.fz c4d_131123_061830_ooi_z_ls9-S26 z expnum 257595 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56619.263 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131122/c4d_131123_061830_ooi_z_ls9.fits.fz c4d_131028_040654_ooi_g_ls9-S26 g expnum 247570 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 56593.171 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131027/c4d_131028_040654_ooi_g_ls9.fits.fz c4d_131203_034718_ooi_r_ls9-S26 r expnum 259863 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56629.156 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131202/c4d_131203_034718_ooi_r_ls9.fits.fz c4d_180105_033253_ooi_z_v1-S17 z expnum 709556 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58123.148 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20180104/c4d_180105_033253_ooi_z_v1.fits.fz c4d_171215_043459_ooi_g_v1-S17 g expnum 705233 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58102.191 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20171214/c4d_171215_043459_ooi_g_v1.fits.fz c4d_171215_043301_ooi_r_v1-S17 r expnum 705232 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58102.190 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20171214/c4d_171215_043301_ooi_r_v1.fits.fz c4d_131015_043103_ooi_z_ls9-N1 z expnum 244257 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56580.188 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20131014/c4d_131015_043103_ooi_z_ls9.fits.fz c4d_140102_031617_ooi_r_ls9-N1 r expnum 270625 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56659.135 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20140101/c4d_140102_031617_ooi_r_ls9.fits.fz c4d_131207_053327_ooi_g_ls9-N1 g expnum 261275 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 56633.230 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20131206/c4d_131207_053327_ooi_g_ls9.fits.fz c4d_160901_075622_ooi_g_ls9-N14 g expnum 569919 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57632.329 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160831/c4d_160901_075622_ooi_g_ls9.fits.fz c4d_160901_075425_ooi_r_ls9-N14 r expnum 569918 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 57632.328 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160831/c4d_160901_075425_ooi_r_ls9.fits.fz c4d_160816_060422_ooi_z_ls9-N14 z expnum 565108 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57616.251 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160815/c4d_160816_060422_ooi_z_ls9.fits.fz c4d_131112_055509_ooi_z_ls9-S7 z expnum 253206 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56608.247 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131111/c4d_131112_055509_ooi_z_ls9.fits.fz c4d_131004_073639_ooi_r_ls9-S7 r expnum 241202 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56569.317 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131003/c4d_131004_073639_ooi_r_ls9.fits.fz c4d_131004_073440_ooi_g_ls9-S7 g expnum 241201 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 56569.316 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131003/c4d_131004_073440_ooi_g_ls9.fits.fz c4d_140113_024107_ooi_z_ls9-N22 z expnum 273683 exptime 90.0 propid 2012B-0001 seeing 0.75 MJD 56670.110 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20140112/c4d_140113_024107_ooi_z_ls9.fits.fz c4d_140122_022529_ooi_r_ls9-N22 r expnum 276711 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56679.099 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20140121/c4d_140122_022529_ooi_r_ls9.fits.fz c4d_131012_082858_ooi_g_ls9-N22 g expnum 243267 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56577.353 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20131011/c4d_131012_082858_ooi_g_ls9.fits.fz c4d_161006_022724_ooi_r_ls9-N21 r expnum 581247 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57667.101 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2a/CP20161005/c4d_161006_022724_ooi_r_ls9.fits.fz c4d_161006_022527_ooi_z_ls9-N21 z expnum 581246 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57667.099 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2a/CP20161005/c4d_161006_022527_ooi_z_ls9.fits.fz c4d_161107_062136_ooi_g_ls9-N21 g expnum 590684 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57699.263 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2/CP20161106/c4d_161107_062136_ooi_g_ls9.fits.fz c4d_171013_074328_ooi_z_v1-S22 z expnum 686592 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 58039.322 object DES survey hex 317-450 tiling 7 decam/CP/V4.1/CP20171012/c4d_171013_074328_ooi_z_v1.fits.fz c4d_161230_015300_ooi_g_ls9-S22 g expnum 605249 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57752.077 object DES survey hex 317-450 tiling 7 decam/CP/V4.8.2/CP20161229/c4d_161230_015300_ooi_g_ls9.fits.fz c4d_161230_015106_ooi_r_ls9-S22 r expnum 605248 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57752.076 object DES survey hex 317-450 tiling 7 decam/CP/V4.8.2/CP20161229/c4d_161230_015106_ooi_r_ls9.fits.fz c4d_171209_041247_ooi_g_v1-S2 g expnum 703167 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58096.176 object DES survey hex 342-440 tiling 8 decam/CP/V4.1/CP20171208/c4d_171209_041247_ooi_g_v1.fits.fz c4d_171128_041326_ooi_z_v1-S2 z expnum 700652 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 58085.176 object DES survey hex 342-440 tiling 8 decam/CP/V4.1/CP20171127/c4d_171128_041326_ooi_z_v1.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9637808-g-20131207T053105_oi[N1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161107T061919_oi[N21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131004T073440_oi[S7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171009_8fce7df-z-20171013T074328_oi[S22,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612fa3-z-20140113T023843_oi[N22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9629c28-r-20160901T075204_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633f34-z-20131112T055509_oi[S7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9507868-r-20161230T014844_oi[S22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20180103_908c72f-z-20180105T033253_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961262c-r-20140122T022307_oi[N22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962efdd-r-20161006T022506_oi[N21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-g-20171215T043459_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950820e-g-20161230T015043_oi[S22,noinherit][2046,4094][real]: DES sur Clipping 4 pixels with anomalously large oow values: max 0.0605492 vs median 0.0448317 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d18b-z-20161006T022307_oi[N21,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T041247_oi[S2,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635a72-r-20131203T034451_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T031355_oi[N1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-r-20171215T043301_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633ba2-r-20131004T073639_oi[S7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_963601c-z-20131123T061830_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131012T082858_oi[N22,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160901T075403_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171128T041326_oi[S2,noinherit][2046,4094][real]: DES Clipping 2 pixels with anomalously large oow values: max 0.062045 vs median 0.0469693 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131028T040654_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T043103_oi[N1,noinherit][2046,4094][real]: DES surv Zeroing out 3416 weight-map pixels below quantization error (= median 3.96e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3416 weight-map pixels below quantization error (= median 4.01e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3430 weight-map pixels below quantization error (= median 0.000303) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3430 weight-map pixels below quantization error (= median 7.36e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 1 weight-map pixels below quantization error (= median 2.9e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 1 weight-map pixels below quantization error (= median 0.000226) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T060204_oi[N14,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 57.90 s, CPU: 2.33 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 192 MB, VmData: 224 MB, maxrss: 0.196144 MB Stage tims finished: 2020-08-05T20:21:18.917244 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171009_8fce7df-z-20171013T074328_oi[S22,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9637808-g-20131207T053105_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131004T073440_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20180103_908c72f-z-20180105T033253_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161107T061919_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612fa3-z-20140113T023843_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-g-20171215T043459_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633f34-z-20131112T055509_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9629c28-r-20160901T075204_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-r-20171215T043301_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9507868-r-20161230T014844_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d18b-z-20161006T022307_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962efdd-r-20161006T022506_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635a72-r-20131203T034451_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131012T082858_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_963601c-z-20131123T061830_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160901T075403_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T043103_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T060204_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 19.014 s worker CPU, 730.619 s worker Wall, Wall: 57.899 s, Cores in use: 0.37, Total efficiency (on 32 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171128T041326_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T041247_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961262c-r-20140122T022307_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950820e-g-20161230T015043_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131028T040654_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T031355_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633ba2-r-20131004T073639_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:21:19.299738 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10315.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10438.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10439.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/reference-custom-033085m44123.fits Stage refs : Wall: 11.36 s, CPU: 1.64 s, VmPeak: 1046 MB, VmSize: 1028 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.210624 MB Stage refs finished: 2020-08-05T20:21:30.664472 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 11.367 s, Cores in use: 0.14, Total efficiency (on 32 cores): 0.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:21:30.721813 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outlier-mask-custom-033085m44123.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-pre-custom-033085m44123.jpg Image c4d_171215_043459_ooi_g_v1-S17 g : masking 423 positive outlier pixels and 0 negative outlier pixels Image c4d_131028_040654_ooi_g_ls9-S26 g : masking 0 positive outlier pixels and 143 negative outlier pixels Image c4d_160901_075622_ooi_g_ls9-N14 g : masking 0 positive outlier pixels and 55 negative outlier pixels Image c4d_131203_034718_ooi_r_ls9-S26 r : masking 2223 positive outlier pixels and 111 negative outlier pixels Image c4d_131004_073639_ooi_r_ls9-S7 r : masking 625 positive outlier pixels and 189 negative outlier pixels Image c4d_161230_015106_ooi_r_ls9-S22 r : masking 0 positive outlier pixels and 101 negative outlier pixels Image c4d_160901_075425_ooi_r_ls9-N14 r : masking 155 positive outlier pixels and 0 negative outlier pixels Image c4d_160816_060422_ooi_z_ls9-N14 z : masking 261 positive outlier pixels and 0 negative outlier pixels Image c4d_171013_074328_ooi_z_v1-S22 z : masking 0 positive outlier pixels and 48 negative outlier pixels Image c4d_171128_041326_ooi_z_v1-S2 z : masking 563 positive outlier pixels and 0 negative outlier pixels Image c4d_140113_024107_ooi_z_ls9-N22 z : masking 283 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outlier-mask-custom-033085m44123.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-post-custom-033085m44123.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-masked-pos-custom-033085m44123.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/outliers-masked-neg-custom-033085m44123.jpg Stage outliers : Wall: 1.55 s, CPU: 1.33 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235312 MB Stage outliers finished: 2020-08-05T20:21:32.270375 Resources for stage outliers : 1.830 s worker CPU, 2.012 s worker Wall, Wall: 1.551 s, Cores in use: 2.04, Total efficiency (on 32 cores): 6.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:21:32.640892 Stage halos : Wall: 1.70 s, CPU: 1.70 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 230 MB, VmData: 259 MB, maxrss: 0.23572 MB Stage halos finished: 2020-08-05T20:21:34.340839 Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.703 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:21:34.796046 PSF sigmas in coadd pixels: ['2.42', '2.02', '1.95', '1.81', '1.90', '1.71', '1.81', '2.20', '2.01'] Using average PSF sigma 1.9801649423466425 Gaussian PSF norm 0.14246024951819158 vs pixelized 0.123396955 average tim pixel scale / coadd scale: 1.001060473330973 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.54', '1.94', '1.79', '1.90', '1.79', '1.77', '1.80', '2.18'] Using average PSF sigma 1.9622684586171428 Gaussian PSF norm 0.1437595302187536 vs pixelized 0.13142803 average tim pixel scale / coadd scale: 1.0010799309634248 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.51', '1.59', '1.67', '1.79', '1.23', '1.64', '1.86', '1.82'] Using average PSF sigma 1.6393292909160833 Gaussian PSF norm 0.17207939450422383 vs pixelized 0.15406284 average tim pixel scale / coadd scale: 1.0010372791332653 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.19 s, CPU: 0.32 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 233 MB, VmData: 259 MB, maxrss: 0.238128 MB Stage fit_on_coadds finished: 2020-08-05T20:21:35.984693 Resources for stage fit_on_coadds : 0.372 s worker CPU, 0.372 s worker Wall, Wall: 1.191 s, Cores in use: 0.58, Total efficiency (on 32 cores): 1.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:21:36.010179 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 2 in veto map, 4 cut by saddle test, 0 cut by aper test, 26 kept SED z : 26 new peaks Found 43 potential peaks Of 43 potential peaks: 28 in veto map, 4 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 39 potential peaks Of 39 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 50 potential peaks Of 50 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 51 potential peaks Of 51 potential peaks: 47 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 45 new sources Median coadd sky for g : -0.00010364415 Median coadd sky for r : -9.891669e-05 Median coadd sky for z : -2.4545365e-05 Stage srcs : Wall: 1.63 s, CPU: 1.54 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 233 MB, VmData: 259 MB, maxrss: 0.23866 MB Stage srcs finished: 2020-08-05T20:21:37.637510 Resources for stage srcs : 0.082 s worker CPU, 0.082 s worker Wall, Wall: 1.629 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:21:37.656902 Blob 1 of 12, id: 4, sources: 17, size: 173x195, npix 13858, brick X: 51,224, Y: 48,243, one pixel: 133 48 Blob 2 of 12, id: 0, sources: 11, size: 115x89, npix 5346, brick X: 0,115, Y: 0,89, one pixel: 1 0 Blob 3 of 12, id: 9, sources: 6, size: 57x92, npix 2680, brick X: 184,241, Y: 151,243, one pixel: 194 151 Blob 4 of 12, id: 5, sources: 3, size: 40x63, npix 1688, brick X: 205,245, Y: 59,122, one pixel: 224 59 Blob 5 of 12, id: 1, sources: 1, size: 43x40, npix 1093, brick X: 126,169, Y: 2,42, one pixel: 134 2 Blob 6 of 12, id: 6, sources: 3, size: 55x36, npix 1014, brick X: 0,55, Y: 83,119, one pixel: 43 83 Blob 7 of 12, id: 8, sources: 2, size: 33x35, npix 573, brick X: 52,85, Y: 131,166, one pixel: 73 131 Blob 8 of 12, id: 7, sources: 1, size: 22x35, npix 553, brick X: 0,22, Y: 122,157, one pixel: 4 122 Blob 9 of 12, id: 2, sources: 1, size: 25x25, npix 411, brick X: 169,194, Y: 25,50, one pixel: 179 25 Blob 10 of 12, id: 3, sources: 1, size: 25x25, npix 367, brick X: 188,213, Y: 46,71, one pixel: 200 46 Blob 11 of 12, id: 11, sources: 1, size: 23x25, npix 363, brick X: 39,62, Y: 202,227, one pixel: 49 202 Blob 12 of 12, id: 10, sources: 1, size: 23x22, npix 292, brick X: 3,26, Y: 165,187, one pixel: 15 165 Blob 7 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14748 MB Blob 12 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093748 MB Blob 9 finished, total: Wall: 0.62 s, CPU: 0.61 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147704 MB Blob 10 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14754 MB Measuring 1 iterative sources Blob 11 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148016 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.01 s, CPU: 1.00 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147808 MB Blob 8 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147712 MB Blob 6 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096116 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.94 s, CPU: 2.94 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148236 MB Blob 3 finished, total: Wall: 4.44 s, CPU: 4.43 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14946 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 9.44 s, CPU: 9.43 s, VmPeak: 1008 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149844 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.50083, ee1=0.431338, ee2=-0.972671 Measuring 7 iterative sources Blob 1 finished, total: Wall: 19.22 s, CPU: 19.22 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 154 MB, VmData: 182 MB, maxrss: 0.15728 MB Old catalog: 49 New catalog: 57 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/blobs-custom-033085m44123.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/metrics/cus/all-models-custom-033085m44123.fits Stage fitblobs : Wall: 19.76 s, CPU: 0.52 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 233 MB, VmData: 259 MB, maxrss: 0.239016 MB Stage fitblobs finished: 2020-08-05T20:21:57.412721 Resources for stage fitblobs : 43.053 s worker CPU, 43.108 s worker Wall, Wall: 19.758 s, Cores in use: 2.21, Total efficiency (on 32 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:21:57.435516 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-resid.jpg Stage coadds : Wall: 4.00 s, CPU: 1.54 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 234 MB, VmData: 259 MB, maxrss: 0.239532 MB Stage coadds finished: 2020-08-05T20:22:01.434363 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 32.663 s worker CPU, 53.104 s worker Wall, Wall: 4.001 s, Cores in use: 8.55, Total efficiency (on 32 cores): 26.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:22:01.449629 Cut to 1 unWISE tiles Reading WISE tile 0332m440 band 4 Reading WISE tile 0332m440 band 1 Reading WISE tile 0332m440 band 3 Reading WISE tile 0332m440 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 959 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.19152 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 935 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203608 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 951 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206924 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.19974 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/tmp-legacysurvey-custom-033085m44123-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.75 s, CPU: 1.13 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 235 MB, VmData: 259 MB, maxrss: 0.240236 MB Stage wise_forced finished: 2020-08-05T20:22:04.203735 Resources for stage wise_forced : 3.422 s worker CPU, 4.691 s worker Wall, Wall: 2.756 s, Cores in use: 1.65, Total efficiency (on 32 cores): 5.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:22:04.221790 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/coadd/cus/custom-033085m44123/legacysurvey-custom-033085m44123-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/tractor-i/cus/tractor-custom-033085m44123.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/tractor/cus/tractor-custom-033085m44123.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/tractor/cus/brick-custom-033085m44123.sha256sum Stage writecat : Wall: 1.54 s, CPU: 1.02 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 236 MB, VmData: 259 MB, maxrss: 0.373112 MB Stage writecat finished: 2020-08-05T20:22:05.759691 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.540 s, Cores in use: 0.66, Total efficiency (on 32 cores): 2.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/033/PGC540647/PGC540647-largegalaxy-writecat.p All done: 100.442 s worker CPU, 833.995 s worker Wall, Wall: 104.763 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 % Finished galaxy PGC540647 in 1.851 minutes. Started working on galaxy PGC540647 at Mon Aug 10 08:30:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.08643907955455 -44.122932808967875 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T08:30:12.726440 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '33.08643907955455', '-44.122932808967875', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.08643907955455 -44.122932808967875 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 33.08643907955455 -44.122932808967875 Starting process 35598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 35599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 35600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 35601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 35602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 35603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 35604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 35605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T08:30:13.178349 Keeping 27 CCDs: c4d_180105_033253_ooi_z_v1-S23 z expnum 709556 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58123.148 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20180104/c4d_180105_033253_ooi_z_v1.fits.fz c4d_131123_061830_ooi_z_ls9-S26 z expnum 257595 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56619.263 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131122/c4d_131123_061830_ooi_z_ls9.fits.fz c4d_131028_040654_ooi_g_ls9-S26 g expnum 247570 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 56593.171 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131027/c4d_131028_040654_ooi_g_ls9.fits.fz c4d_131203_034718_ooi_r_ls9-S26 r expnum 259863 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56629.156 object DES survey hex 342-440 tiling 3 decam/CP/V4.8.2a/CP20131202/c4d_131203_034718_ooi_r_ls9.fits.fz c4d_180105_033253_ooi_z_v1-S17 z expnum 709556 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58123.148 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20180104/c4d_180105_033253_ooi_z_v1.fits.fz c4d_171215_043459_ooi_g_v1-S17 g expnum 705233 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58102.191 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20171214/c4d_171215_043459_ooi_g_v1.fits.fz c4d_171215_043301_ooi_r_v1-S17 r expnum 705232 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58102.190 object DES survey hex 317-450 tiling 9 decam/CP/V4.1/CP20171214/c4d_171215_043301_ooi_r_v1.fits.fz c4d_131015_043103_ooi_z_ls9-N1 z expnum 244257 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56580.188 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20131014/c4d_131015_043103_ooi_z_ls9.fits.fz c4d_140102_031617_ooi_r_ls9-N1 r expnum 270625 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56659.135 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20140101/c4d_140102_031617_ooi_r_ls9.fits.fz c4d_131207_053327_ooi_g_ls9-N1 g expnum 261275 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 56633.230 object DES survey hex 342-440 tiling 1 decam/CP/V4.8.2a/CP20131206/c4d_131207_053327_ooi_g_ls9.fits.fz c4d_160901_075622_ooi_g_ls9-N14 g expnum 569919 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57632.329 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160831/c4d_160901_075622_ooi_g_ls9.fits.fz c4d_160901_075425_ooi_r_ls9-N14 r expnum 569918 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 57632.328 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160831/c4d_160901_075425_ooi_r_ls9.fits.fz c4d_160816_060422_ooi_z_ls9-N14 z expnum 565108 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57616.251 object DES survey hex 342-440 tiling 5 decam/CP/V4.8.2a/CP20160815/c4d_160816_060422_ooi_z_ls9.fits.fz c4d_131112_055509_ooi_z_ls9-S7 z expnum 253206 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56608.247 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131111/c4d_131112_055509_ooi_z_ls9.fits.fz c4d_131004_073639_ooi_r_ls9-S7 r expnum 241202 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 56569.317 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131003/c4d_131004_073639_ooi_r_ls9.fits.fz c4d_131004_073440_ooi_g_ls9-S7 g expnum 241201 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 56569.316 object DES survey hex 317-450 tiling 4 decam/CP/V4.8.2a/CP20131003/c4d_131004_073440_ooi_g_ls9.fits.fz c4d_140113_024107_ooi_z_ls9-N22 z expnum 273683 exptime 90.0 propid 2012B-0001 seeing 0.75 MJD 56670.110 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20140112/c4d_140113_024107_ooi_z_ls9.fits.fz c4d_140122_022529_ooi_r_ls9-N22 r expnum 276711 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56679.099 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20140121/c4d_140122_022529_ooi_r_ls9.fits.fz c4d_131012_082858_ooi_g_ls9-N22 g expnum 243267 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56577.353 object DES survey hex 342-440 tiling 2 decam/CP/V4.8.2a/CP20131011/c4d_131012_082858_ooi_g_ls9.fits.fz c4d_161006_022724_ooi_r_ls9-N21 r expnum 581247 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57667.101 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2a/CP20161005/c4d_161006_022724_ooi_r_ls9.fits.fz c4d_161006_022527_ooi_z_ls9-N21 z expnum 581246 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57667.099 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2a/CP20161005/c4d_161006_022527_ooi_z_ls9.fits.fz c4d_161107_062136_ooi_g_ls9-N21 g expnum 590684 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57699.263 object DES survey hex 342-440 tiling 6 decam/CP/V4.8.2/CP20161106/c4d_161107_062136_ooi_g_ls9.fits.fz c4d_171013_074328_ooi_z_v1-S22 z expnum 686592 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 58039.322 object DES survey hex 317-450 tiling 7 decam/CP/V4.1/CP20171012/c4d_171013_074328_ooi_z_v1.fits.fz c4d_161230_015300_ooi_g_ls9-S22 g expnum 605249 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57752.077 object DES survey hex 317-450 tiling 7 decam/CP/V4.8.2/CP20161229/c4d_161230_015300_ooi_g_ls9.fits.fz c4d_161230_015106_ooi_r_ls9-S22 r expnum 605248 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57752.076 object DES survey hex 317-450 tiling 7 decam/CP/V4.8.2/CP20161229/c4d_161230_015106_ooi_r_ls9.fits.fz c4d_171209_041247_ooi_g_v1-S2 g expnum 703167 exptime 90.0 propid 2012B-0001 seeing 1.24 MJD 58096.176 object DES survey hex 342-440 tiling 8 decam/CP/V4.1/CP20171208/c4d_171209_041247_ooi_g_v1.fits.fz c4d_171128_041326_ooi_z_v1-S2 z expnum 700652 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 58085.176 object DES survey hex 342-440 tiling 8 decam/CP/V4.1/CP20171127/c4d_171128_041326_ooi_z_v1.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_963601c-z-20131123T061830_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-r-20171215T043301_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-g-20171215T043459_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20180103_908c72f-z-20180105T033253_oi[S17,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635a72-r-20131203T034451_oi[S26,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T043103_oi[N1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T031355_oi[N1,noinherit][2046,4094][real]: DES surv Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9637808-g-20131207T053105_oi[N1,noinherit][2046,4094][real]: DES surv Zeroing out 3430 weight-map pixels below quantization error (= median 7.37e-05) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160901T075403_oi[N14,noinherit][2046,4094][real]: DES sur Clipping 2 pixels with anomalously large oow values: max 0.062045 vs median 0.0469693 Zeroing out 3430 weight-map pixels below quantization error (= median 0.000303) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9629c28-r-20160901T075204_oi[N14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131028T040654_oi[S26,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633f34-z-20131112T055509_oi[S7,noinherit][2046,4094][real]: DES surv Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633ba2-r-20131004T073639_oi[S7,noinherit][2046,4094][real]: DES surv Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131004T073440_oi[S7,noinherit][2046,4094][real]: DES surv Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612fa3-z-20140113T023843_oi[N22,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961262c-r-20140122T022307_oi[N22,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131012T082858_oi[N22,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962efdd-r-20161006T022506_oi[N21,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d18b-z-20161006T022307_oi[N21,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171009_8fce7df-z-20171013T074328_oi[S22,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161107T061919_oi[N21,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950820e-g-20161230T015043_oi[S22,noinherit][2046,4094][real]: DES sur Clipping 4 pixels with anomalously large oow values: max 0.0605492 vs median 0.0448317 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9507868-r-20161230T014844_oi[S22,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T041247_oi[S2,noinherit][2046,4094][real]: DES Zeroing out 3430 weight-map pixels below quantization error (= median 3.96e-06) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171128T041326_oi[S2,noinherit][2046,4094][real]: DES Zeroing out 3430 weight-map pixels below quantization error (= median 4.02e-06) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T060204_oi[N14,noinherit][2046,4094][real]: DES sur Stage tims : Wall: 108.29 s, CPU: 0.96 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.19428 MB Stage tims finished: 2020-08-10T08:32:01.471474 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131028T040654_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962d18b-z-20161006T022307_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635a72-r-20131203T034451_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633f34-z-20131112T055509_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962efdd-r-20161006T022506_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T043103_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633ba2-r-20131004T073639_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161107T061919_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_963601c-z-20131123T061830_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9637808-g-20131207T053105_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612fa3-z-20140113T023843_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950820e-g-20161230T015043_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Zeroing out 1 weight-map pixels below quantization error (= median 2.9e-06) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-r-20171215T043301_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160901T075403_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961262c-r-20140122T022307_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9507868-r-20161230T014844_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Zeroing out 1 weight-map pixels below quantization error (= median 0.000226) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T031355_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131004T073440_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171009_8fce7df-z-20171013T074328_oi[S22,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171128T041326_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171212_905e4e2-g-20171215T043459_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9629c28-r-20160901T075204_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131012T082858_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T041247_oi[S2,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20180103_908c72f-z-20180105T033253_oi[S17,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T060204_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Resources for stage tims : 9.410 s worker CPU, 559.727 s worker Wall, Wall: 108.294 s, Cores in use: 0.10, Total efficiency (on 8 cores): 1.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T08:32:01.788959 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10315.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10438.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10439.fits Matched 6 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/reference-custom-033086m44122.fits Stage refs : Wall: 19.19 s, CPU: 1.42 s, VmPeak: 1040 MB, VmSize: 1022 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.208532 MB Stage refs finished: 2020-08-10T08:32:20.977180 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 19.189 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T08:32:21.027790 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/outlier-mask-custom-033086m44122.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/outliers-pre-custom-033086m44122.jpg Image c4d_171215_043459_ooi_g_v1-S17 g : masking 398 positive outlier pixels and 0 negative outlier pixels Image c4d_131028_040654_ooi_g_ls9-S26 g : masking 0 positive outlier pixels and 140 negative outlier pixels Image c4d_131012_082858_ooi_g_ls9-N22 g : masking 150 positive outlier pixels and 0 negative outlier pixels Image c4d_161107_062136_ooi_g_ls9-N21 g : masking 0 positive outlier pixels and 56 negative outlier pixels Image c4d_171215_043301_ooi_r_v1-S17 r : masking 113 positive outlier pixels and 0 negative outlier pixels Image c4d_160901_075425_ooi_r_ls9-N14 r : masking 155 positive outlier pixels and 0 negative outlier pixels Image c4d_131203_034718_ooi_r_ls9-S26 r : masking 2426 positive outlier pixels and 111 negative outlier pixels Image c4d_131004_073639_ooi_r_ls9-S7 r : masking 488 positive outlier pixels and 189 negative outlier pixels Image c4d_131123_061830_ooi_z_ls9-S26 z : masking 81 positive outlier pixels and 0 negative outlier pixels Image c4d_160816_060422_ooi_z_ls9-N14 z : masking 267 positive outlier pixels and 0 negative outlier pixels Image c4d_140113_024107_ooi_z_ls9-N22 z : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_171128_041326_ooi_z_v1-S2 z : masking 570 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/outlier-mask-custom-033086m44122.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/outliers-post-custom-033086m44122.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/outliers-masked-pos-custom-033086m44122.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/outliers-masked-neg-custom-033086m44122.jpg Stage outliers : Wall: 1.43 s, CPU: 1.20 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 227 MB, VmData: 257 MB, maxrss: 0.23254 MB Stage outliers finished: 2020-08-10T08:32:22.459519 Resources for stage outliers : 2.026 s worker CPU, 2.028 s worker Wall, Wall: 1.433 s, Cores in use: 2.25, Total efficiency (on 8 cores): 28.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T08:32:22.794581 Stage halos : Wall: 0.44 s, CPU: 0.44 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 228 MB, VmData: 257 MB, maxrss: 0.232972 MB Stage halos finished: 2020-08-10T08:32:23.230919 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.438 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T08:32:23.610523 PSF sigmas in coadd pixels: ['2.42', '2.02', '1.95', '1.81', '1.90', '1.71', '1.81', '2.20', '2.01'] Using average PSF sigma 1.9801649423466425 Gaussian PSF norm 0.14246024951819158 vs pixelized 0.123406544 average tim pixel scale / coadd scale: 1.001060473330973 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.54', '1.94', '1.79', '1.90', '1.79', '1.77', '1.80', '2.18'] Using average PSF sigma 1.9622684586171428 Gaussian PSF norm 0.1437595302187536 vs pixelized 0.13143232 average tim pixel scale / coadd scale: 1.0010799309634248 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.51', '1.59', '1.67', '1.79', '1.23', '1.64', '1.86', '1.82'] Using average PSF sigma 1.6393292909160833 Gaussian PSF norm 0.17207939450422383 vs pixelized 0.15406267 average tim pixel scale / coadd scale: 1.0010372791332653 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.34 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 229 MB, VmData: 257 MB, maxrss: 0.234808 MB Stage fit_on_coadds finished: 2020-08-10T08:32:23.950085 Resources for stage fit_on_coadds : 0.441 s worker CPU, 0.441 s worker Wall, Wall: 0.341 s, Cores in use: 2.30, Total efficiency (on 8 cores): 28.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T08:32:23.963045 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 31 potential peaks Of 31 potential peaks: 3 in veto map, 4 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 43 potential peaks Of 43 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 39 potential peaks Of 39 potential peaks: 33 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 48 potential peaks Of 48 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 51 potential peaks Of 51 potential peaks: 44 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 43 new sources Median coadd sky for g : -0.00010543976 Median coadd sky for r : -6.678364e-05 Median coadd sky for z : 3.2332027e-05 Stage srcs : Wall: 0.60 s, CPU: 0.56 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.235328 MB Stage srcs finished: 2020-08-10T08:32:24.561436 Resources for stage srcs : 0.081 s worker CPU, 0.081 s worker Wall, Wall: 0.599 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T08:32:24.572761 Blob 1 of 11, id: 4, sources: 16, size: 173x195, npix 13868, brick X: 62,235, Y: 47,242, one pixel: 143 47 Blob 2 of 11, id: 0, sources: 12, size: 126x89, npix 5748, brick X: 0,126, Y: 0,89, one pixel: 5 0 Blob 3 of 11, id: 8, sources: 5, size: 51x92, npix 2383, brick X: 194,245, Y: 150,242, one pixel: 205 150 Blob 4 of 11, id: 6, sources: 4, size: 66x75, npix 2068, brick X: 0,66, Y: 83,158, one pixel: 51 83 Blob 5 of 11, id: 5, sources: 2, size: 29x56, npix 1111, brick X: 216,245, Y: 58,114, one pixel: 234 58 Blob 6 of 11, id: 1, sources: 1, size: 44x40, npix 1094, brick X: 136,180, Y: 1,41, one pixel: 145 1 Blob 7 of 11, id: 7, sources: 2, size: 33x35, npix 581, brick X: 62,95, Y: 130,165, one pixel: 84 130 Blob 8 of 11, id: 2, sources: 1, size: 26x25, npix 395, brick X: 179,205, Y: 24,49, one pixel: 190 24 Blob 9 of 11, id: 10, sources: 1, size: 23x25, npix 363, brick X: 50,73, Y: 201,226, one pixel: 60 201 Blob 7 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145216 MB Blob 10 of 11, id: 3, sources: 1, size: 25x25, npix 358, brick X: 199,224, Y: 45,70, one pixel: 210 45 Blob 5 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143476 MB Blob 11 of 11, id: 9, sources: 1, size: 23x22, npix 300, brick X: 14,37, Y: 164,186, one pixel: 26 164 Blob 8 finished, total: Wall: 1.05 s, CPU: 0.80 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143436 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 1023 MB, VmSize: 728 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145216 MB Blob 6 finished, total: Wall: 1.82 s, CPU: 1.59 s, VmPeak: 999 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146264 MB Blob 11 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143436 MB Blob 10 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143476 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 3.39 s, CPU: 3.38 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.143192 MB Blob 3 finished, total: Wall: 4.73 s, CPU: 4.72 s, VmPeak: 995 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144544 MB Measuring 3 iterative sources Blob 2 finished, total: Wall: 9.84 s, CPU: 9.84 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146904 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.03399, ee1=0.30188, ee2=-0.709042 Measuring 8 iterative sources Blob 1 finished, total: Wall: 18.39 s, CPU: 18.25 s, VmPeak: 1030 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.145336 MB Old catalog: 47 New catalog: 55 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/blobs-custom-033086m44122.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/metrics/cus/all-models-custom-033086m44122.fits Stage fitblobs : Wall: 18.79 s, CPU: 0.38 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.235684 MB Stage fitblobs finished: 2020-08-10T08:32:43.360134 Resources for stage fitblobs : 43.085 s worker CPU, 43.783 s worker Wall, Wall: 18.788 s, Cores in use: 2.31, Total efficiency (on 8 cores): 28.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T08:32:43.372798 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/tmp-legacysurvey-custom-033086m44122-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/tmp-legacysurvey-custom-033086m44122-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/tmp-legacysurvey-custom-033086m44122-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/tmp-legacysurvey-custom-033086m44122-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-resid.jpg Stage coadds : Wall: 1.30 s, CPU: 0.54 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.2362 MB Stage coadds finished: 2020-08-10T08:32:44.669468 Resources for stage coadds : 4.388 s worker CPU, 4.623 s worker Wall, Wall: 1.298 s, Cores in use: 3.80, Total efficiency (on 8 cores): 47.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T08:32:44.681022 Cut to 1 unWISE tiles Reading WISE tile 0332m440 band 2 Reading WISE tile 0332m440 band 3 Reading WISE tile 0332m440 band 1 Reading WISE tile 0332m440 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.209752 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1023 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.210776 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 999 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.196036 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0332m440/unwise-0332m440-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 995 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206972 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/tmp-legacysurvey-custom-033086m44122-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/tmp-legacysurvey-custom-033086m44122-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.16 s, CPU: 0.62 s, VmPeak: 1040 MB, VmSize: 1032 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.236904 MB Stage wise_forced finished: 2020-08-10T08:32:46.843523 Resources for stage wise_forced : 3.392 s worker CPU, 5.442 s worker Wall, Wall: 2.163 s, Cores in use: 1.85, Total efficiency (on 8 cores): 23.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T08:32:46.858249 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/coadd/cus/custom-033086m44122/legacysurvey-custom-033086m44122-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/tractor-i/cus/tractor-custom-033086m44122.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/tractor/cus/tractor-custom-033086m44122.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/tractor/cus/brick-custom-033086m44122.sha256sum Stage writecat : Wall: 0.98 s, CPU: 0.77 s, VmPeak: 1164 MB, VmSize: 1036 MB, VmRSS: 233 MB, VmData: 257 MB, maxrss: 0.369764 MB Stage writecat finished: 2020-08-10T08:32:47.836009 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.979 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC540647/PGC540647-largegalaxy-writecat.p All done: 62.824 s worker CPU, 616.128 s worker Wall, Wall: 154.677 s, Cores in use: 0.45, Total efficiency (on 8 cores): 5.7 % Finished galaxy PGC540647 in 2.610 minutes.