PS1 Medium Deep Fields: Review and Status

PS1 Medium Deep Fields:
Review and Status
Mark Huber for the IPP Team (IfA) PS1SC STScI Meeting June 23, 2014
Survey: http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Medium_Deep_Survey
Processing: http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MediumDeepFields
•
•
•
Medium Deep (MD) quick summary/review
MD processing version 2 (MD.PV2) — update reprocessing
• summary and status since Taiwan meeting late-2013
• focus on deep stack issues MD processing version 3 (MD.PV3) — full pixel reprocessing
PS1 Medium Deep Survey Fields
Courtesy Rick White (STSCI)
Field
Dec
Overlaps
MD01
RA
(J2000)
02:24:50
-04:35:00
XMM-LSS-DXS/VVDS-02h
MD02
03:32:24
-28:08:00
CDGS/GOODS/GEMS
MD03
08:42:22
+44:19:00
IFA/Lynx
MD04
10:00:00
+02:12:00
COSMOS
MD05
10:47:40
+58:05:00
Lockman-DXS
MD06
12:20:00
+47:07:00
NGC4258
MD07
14:14:49
+53:05:00
DEEP2/Groth Strip
MD08
16:11:09
+54:57:00
EliasN1-DXS
MD09
22:16:45
+00:17:00
SA22-DXS/VVDS-22h
MD10
23:29:15
-00:26:00
DEEP2-Field 3
Tested but discontinued:
MD11 = NEP (18:00, +66:34)
http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Medium_Deep_Survey
PS1SC STScI Meeting 2014
MD Observations
Summary cadence: http://ps1sc.ifa.hawaii.edu/PS1wiki/index.php/Medium_Deep_Schedule
By Field
~Season
MD01
Aug -- Jan
MD02
Sep -- Feb
g,r 8x113s
MD03
Nov -- Apr
i,z,y 8x 240s
MD04
Dec -- May
MD05
Dec -- Jun
MD06
Jan -- Jul
MD07
Feb -- Jul
MD08
May -- Sep
MD09
Jun -- Nov
MD10
Jul -- Dec
MD11
9/21/2010--10/06/2010
By Filter (since end 2011):
•
griz cycle
•
•
•
•
•
y during bright time, z added at
full moon
extra g,r observations at dark
time, replaced into/out of bright
time
extra MD observations during
marginal weather
Summary plots of MD observations: http://star.pst.qub.ac.uk/ps/parts/telescope_logs_en.htm
PS1SC STScI Meeting 2014
MD07 current pointing
V3 Tessellation for Skycells
•
•
•
•
•
090
099
000
009
platescale 0.25”/pixel
10x10 grid (12x12 for V2 and earlier)
E in -x (flipped) and N in +y direction
MD07 early and current pointing
320 pixel (80”) overlap (300 px, 60” in V2)
shifted centers to include early data regions
(MD07, less for 08, 09, 10) — these will have
focal plane in different skycells
Any problems found with these
field shifts?
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD.GR0#MD.V3Tessellation
PS1SC STScI Meeting 2014
MD Stack Types
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD_stack_types
• Night stacks (MDN) [nightlyscience/nightstack]: standard nightlyscience stacks use N>3 input
warps, reprocessed GR0/PV1 use N>1 (only for MD09 reprocessed through mid-2012). Should
some limits be imposed for marginal data nights? Should other configurations be changed for PV3?
• Reference stacks [refstack]: make best stack as a diffim template with guideline of >30 inputs/pixel
without growing the best PSF by more than ~0.2 pixels. New input cuts starting with
MD10.refstack.20120705 help to further restrict the input FWHM.
• seasonal reference stacks (MDO) []: off-year reference stack with inputs to stack excluding
particular season, redo all for uniform set
• Deep stacks (MDD) [deepstack]: all input images versus modest cuts (FWHM<10 pixels,
elongation<1.5, dZPT<0.3, cut large background tail) and exclude 2009—mid-2010 season data
(should this be changed for PV3?)
• IQ stacks (MDT) [iqstack]: only best of best inputs, template stack. N input limit? What fraction of
outer edges is acceptable loss? — parameters still to work out
• Xtest stacks [reftest, deeptest etc]: as the name suggests, test or sample type of stack is often
made, such as with the refstacks [reftest]. Images are usually pushed to the distribution server,
setup details for the stack should be documented on the relevant wiki.
PS1SC STScI Meeting 2014
Summary of MD.PV2
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD.PV2
• MD.PV2 (as with LAP) is an update reprocessing of data from PV1 and improvements to stacking
improvements in chip detrends and camera stage processing (dynamic masks)
• incorporates
after mid-July 2013 (nightly processing after this automatically includes these improvements)
updated warps to be kept on disk (deep stack production, full-forced photometry, faster
• all
Postage Stamp Server access) ref+deep stacks using new 1-D Gaussian convolution method for pixel rejection, all
• only
nightlyscience stacks continued using previous method and configuration (to change in PV3)
reference stacks for MD03,04 2013 also using updated warps rather than full reprocessing
• past
of selected exposures (each have their own wiki pages)
• all exposures from the survey (April 2009 through April 2014) have finished
stacks for all MD fields in progress — 50% done (expect finish by end of July) using special
• deep
set of high memory nodes reference stacks for each season for each MD field as a uniform set — about to start
• seasonal
(expect finish by early August)
stacks for all MD fields — still testing configurations (very short processing time, expect mid• IQ
August to finish)
• full-forced photometry — at least MD04 and/or MD09 as test cases prior to PV3?
PS1SC STScI Meeting 2014
Summary Status of MD.PV2 (as of June 20, 2014)
Field/Stage
cam/warp
ref stack
skycal
deep stack
skycal
IQ stack
in PSPS
MD01
pv2
x
x
~20140701(3)
x
x
x
MD02
pv2
x
x
~20140708(3)
x
x
x
MD03
pv2
x
x
~201407016(3)
x
x
x
MD04
pv2
~20140629
x
20140506
20140511(2)
20140620(3)
mid-July?
MD05
pv2
x
x
20140616(3)
~20140624(3)
x
x
MD06
pv2
x
x
~20140624(3)
x
x
x
MD07
pv2
x
x
20140605
x
x
MD08
pv2
x
x
20140529
x
x
MD09
pv2
~20140706
x
20140512
mid-July?
pv1+
MD10
pv2
~20140713
x
20140520
20140612(2)
20140620(3)
20140605(2)
20140620(3)
20140521(2)
20140618(3)
20140529(2)
20140619(3)
x
x
MD11
----
----
----
----
----
----
----
pv2-
alldeeptest.20131010
MD04 and MD09 (green) are common test fields and have various products in advance of other fields
- PSPS MD04 is pre-PV2 full deep stack, MD09 is post-PV1 — see relevant wiki for more information - ref stack is full seasonal set. MD09/10 shifted field, require additional analysis and ends projected dates (expect all by early Aug.)
- deepstack (3) using the 20140616 code improvements, date is start data and take ~1 week to finish (with current best cuts)
- skycal multiple dates, (2) ready to load PSPS but issues may require (3) 20140616 code improvements instead? PS1SC STScI Meeting 2014
-
MD.PV2 Deep Stack
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD.PV2.deepstack.20130506
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MDdeeptest_pixrej_20140403
•
first full set of deep stacks for MD started with improved code and configurations (20140506) •
•
resolved problems prior to Taiwan for stacks >600 inputs (tested up to ~1500 inputs for now)
clean up improvement and changes with pixel rejection •
•
SUSPECT pixels now set bad and smaller threshold for good pixels (lose ~2-5% of input pixels)
•
skycell edge masking where pixel rejection is not actually applied in final stack
minimum inputs per pixel to cut field edge poor pixels, also cuts pixels at rotation dither center of
field (MD pixels worse than what should be typically available in 3PI overlap in those areas)
PS1SC STScI Meeting 2014
MD.PV2 Deep Stack
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD.PV2.deepstack.20130506
• new improvements 20140616 (PV3 code version) — warp BSCALE offset correction hack for background
• input
(PV3 will properly account for in warps) — will only apply
MD04-i
to MD05, 06, 01, 02, 03 (half the fields for PV2)
improvements (Gene commented on) and
• photometry
0.05-0.1 bulk offset in zeropoint correction improvement
(MD04-i)
MD04 unconvolved stack FWHM_MAJOR ~1.2, 1.1,
• Example
1.0, 1.0, 1.1”
MD04 unconvolved stack magnitude@5-sigma for
• Example
point sources below
MD04 grizy
PS1SC STScI Meeting 2014
•
MD.PV2 Deep Stack
couple key issues to still resolve before PV3 stack products started:
•
internal photometry quality fault issue (can impact all stack types) — typically edge skycells will be
lost until fixed
•
stack inputs — all in versus cuts with date restrictions (and additional losses in pixel rejection)
•
MD04.alldeeptest.20131010 loaded into PSPS after Taiwan meeting, but images and catalogs can
also be directly compared with the best cuts with date restricted version MD04.cut2009deeptest.
20131103
•
MD04.pv2.deepstack.20140506 with best cuts with date restriction and extra pixel rejection is
next to be loaded into PSPS for comparison •
prior to 1/2010 detrend issues, after 5/2010 baffle improved — change date cuts for PV3?
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD04.pv2_stacktest.20130903#DeepStacks
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD.PV2.deepstack.20130506
MD04.pv2.
deepstack.
20140506
all
g
641
601
577
418
r
623
591
567
417
i
770
691
709
430
z
798
734
695
494
y
562
498
465
301
all,>1/2010!
cuts!
(5-10% loss) (~10% loss)
cuts,>5/2010!
(~40-50%
loss)
PS1SC STScI Meeting 2014
MD.PV3: Full Reprocessing (Maui)
http://svn.pan-starrs.ifa.hawaii.edu/trac/ipp/wiki/MD.PV3
•
Planning and schedule estimates just starting — details will be updated on wiki but will need to
align with deadlines Ken Chambers discussed
•
Fields to include additional surveys:
MD01–10 (~41000 exposures)
STS (~31000)
M31 (~4500)
NCP (~2700)
data products:
exposures: chip --> camera/SMF --> warp stacks: night (MDN), seasonal reference (MDO), deep (MDD), IQ (MDT)
difference images: warp-refstack (WS), nightstack-refstack (SS)
exposure, difference, stack and full-forced photometry to PSPS
•
•
•
•
•
•
•
•
•
PS1SC STScI Meeting 2014