How big is the universe?

December 16th, 2011 by Tom

Sometimes we can get a sense of the immensity of the universe from mundane things. The odometer on my 10 year old car is approaching 186,000 miles. That’s about as far as light goes in a single second. It takes light about 1.5 seconds to go from the Earth to the Moon, so I haven’t even gone as far as the nearest celestial body. The solar system is small potatoes though. To get to the very nearest objects that someone using SkyView is likely to want to look at, it takes light over 4 years, over 120 million seconds. That’s a billion years of driving. I don’t think the warranty will hold out!

Features in the Gallery: Don’t look too close.

November 14th, 2011 by Tom

We recently had a query about features in the image
.
You can see it in the Gallery.

There images seems to have a very sharp but colorful transition between the bottom left and top right, but there are also a series of red steps on the left. If you look very closely you may see the the white block has two steps parallel to (and of the same width) as the red steps.

What’s going on here?

There are several different things happening here. Almost everything we’re seeing is an artifact of how we chose to sample the data. If you look at the characteristics of the image in the link above, you’ll see that it’s only about 0.0272 degrees on a side. However the survey it is based on, the H-alpha composite image says that the pixels in the underlying data are 2.5′. That’s about 0.042 degrees. So the image we’re looking at covers less than a single pixel in the input data does. We’re immensely oversampled.

Once we realize this, it’s pretty clear that we’re seeing two pixels. The original data in in galactic coordinates, so the border between the two pixels is oblique rather than horizontal or vertical.

The colored stripe is a consequence of using the clip resampling and a rather large smoothing radius (11 in this case). This tends to blur the sharp edges between the pixels so that instead of seeing a step function at the edge between the two pixels, we see a gradual transition with a width of about a dozen pixels. A Stern Special color table means makes the transition look like a rainbow rather than a sequence of grays. The fact that the transitions seems to cover the entire color table is not meaningful. No matter how little dynamic range there is in the image, the default is to try to emphasize details by using the entire color table. In fact the two pixels are not especially different compared to other pixels in the image.

For me, the really hard thing to understand were the steps in the image. Where do they come from? To understand them you really need to understand the clip resampling that this image uses. We call the sampler clip resampling because the way it works is to superpose the grid of user defined pixels on top of the grid of survey pixels. The clip sampler assumes that the flux in each input pixel is evenly distributed over the pixels. In this case the output pixels are much smaller than the input pixels (by a factor of about 600) so they would form a dense almost rectilinear grid over the much coarser survey pixels. The key is the ‘almost’. We’re dealing with projections in the sky, so there are small distortions from rectilinearity. Some of the output pixels are a little bigger than others — and they tend to get larger as we move from right to left in the image. Larger pixels collect a little more flux and so the pixels get smoothing increasing values as we moved from right to left. However, the color table only has a few values that are available in the range of fluxes, so we get the step function that initially seems some mysterious.

If we’d used the Clip (Intensive) sampler, instead of the Clip (Flux conserving) the steps would disappear. This sampler divides each output pixel by the size of the output pixel so that it exactly cancels out the changes in pixel values.

skyview image clip intensive sampler

H-Alpha Comp image using Clip (Intensive) sampler

If we’d used the default nearest neighbor method, we’d also not have seen the steps.

On the other hand if we’d used the bi-linear interpolation or the higher order resamplers which try to smoothly interpolated between pixels, then the image will look entirely different since the gradient of the image in both directions will affect the image, not just the two pixels we happen to overlap.

H-Alpha Comp image using Nearest Neighbor sampler

The take home lesson here is that you shouldn’t oversample survey data too much — and you certainly don’t want to ascribe any meaning to features that are smaller than the survey resolution.

Fermi Survey Files

May 31st, 2011 by Tom

The survey description files for the Fermi soft and hard surveys were improperly formatted so that users attempting to use the SkyView jar in batch mode would not be able to query these surveys.  The files have been updated in the latest release (with the new SDSS surveys).

 

SkyView Support for SDSS DR8

May 31st, 2011 by Tom

We have updated SkyView to use the DR8 release of the Sloan Digital Sky Survey (SDSS). The DR8 includes substantially greater sky coverage and is a major reprocessing of all data in the SDSS. There are a fair number of changes both in the content and internal formats. The changes are summarized by the SDSS team in their differences page. A key change is that the new data are sky subtracted so that individual pixel values are very different between the DR7 and DR8. While the loglog scaling was often helpful is showing features in the DR7, the default log scaling generally does fine with the DR8.

Internally the data provided to SkyView has changed substantially. Data are now compressed using the BZIP2 compression technique and getting efficient support for decompressing these data was one of the reasons it took us so long to update.

Since the DR7 and DR8 differ significantly  SkyView will support both for a transition period. The SDSSx survey names will point to the DR8 while the SDSSDR7x surveys will point to the DR7. The servers for the DR8 and entirely different from the DR7.  Last week there was some problem with the DR8′s servers’ hardware.  If such problems recur you can use the DR7 surveys as a backup.   The DR7 surveys are listed at the bottom of the menu in which the DR8 surveys are found.

Since the SDSS data are retrieved from a remote source,  SkyView needs to download the data into its cache before processing. SkyView only downloads files once, but SDSS requests may take a little longer than users are used to since we’d already filled the DR7 cache with many of the popular target areas. We’ll phase out DR7 support if and as usage of the DR7 surveys drops off.

 

SkyView Image Gallery – over 10,000 images

April 27th, 2011 by Laura

Did you know that the image displayed on the SkyView home page is a random image selected from the SkyView Image Gallery which features images created by SkyView users? If you click on the image you can see the specifics – center coordinates, survey, projection, etc. We find it hard to believe we now have over 10,000 images in our gallery and we have seen some truly amazing submissions.

We plan to make some improvements soon to speed up the time it takes to submit the images and to group the images in the gallery so they can be viewed by survey, date, position, etc. We also want to comment more on some of the more unusual images that can be generated in SkyView.

Thank you for your interest in SkyView!

SkyView Allsky Images from Gamma-ray to Radio

April 26th, 2011 by Laura

We have been thinking of ways to add more educational aspects to the SkyView website and our first step was to create a slide show of survey data that cover the entire sky. This first image set is in equatorial coordinates and we hope to add galactic images soon and then interactive enhancements as time permits. Of course the first lesson we learn from these images is that the sky looks different in different wavelengths. We also see that certain celestial features come and go. This is typically dependent on the process by which the radiation is emitted.

We hope that these images are interesting to SkyView users. Let us know if you have any comments.

SkyView system usage

March 8th, 2011 by Laura

The number of SkyView queries has increased by a factor of 5 over the last year and with our recent move to a virtual machine architecture we have been able to accommodate this growth. However we experienced a spike in usage last night that did affect system availability. Although SkyView is processing queries again we are working with our system administrators to analyze and improve the situation. We apologize for any inconvenience.

SkyView 2MASS data interruption March 1, 2011

March 1st, 2011 by Laura

The remote system that serves 2MASS data was down for scheduled maintenance for a couple hours today. As of 3:50pm EST service has been restored and 2MASS data is again available in SkyView. We apologize for any inconvenience.

SkyView Fermi LAT Surveys

February 28th, 2011 by Tom

We have just released two gamma-ray all-sky surveys based upon the Fermi LAT weekly data. Fermi images go much deeper and have somewhat higher resolution than the old EGRET surveys. Fermi is also sensitive to gamma-rays at significantly higher energies, up to 300 GeV.

The two surveys cover the bands 0.1-5.4 GeV and 5.4-300 GeV. There are many more counts in the lower energy survey and many more sources are apparent there. The surveys are generated from the weekly exposure maps and photon lists supplied by the Fermi LAT team. The exposures are summed together to create an overall exposure map and the photon lists are combined and resampled in 1/8 degree pixels in a Cartesian projection. The combined exposure at the center of each of these pixels is then sampled and weighted by the size of the pixel to get the normalized exposure. The ratio of the counts to the weighted is used to get the intensity of the pixel. Currently we are only providing the intensity maps but we can also include the counts and exposure maps if there is interest. We also hope to provide a 3-D Fermi survey with perhaps 10 energy bands.

Fermi’s new hard band extends SkyView‘s frequency coverage a full decade above the previous upper limit.

SkyView updates GALEX survey

February 16th, 2011 by Laura

Galaxy Evolution Explorer (GALEX) surveys have been updated to use the GALEX GR6 release. As mentioned in a previous post GR6 improvements include more sky coverage and a bit better calibration. Image generation for GALEX may be slow for a period of time as the data file caches get rebuilt. More GALEX mission information can be found at the Space Telescope Science Institute GALEX page.