Changing QSO Catalog Inputs

I'm trying to figure out how to modify the inputs (currently SDSS DR5 quasars with good photometry) into Joe's Monte Carlo. Here is what I have figured out so far (all the below files are on riemann):

hiz_kde_numerator.pro ;main program to generate the QSO Catalog
(calls) →
qso_fakephoto.pro ;generates simulated redshift and i-magnitude based on luminosity function and DR5 inputs
(calls) →
qso_photosamp.pro ;This generates the training set photometry
(calls) →
sdss_read_data.pro ;This reads in SDSS data it currently has the following 'DR5' call
qsos = sdss_read_data('DR5', Z_MIN = Z_MIN, Z_MAX = Z_MAX)

Here is a color-color redshift temperature plot of these DR5 QSOs:


I'm going to try to add in the BOSS QSOs with co-added photometry, especially in the redshift range z > 2.0 where we seem to be missing QSOs:


I found that there are 1,973 BOSS quasars that have a redshift above 2.0 for which we also have coadded photometry. Here they are plotted:


While it is a little more filled in in the u-g = 0.8 space, comparing it to all the BOSS quasars (regardless of how good their photometry is) below:

Improving Luminosity Function

Had a long chat with Joe Hennawi today. He basically went through his Quasar Monte Carlo (that generates the QSO catalog for the likelihood) and showed me where to make improvements.

He agrees that what we are doing with variability and putting the QSOs in the denominator of the likelihood calculation is correct. He thinks we have problems we need to first address are:

1. Because we remove all variable objects from the everything catalog, we basically don't have low redshift quasars anywhere in our code, and so we need to change the QSO catalog to include these (but only put them in the denominator, and keep the numerator to only be QSOs in our redshift range).

2. The luminosity function isn't working well enough for low redshifts to do (1) so I need to fix this by using Richard '06 function instead -- this is coded up already, I just need to implement it.

Joe also described to me his work at NYU. I need to get in touch with Jo Bovy and get a description of his "extreme deconvolution" method for a "future possibilities" slide for my Utah talk.

Here are (very rough) notes from my talk with Joe today, basically for my own use:

get luminosity function working on joe's monte carlo
change likelihood so that numerator is z, 2.15 - 4 and denominator, is all quasars of all redshifts)
hopkins/richards paper

make same plot as on blog with coadded photometery

send joe the coadded stipe-82 and median seeing.

jo bovi

/home/jhennawi/Projects/QSOClustering/pro/data/kde
file for monte-carlo - hiz_kde_numerator.pro

/home/jhennawi/Projects/QSOClustering/pro/k_correct/qso_mag_rand.pro

hiz_kde_numerator
dndz file is generated (need to fix it with different luminosity function)
randomly select objects from dndz distribution.
qso_mag_rand - given limitis generate random magnitudes
qso_fakephoto -matches the redshifts and imagnitude
if brighter than some magnitude limit, then uses real data, if less than

/home/jhennawi/Projects/QSOClustering/pro/k_correct/qso_dndz.pro
luminosity function code
computes the number counts of quasars in dn/dz so integrated over dz would get number count between

don't change the cosmological parameters.

/home/jhennawi/Projects/QSOClustering/pro/k_correct/qso_lf_shen.pro
needs to be modified
try to implement the Richards '06

/home/jhennawi/Projects/QSOClustering/pro/k_correct/shen_hopkins/QSO_LF.pro

QSO_LF_SHEN

n(i_faint,i_bright, z_min,z_max) = int_z_min^z_max dz qso_dndz(i_faint,i_bright,z)

/home/jhennawi/Projects/QSOClustering/pro/data/sdss/hiz_qso_dndz.pro
generates the distribution
change so it goes from 0.5 to 5.0

Files I'm using:
/home/jhennawi/Projects/QSOClustering/pro/data/kde
[3/3/10 1:13:26 PM] Joseph F. Hennawi: /home/jhennawi/Projects/QSOClustering/pro/k_correct/qso_mag_rand.pro
[3/3/10 1:25:51 PM] Joseph F. Hennawi: n(i_faint,i_bright, z_min,z_max) = int_z_min^z_max dz qso_dndz(i_faint,i_bright,z)
[3/3/10 1:28:45 PM] Joseph F. Hennawi: /home/jhennawi/Projects/QSOClustering/pro/k_correct/qso_lf_shen.pro
[3/3/10 1:30:22 PM] Joseph F. Hennawi: /home/jhennawi/Projects/QSOClustering/pro/k_correct/qso_lf_shen.pro
[3/3/10 1:32:11 PM] Joseph F. Hennawi: /home/jhennawi/Projects/QSOClustering/pro/k_correct/shen_hopkins
[3/3/10 1:41:52 PM] Joseph F. Hennawi: /home/jhennawi/Projects/QSOClustering/pro/data/sdss/hiz_qso_dndz.pro