PROC QLEARN

Downloads

(Available free to members. Register.)

32-bit SAS Procedure:

64-bit SAS Procedure:

Users' Guide:


	[X] Terms and Conditions of Use (c) 2012, The Pennsylvania State University. This program is free software; you can redistribute it and/or modify it under the terms described below. WARRANTY This software is provided "as is," and any express or implied warranties, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose, are expressly disclaimed. In no event shall Penn State University or its employees be liable for any direct, indirect, incidental, special, exemplary, or consequential damages (including, but not limited, the costs of procurement of substitute goods or services; loss of use, data or profits; or business interruption) however caused and on any theory of liability, whether in contract, strict liability, or tort (including negligence or otherwise) arising in any way out of the use of this software, even if advised in advance of the possibility of such damage. PUBLICATIONS Any peer-reviewed publication in which this software is used will include a citation of the software in the reference section. Sample citations in APA format will be available on The Methodology Center website for as long as the software is supported by the center. REDISTRIBUTION Redistribution and use of this software, with or without modification, are permitted, provided that the following conditions are met: 1. Any redistribution must include the above copyright notice and disclaimer and this list of conditions in any related documentation and, if feasible, in the redistributed software. 2. Any redistribution must include the acknowledgment, "This product includes software developed by Methodology Center, The Pennsylvania State University," in any related documentation and, if feasible, in the redistributed software. 3. The names "Penn State" and "Penn State University", and “The Pennsylvania State University” are trademarks of The Pennsylvania State University and may not be used in association with any goods or services, including products derived from these materials, without the prior express written agreement of The Pennsylvania State University. OTHER TERMS By downloading this software, you are agreeing to abide by the terms and conditions contained herein. By downloading, you are obtaining a non-exclusive license to use these materials in accordance with these terms. Nothing contained herein shall be deemed a waiver of any rights by The Pennsylvania State University in these materials.


	[X] Terms and Conditions of Use (c) 2012, The Pennsylvania State University. This program is free software; you can redistribute it and/or modify it under the terms described below. WARRANTY This software is provided "as is," and any express or implied warranties, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose, are expressly disclaimed. In no event shall Penn State University or its employees be liable for any direct, indirect, incidental, special, exemplary, or consequential damages (including, but not limited, the costs of procurement of substitute goods or services; loss of use, data or profits; or business interruption) however caused and on any theory of liability, whether in contract, strict liability, or tort (including negligence or otherwise) arising in any way out of the use of this software, even if advised in advance of the possibility of such damage. PUBLICATIONS Any peer-reviewed publication in which this software is used will include a citation of the software in the reference section. Sample citations in APA format will be available on The Methodology Center website for as long as the software is supported by the center. REDISTRIBUTION Redistribution and use of this software, with or without modification, are permitted, provided that the following conditions are met: 1. Any redistribution must include the above copyright notice and disclaimer and this list of conditions in any related documentation and, if feasible, in the redistributed software. 2. Any redistribution must include the acknowledgment, "This product includes software developed by Methodology Center, The Pennsylvania State University," in any related documentation and, if feasible, in the redistributed software. 3. The names "Penn State" and "Penn State University", and “The Pennsylvania State University” are trademarks of The Pennsylvania State University and may not be used in association with any goods or services, including products derived from these materials, without the prior express written agreement of The Pennsylvania State University. OTHER TERMS By downloading this software, you are agreeing to abide by the terms and conditions contained herein. By downloading, you are obtaining a non-exclusive license to use these materials in accordance with these terms. Nothing contained herein shall be deemed a waiver of any rights by The Pennsylvania State University in these materials.

PROC QLEARN Users' Guide (v. 1.0)

Which to Download?

In SAS, open HELP/ABOUT menu
"W64..." = 64-bit SAS
"W32..." or other = 32-bit SAS

Need Help?

Email MCHelpDesk@psu.edu

Install

View the step-by-step installation instructions PDF version

Questions? Email MCHelpDesk@psu.edu

Overview

PROC QLEARN, developed by the Methodology Center, is a SAS procedure for analyzing data from a sequential, multiple assignment, randomized trial (SMART) to develop adaptive interventions. The procedure uses a generalization of Q-learning, which allows treatments and covariates vary over time. Compatible with SAS version 9.1 or higher. Features include

works with two-decision-stages,
obtains confidence intervals for the regression parameters from decision stage 1,
enables construction of more richly-individualized adaptive interventions, and
takes full advantage of data generated during a SMART.

Key Terms

What is Q-learning?

Q-learning, a method developed in computer science, is an extension of the standard regression method that can be used with longitudinal data in which treatments and covariates vary over time.

What is SMART?

A sequential, multiple assignment, randomized trial (SMART) is an experimental design that enables scientists to build better adaptive interventions.

What is an adaptive intervention?

An adaptive intervention is a course of time-varying treatment designed to adapt to an individual’s changing life circumstances, response to treatment, or other designated indicator.

Recommended Citations

PROC QLEARN (Version 1.0) [Software] (2012). University Park: The Methodology Center, Penn State. Retrieved from http://methodology.psu.edu

Ertefaie, A., Almirall, D. A., Huang L., Dziak, J. J., Wagner, A. T., & Murphy, S. A. (2012). SAS PROC QLEARN users’ guide (Version 1.0). University Park: The Methodology Center, Penn State. Retrieved from http://methodology.psu.edu

Installation Tester

Paste and run the code below in SAS. If it runs without error, installation succeeded.

If installation fails, consult the install instructions on the left or email the help desk.

DATA test;
INPUT o11 o12 o13 a1 o21 o22 a2 y s;
DATALINES;
1  1.13703 0 -1 . 1  . 3 0
0 -0.56694 0 -1	5 1  1 4 1
0  0.55262 1  1 5 0 -1 4 1
0 -0.0125  0  1 5 0 -1 4 1
0 -0.57121 1  1 6 0  1 2 1
0 -0.68428 1 -1	8 0 -1 4 1
0  1.16931 0 -1 . 1  . 3 0
0  0.36947 1  1 6 1 -1 3 1
0 -0.51073 0  1	8 0  1 3 1
0 -0.63154 0 -1	3 1  1 4 1
0  1.71328 0 -1	7 1  1 3 1
1 -0.223   0  1	3 0 -1 4 1
0 -0.9589  0 -1	5 0 -1 4 1
0  0.03775 0 -1	3 1  1 5 1
0 -1.64151 0  1	2 0 -1 4 1
0  0.78999 0  1	4 0 -1 5 1
0 -1.05713 0 -1	1 0 -1 4 1
0 -1.02893 0  1	2 0 -1 5 1
0  1.10093 1  1	2 0  1 2 1
0 -0.61391 0  1 1 1  1 5 1

RUN;

PROC QLEARN DATA=test; 
   MAIN1 o11 o12; 
   TAILOR1 o13;
   MAIN2 o13 o21 ;
   TAILOR2 o22;
   RESPONSE y;
   STG2SAMPLE s;
   STG1TRT a1;
   STG2TRT a2;
RUN;