Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

CiteULike is a free service for managing and discovering scholarly references - click here to get started.

Sign In to gain access to subscriptions and/or personal tools.
Journal of Positive Behavior Interventions
This Article
Right arrow Abstract Freely available
Right arrow Free Full Text (Free PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by McIntosh, K.
Right arrow Articles by Tobin, T. J.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Technical Adequacy of the Functional Assessment Checklist: Teachers and Staff (FACTS) FBA Interview Measure

Kent McIntosh

University of British Columbia, Vancouver, Canada

Chris Borgmeier

Portland State University, Oregon

Cynthia M. Anderson

University of Oregon, Eugene

Robert H. Horner

University of Oregon, Eugene

Billie Jo Rodriguez

University of Oregon, Eugene

Tary J. Tobin

University of Oregon, Eugene

With the recent increase in the use of functional behavior assessment (FBA) in school settings, there has been an emphasis in practice on the development and use of effective, efficient methods of conducting FBAs, particularly indirect assessment tools such as interviews. There are both benefits and drawbacks to these tools, and their technical adequacy is often unknown. This article presents a framework for assessing the measurement properties of FBA interview tools and uses this framework to assess evidence for reliability and validity of one interview tool, the Functional Assessment Checklist: Teachers and Staff (FACTS; March et al., 2000). Results derived from 10 research studies using the FACTS indicate strong evidence of test—retest reliability and interobserver agreement, moderate to strong evidence of convergent validity with direct observation and functional analysis procedures, strong evidence of treatment utility, and strong evidence of social validity. Results are discussed in terms of future validation research for FBA methods and tools.

Key Words: behavioral assessment • positive behavior supports • functional assessment • behavioral assessment • school-based assessment • applied behavior analysis • Functional behavioral assessment

References

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
  • Baer, D.M., Wolf, M.M., & Risley, T.R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91—97.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Baer, D.M., Wolf, M.M., & Risley, T.R. (1987). Some still-current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 20, 313—327.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Barton-Arwood, S.M., Wehby, J.H., Gunter, P.L., & Lane, K.L. (2003). Functional behavior assessment rating scales: Intrarater reliability with students with emotional or behavioral disorders. Behavioral Disorders, 28, 386—400.[Web of Science]
  • *Bergstrom, M.K. (2003). Efficacy of school-based teams conducting functional behavioral assessment in the general education environment. Unpublished doctoral dissertation, University of Oregon.
  • Bergstrom, M.K., Horner, R.H., & Crone, D.A. (2007). School-based team members conducting functional behavioral assessments in the general education environment. Manuscript submitted for publication.
  • Bijou, S.W., Peterson, R.F., & Ault, M.H. (1968). A method to integrate descriptive and experimental field studies at the level of data and empirical concepts. Journal of Applied Behavior Analysis, 1, 175—191.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Borgmeier, C. (2003). An evaluation of informant confidence ratings as a predictive measure of the accuracy of hypotheses from functional assessment interviews. Unpublished doctoral dissertation, University of Oregon.
  • Borgmeier, C. (2007). Interview prompts: The antecedents to informant responding in functional behavioral assessment interviews. Manuscript in preparation.
  • *Borgmeier, C., & Horner, R.H. (2006). An evaluation of the predictive validity of confidence ratings in identifying accurate functional behavioral assessment hypothesis statements. Journal of Positive Behavior Interventions, 8, 100—105.[Abstract/Free Full Text]
  • Carr, E.G. (1977). The motivation of self-injurious behavior: A review of some hypotheses. Psychological Bulletin, 84, 800—816.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Carr, E.G., Dunlap, G., Horner, R.H., Koegel, R.L., Turnbull, A.P., Sailor, W., et al. (2002). Positive behavior support: Evolution of an applied science. Journal of Positive Behavior Interventions, 4, 4—16, 20.
  • Carr, E.G., Horner, R.H., Turnbull, A., Marquis, J., Magito-McLaughlin, D., McAtee, M., et al. (1999). Positive behavior support as an approach for dealing with problem behavior in people with developmental disabilities: A research synthesis. Washington, DC: American Association on Intellectual and Developmental Disabilities.
  • Carr, E.G., Langdon, N.A., & Yarbrough, S. (1999). Hypothesis-based intervention for severe problem behavior. In A. C. Repp & R. H. Horner (Eds.), Functional analysis of problem behavior: From effective assessment to effective support (pp. 9—31). Belmont, CA: Wadsworth.
  • *Carter, D.L., & Horner, R.H. (2007). Adding functional behavioral assessment to First Step to Success: A case study. Journal of Positive Behavior Interventions, 9, 229—238.[Abstract/Free Full Text]
  • Cone, J.D. (1997). Issues in functional analysis in behavioral assessment. Behaviour Research and Therapy, 35, 259—275.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Conroy, M.A., Fox, J.J., Bucklin, A., & Good, W. (1996). An analysis of the reliability and stability of the Motivation Assessment Scale in assessing the challenging behaviors of persons with developmental disabilities. Education and Training in Mental Retardation and Developmental Disabilities, 31, 243—250.
  • Crone, D.A., Hawken, L.S., & Bergstrom, M.K. (2007). A demonstration of training, implementing, and using functional behavioral assessment in 10 elementary and middle school settings. Journal of Positive Behavior Interventions, 9, 15—29.[Abstract/Free Full Text]
  • Crone, D.A., & Horner, R.H. (2003). Building positive behavior support systems in schools: Functional behavioral assessment. New York: Guilford.
  • Drasgow, E., & Yell, M.L. (2001). Functional behavioral assessment: Legal requirements and challenges. School Psychology Review, 30, 239—251.[Web of Science]
  • Dunlap, G. (2006). The applied behavior analytic heritage of PBS: A dynamic model of action-oriented research. Journal of Positive Behavior Interventions, 8, 58—60.[Free Full Text]
  • DuPaul, G.J., Eckert, T.L., & McGoey, K.E. (1997). Interventions for students with attention-deficit/hyperactivity disorder: One size does not fit all. School Psychology Review, 26, 369—381.
  • Ervin, R.A., DuPaul, G.J., Kern, L., & Friman, P.C. (1998). Classroom-based functional and adjunctive assessments: Proactive approaches to intervention selection for adolescents with attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 31, 65—78.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Ervin, R.A., Ehrhardt, K.E., & Poling, A. (2001). Functional assessment: Old wine in new bottles. School Psychology Review, 30, 156—172.[Web of Science]
  • Ervin, R.A., Radford, P., Bertsch, K., Piper, A., Ehrhardt, K., & Poling, A. (2001). A descriptive analysis and critique of the empirical literature on school-based functional assessment. School Psychology Review, 30, 193—210.[Web of Science]
  • *Filter, K.J., & Horner, R.H. (in press). Functionally-indicated academic interventions for problem behavior. Journal of Positive Behavior Interventions.
  • Floyd, R.G., Phaneuf, R.L., & Wilczynski, S.M. (2005). Measurement properties of indirect assessment methods for functional behavioral assessment: A review of research. School Psychology Review, 34, 58—73.[Web of Science]
  • Gresham, F.M. (2003). Establishing the technical adequacy of functional behavioral assessment: Conceptual and measurement challenges. Behavioral Disorders, 28, 282—298.[Web of Science]
  • Gresham, F.M., & Davis, C.J. (1988). Behavioral interviews with teachers and parents. In E. Shapiro & T. Kratochwill (Eds.), Behavioral assessment in schools: Conceptual foundations and practical applications (pp. 455—493). New York: Guilford Press.
  • Hawken, L.S., & Horner, R.H. (2003). Evaluation of a targeted group intervention within a school-wide system of behavior support. Journal of Behavioral Education, 12, 225—240.
  • Hayes, S.C., Nelson, R.O., & Jarrett, R.B. (1986). Evaluating the quality of behavioral assessment. In R. O. Nelson & S. C. Hayes (Eds.), Conceptual foundations of behavioral assessment (pp. 463—503). New York: Guilford.
  • Hoff, K.E., Ervin, R.A., & Friman, P.C. (2005). Refining functional behavioral assessment: Analyzing the separate and combined effects of hypothesized controlling variables during ongoing classroom routines. School Psychology Review, 34, 45—57.[Web of Science]
  • Horner, R.H. (1994). Functional assessment: Contributions and future directions. Journal of Applied Behavior Analysis, 27, 401—404.[CrossRef][Medline] [Order article via Infotrieve]
  • Horner, R.H., Vaughn, B.J., Day, H.M., & Ard, W.R. (1996). The relationship between setting events and problem behavior: Expanding our understanding of behavioral support. In L. Koegel, R. L. Koegel, & G. Dunlap (Eds.), Positive behavioral support: Including people with difficult behavior in the community (pp. 381—402). Baltimore: Brookes.
  • Individuals with Disabilities Education Act of 1990, 20 U.S.C. § 1400 et seq. (1990) (amended 1997).
  • Individuals with Disabilities Education Improvement Act of 2004, 20 U.S.C. § 1400 et seq. (2004) (reauthorization of the Individuals with Disabilities Education Act of 1990).
  • Ingram, K., Lewis-Palmer, T., & Sugai, G. (2005). Function-based intervention planning: Comparing the effectiveness of FBA function-based and non-function-based intervention plans. Journal of Positive Behavior Interventions, 7, 224—236.[Abstract/Free Full Text]
  • Iwata, B., Dorsey, M., Slifer, K., Bauman, K., & Richman, G. (1994). Toward a functional analysis of self injury. Journal of Applied Behavior Analysis, 27, 196—209. (Original work published in 1982 in Analysis and Intervention in Developmental Disabilities, 2, 3—20.)[CrossRef][Web of Science]
  • Iwata, B., Pace, G., Dorsey, M., Zarcone, J., Vollmer, T., Smith, R.G., et al. (1994). The functions of self-injurious behavior: An experimental epidemiological analysis. Journal of Applied Behavior Analysis, 27, 215—240.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Johnston, J.M., & Pennypacker, H.S. (1993). Strategies and tactics of human behavioral research (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
  • Kearney, C.A., & Albano, A.M. (2004). The functional profiles of school refusal behavior: Diagnostic aspects. Behavior Modification, 28, 147—161.[Abstract/Free Full Text]
  • Kearney, C.A., Pursell, C., & Alvarez, K. (2001). Treatment of school refusal behavior in children with mixed functional profiles. Cognitive and Behavioral Practice, 8, 3—11.[CrossRef]
  • Kern, L., & Dunlap, G. (1999). Assessment-based interventions for children with emotional and behavioral disorders. In A. C. Repp & R. H. Horner (Eds.), Functional analysis of problem behavior: From functional assessment to effective support (pp. 197—218). Monterey, CA: Brooks/Cole.
  • Kinch, C., Lewis-Palmer, T., Hagan-Burke, S., & Sugai, G. (2001). A comparison of teacher and student functional behavior assessment interview information from low-risk and high-risk classrooms. Education and Treatment of Children, 24, 480—494.
  • Kwak, M.M., Ervin, R.A., Anderson, M.Z., & Austin, J. (2004). Agreement of function across methods used in school-based functional assessment with preadolescent and adolescent students. Behavior Modification, 28, 375—401.[Abstract/Free Full Text]
  • *March, R.E., & Horner, R.H. (2002). Feasibility and contributions of functional behavioral assessment in schools. Journal of Emotional and Behavioral Disorders, 10, 158—170.[Abstract/Free Full Text]
  • March, R.E., Horner, R.H., Lewis-Palmer, T., Brown, D., Crone, D., Todd, A.W., et al. (2000). Functional Assessment Checklist: Teachers and Staff (FACTS). Eugene, OR: Educational and Community Supports.
  • McIntosh, K., Brown, J.A., & Borgmeier, C.J. (in press). Validity of functional behavior assessment within an RTI framework: Evidence and future directions. Assessment for Effective Intervention.
  • McIntosh, K., Kauffman, A.L., & Carter, D.R. (2007). Relations among informal, standardized, and functional behavior measures: ODRs, suspensions, BASC-2, and FACTS. Manuscript submitted for publication.
  • *McKenna, M.K. (2006). The role of function-based academic and behavior supports to improve reading achievement. Unpublished doctoral dissertation, University of Oregon.
  • Merrell, K. (2007). Behavioral, social, and emotional assessment of children and adolescents (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
  • Nelson, J.R., Roberts, M.L., Rutherford, R.B., Mathur, S.R., & Aaroe, L.A. (1999). A statewide survey of special education administrators and school psychologists regarding functional behavioral assessment. Education and Treatment of Children, 22, 267—279.
  • Nelson-Gray, R.O. (2003). Treatment utility of psychological assessment. Psychological Assessment, 15, 521—531.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • Newcomer, L.L., & Lewis, T.J. (2004). Functional behavioral assessment: An investigation of assessment reliability and effectiveness of function-based interventions. Journal of Emotional and Behavioral Disorders, 12, 168—181.[Abstract/Free Full Text]
  • O'Neill, R.E., Horner, R.H., Albin, R.W., Sprague, J.R., Storey, K., & Newton, J.S. (1997). Functional assessment and program development for problem behavior: A practical handbook (2nd ed.). Pacific Grove, CA: Brooks/Cole.
  • Pelios, L., Morren, J., Tesch, D., & Axelrod, S. (1999). The impact of functional analysis methodology on treatment choice for self-injurious and aggressive behavior. Journal of Applied Behavior Analysis, 32, 185—195.[CrossRef][Medline] [Order article via Infotrieve]
  • *Preciado, J.A. (2006). Using a function-based approach to decrease problem behavior and increase reading academic engagement for Latino English language learners. Unpublished doctoral dissertation, University of Oregon.
  • Radford, P.M., & Ervin, R.A. (2002). Employing descriptive functional assessment methods to assess low-rate, high-intensity behaviors: A case example. Journal of Positive Behavior Interventions, 4, 146—155.[Abstract/Free Full Text]
  • Reed, H., Thomas, E., Sprague, J.R., & Horner, R.H. (1997). The student guided functional assessment interview: An analysis of student and teacher agreement. Journal of Behavioral Education, 7, 33—49.
  • Reitman, D., & Hupp, S.D. (2003). Behavior problems in the school setting: Synthesizing structural and functional assessment. In M. L. Kelley, G. H. Noell & D. Reitman (Eds.), Practitioner's guide to empirically based measures of school behavior (pp. 23—36). New York: Kluwer Academic/Plenum Press.
  • Repp, A.C., & Karsh, K.G. (1994). Hypothesis-based interventions for tantrum behaviors of persons with developmental disabilities in school settings. Journal of Applied Behavior Analysis, 27, 21—31.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]
  • *Salentine, S.P. (2003, May). The impact of "contextual fit" on the selection of behavior support plan procedures. In R. H. Horner (Chair), Moving from functional assessment to the design of behavior support. Symposium conducted at the conference of the International Association for Behavior Analysis, San Francisco.
  • Sasso, G.M., Conroy, M.A., Stichter, J.P., & Fox, J.J. (2001). Slowing down the bandwagon: The misapplication of functional assessment for students with emotional or behavioral disorders. Behavioral Disorders, 26, 282—296.
  • *Schindler, H.R., & Horner, R.H. (2005). Generalized reduction of problem behavior of young children with autism: Building trans-situational interventions. American Journal of Mental Retardation, 110, 36—47.[CrossRef][Medline] [Order article via Infotrieve]
  • Scott, T.M., Bucalos, A., Liaupsin, C., Nelson, C.M., Jolivette, K., & DeShea, L. (2004). Using functional behavior assessment in general education settings: Making a case for effectiveness and efficiency. Behavioral Disorders, 29, 189—201.[Web of Science]
  • Shriver, M.D., Anderson, C.M., & Proctor, B. (2001). Evaluating the validity of functional behavior assessment. School Psychology Review, 30, 180—192.[Web of Science]
  • Skinner, B.F. (1953). Science and human behavior. New York: Macmillan.
  • Sprague, J.R., & Horner, R.H. (1999). Low-frequency high-intensity problem behavior: Toward an applied technology of functional assessment and intervention. In A. C. Repp & R. H. Horner (Eds.), Functional analysis of problem behavior: From effective assessment to effective support (pp. 98—116). Belmont, CA: Wadsworth.
  • Stage, S.A., Cheney, D., Walker, B., & LaRocque, M. (2002). A preliminary discriminant and convergent validity study of the Teacher Functional Behavioral Assessment Checklist. School Psychology Review, 31, 71—93.[Web of Science]
  • Sterling-Turner, H.E., Robinson, S.L., & Wilczynski, S.M. (2001). Functional assessment of distracting and disruptive behaviors in the school setting. School Psychology Review, 30, 211—226.
  • Sturmey, P. (Ed.). (2007). Functional analysis in clinical treatment. Chicago, IL: Elsevier.
  • Sugai, G., Horner, R.H., Dunlap, G., Hieneman, M., Lewis, T.J., Nelson, C.M., et al. (2000). Applying positive behavior support and functional behavioral assessment in schools. Journal of Positive Behavior Interventions, 2, 131—143.[Abstract/Free Full Text]
  • Sugai, G., Lewis-Palmer, T., & Hagan, S. (1998). Using functional assessments to develop behavior support plans. Preventing School Failure, 43, 6—13.
  • Sugai, G., Lewis-Palmer, T., & Hagan-Burke, S. (1999—2000). Overview of the functional behavioral assessment process. Exceptionality, 8, 149—160.[CrossRef]
  • Thompson, B. (Ed.). (2003). Score reliability: Contemporary thinking on reliability issues. Thousand Oaks, CA: Sage.
  • Todd, A.W., Horner, R.H., & Sugai, G. (1999). Self-monitoring and self-recruited praise: Effects on problem behavior, academic engagement, and work completion in a typical classroom. Journal of Positive Behavior Interventions, 1, 66—76.[Abstract/Free Full Text]
  • Vollmer, T.R., Northup, J., Ringdahl, J.E., LeBlanc, L.A., & Chauvin, T.M. (1996). Functional analysis of severe tantrums displayed by children with language delays. Behavior Modification, 20, 97—115.[Abstract]
  • Zarcone, J.R., Rodgers, T.A., Iwata, B.A., Rourke, D.A., & Dorsey, M.F. (1991). Reliability analysis of the Motivation assessment scale: A failure to replicate. Research in Developmental Disabilities, 12, 349—360.[CrossRef][Web of Science][Medline] [Order article via Infotrieve]

Journal of Positive Behavior Interventions, Vol. 10, No. 1, 33-45 (2008)
DOI: 10.1177/1098300707311619
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 Journal of Positive Behavior InterventionsHome page
K. McIntosh, A. L. Campbell, D. R. Carter, and C. Rossetto Dickey
Differential Effects of a Tier Two Behavior Intervention Based on Function of Problem Behavior
Journal of Positive Behavior Interventions, April 1, 2009; 11(2): 82 - 93.
[Abstract] [PDF]

Home page
 Assessment for Effective InterventionHome page
K. McIntosh, J. A. Brown, and C. J. Borgmeier
Validity of Functional Behavior Assessment Within a Response to Intervention Framework: Evidence, Recommended Practice, and Future Directions
Assessment for Effective Intervention, December 1, 2008; 34(1): 6 - 14.
[Abstract] [PDF]

Home page
 Journal of Special EducationHome page
K. McIntosh, R. H. Horner, D. J. Chard, C. R. Dickey, and D. H. Braun
Reading Skills and Function of Problem Behavior in Typical School Settings
Journal of Special Education, November 1, 2008; 42(3): 131 - 147.
[Abstract] [PDF]

This Article
Right arrow Abstract Freely available
Right arrow Free Full Text (Free PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by McIntosh, K.
Right arrow Articles by Tobin, T. J.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?