Development and Testing of Program Evaluation Instruments for the iCook 4-H Curriculum

Douglas R. Mathews, Zachary J. Kunicki, Sarah E. Colby, Lisa D Franzen-Castle, Kendra K. Kattelmann, Melissa D. Olfert, Adrienne A. White

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Objective: To develop and test the validity of program outcome evaluation instruments for cooking, eating, and playing together for obesity prevention during iCook 4-H. Design: Instrument development for both youth and adults through pre-post testing of items newly constructed and compiled to address key curriculum constructs. Testing occurred throughout program intervention and dissemination to determine dimensionality, internal consistency and test-retest reliability, and validity. Setting: A 5-state out-of-school program in cooperative extension and other community sites. Participants: Youths aged 9–10 years; adults were main food preparers; the first phase involved 214 dyads and the second phase, 74 dyads. Main Outcome Measure(s): Youth measures were cooking skills, culinary self-efficacy, physical activity, and openness to new foods. Adult measures were cooking together, physical activity, and eating together. Analysis: Exploratory factor analysis to determine initial scale structure and confirmatory factor analysis to confirm factor structures. Longitudinal invariance tests to see whether the factor structure held over time. Test-retest reliability was determined by Pearson r and internal consistency was determined by coefficient Ω and Cronbach α. Validity testing was determined by Pearson r correlations. Results: Youth cooking skills, openness to new foods, and adult eating together and cooking together showed strong evidence for dimensionality, reliability, and validity. Youth physical activity and adult physical activity measures showed strong evidence for dimensionality and validity but not reliability. The youth culinary self-efficacy measure showed strong evidence for reliability and validity but weaker evidence for dimensionality. Conclusions and Implications: Program outcome evaluation instruments for youths and adults were developed and tested to accompany the iCook 4-H curriculum. Program leaders, stakeholders, and administrators may monitor outcomes within and across programs and generate consistent reporting.

Original languageEnglish (US)
Pages (from-to)S21-S29
JournalJournal of Nutrition Education and Behavior
Volume51
Issue number3
DOIs
StatePublished - Mar 1 2019

Fingerprint

Program Development
Program Evaluation
Curriculum
Reproducibility of Results
Cooking
Exercise
Eating
Self Efficacy
Food
Statistical Factor Analysis
Administrative Personnel
Obesity
Outcome Assessment (Health Care)

Keywords

  • cooking
  • dyad interventions
  • iCook 4-H
  • program evaluation
  • youth

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Nutrition and Dietetics

Cite this

Development and Testing of Program Evaluation Instruments for the iCook 4-H Curriculum. / Mathews, Douglas R.; Kunicki, Zachary J.; Colby, Sarah E.; Franzen-Castle, Lisa D; Kattelmann, Kendra K.; Olfert, Melissa D.; White, Adrienne A.

In: Journal of Nutrition Education and Behavior, Vol. 51, No. 3, 01.03.2019, p. S21-S29.

Research output: Contribution to journalArticle

Mathews, Douglas R. ; Kunicki, Zachary J. ; Colby, Sarah E. ; Franzen-Castle, Lisa D ; Kattelmann, Kendra K. ; Olfert, Melissa D. ; White, Adrienne A. / Development and Testing of Program Evaluation Instruments for the iCook 4-H Curriculum. In: Journal of Nutrition Education and Behavior. 2019 ; Vol. 51, No. 3. pp. S21-S29.
@article{99600565e5704bd28802942fa352f483,
title = "Development and Testing of Program Evaluation Instruments for the iCook 4-H Curriculum",
abstract = "Objective: To develop and test the validity of program outcome evaluation instruments for cooking, eating, and playing together for obesity prevention during iCook 4-H. Design: Instrument development for both youth and adults through pre-post testing of items newly constructed and compiled to address key curriculum constructs. Testing occurred throughout program intervention and dissemination to determine dimensionality, internal consistency and test-retest reliability, and validity. Setting: A 5-state out-of-school program in cooperative extension and other community sites. Participants: Youths aged 9–10 years; adults were main food preparers; the first phase involved 214 dyads and the second phase, 74 dyads. Main Outcome Measure(s): Youth measures were cooking skills, culinary self-efficacy, physical activity, and openness to new foods. Adult measures were cooking together, physical activity, and eating together. Analysis: Exploratory factor analysis to determine initial scale structure and confirmatory factor analysis to confirm factor structures. Longitudinal invariance tests to see whether the factor structure held over time. Test-retest reliability was determined by Pearson r and internal consistency was determined by coefficient Ω and Cronbach α. Validity testing was determined by Pearson r correlations. Results: Youth cooking skills, openness to new foods, and adult eating together and cooking together showed strong evidence for dimensionality, reliability, and validity. Youth physical activity and adult physical activity measures showed strong evidence for dimensionality and validity but not reliability. The youth culinary self-efficacy measure showed strong evidence for reliability and validity but weaker evidence for dimensionality. Conclusions and Implications: Program outcome evaluation instruments for youths and adults were developed and tested to accompany the iCook 4-H curriculum. Program leaders, stakeholders, and administrators may monitor outcomes within and across programs and generate consistent reporting.",
keywords = "cooking, dyad interventions, iCook 4-H, program evaluation, youth",
author = "Mathews, {Douglas R.} and Kunicki, {Zachary J.} and Colby, {Sarah E.} and Franzen-Castle, {Lisa D} and Kattelmann, {Kendra K.} and Olfert, {Melissa D.} and White, {Adrienne A.}",
year = "2019",
month = "3",
day = "1",
doi = "10.1016/j.jneb.2018.10.014",
language = "English (US)",
volume = "51",
pages = "S21--S29",
journal = "Journal of Nutrition Education and Behavior",
issn = "1499-4046",
publisher = "Elsevier Inc.",
number = "3",

}

TY - JOUR

T1 - Development and Testing of Program Evaluation Instruments for the iCook 4-H Curriculum

AU - Mathews, Douglas R.

AU - Kunicki, Zachary J.

AU - Colby, Sarah E.

AU - Franzen-Castle, Lisa D

AU - Kattelmann, Kendra K.

AU - Olfert, Melissa D.

AU - White, Adrienne A.

PY - 2019/3/1

Y1 - 2019/3/1

N2 - Objective: To develop and test the validity of program outcome evaluation instruments for cooking, eating, and playing together for obesity prevention during iCook 4-H. Design: Instrument development for both youth and adults through pre-post testing of items newly constructed and compiled to address key curriculum constructs. Testing occurred throughout program intervention and dissemination to determine dimensionality, internal consistency and test-retest reliability, and validity. Setting: A 5-state out-of-school program in cooperative extension and other community sites. Participants: Youths aged 9–10 years; adults were main food preparers; the first phase involved 214 dyads and the second phase, 74 dyads. Main Outcome Measure(s): Youth measures were cooking skills, culinary self-efficacy, physical activity, and openness to new foods. Adult measures were cooking together, physical activity, and eating together. Analysis: Exploratory factor analysis to determine initial scale structure and confirmatory factor analysis to confirm factor structures. Longitudinal invariance tests to see whether the factor structure held over time. Test-retest reliability was determined by Pearson r and internal consistency was determined by coefficient Ω and Cronbach α. Validity testing was determined by Pearson r correlations. Results: Youth cooking skills, openness to new foods, and adult eating together and cooking together showed strong evidence for dimensionality, reliability, and validity. Youth physical activity and adult physical activity measures showed strong evidence for dimensionality and validity but not reliability. The youth culinary self-efficacy measure showed strong evidence for reliability and validity but weaker evidence for dimensionality. Conclusions and Implications: Program outcome evaluation instruments for youths and adults were developed and tested to accompany the iCook 4-H curriculum. Program leaders, stakeholders, and administrators may monitor outcomes within and across programs and generate consistent reporting.

AB - Objective: To develop and test the validity of program outcome evaluation instruments for cooking, eating, and playing together for obesity prevention during iCook 4-H. Design: Instrument development for both youth and adults through pre-post testing of items newly constructed and compiled to address key curriculum constructs. Testing occurred throughout program intervention and dissemination to determine dimensionality, internal consistency and test-retest reliability, and validity. Setting: A 5-state out-of-school program in cooperative extension and other community sites. Participants: Youths aged 9–10 years; adults were main food preparers; the first phase involved 214 dyads and the second phase, 74 dyads. Main Outcome Measure(s): Youth measures were cooking skills, culinary self-efficacy, physical activity, and openness to new foods. Adult measures were cooking together, physical activity, and eating together. Analysis: Exploratory factor analysis to determine initial scale structure and confirmatory factor analysis to confirm factor structures. Longitudinal invariance tests to see whether the factor structure held over time. Test-retest reliability was determined by Pearson r and internal consistency was determined by coefficient Ω and Cronbach α. Validity testing was determined by Pearson r correlations. Results: Youth cooking skills, openness to new foods, and adult eating together and cooking together showed strong evidence for dimensionality, reliability, and validity. Youth physical activity and adult physical activity measures showed strong evidence for dimensionality and validity but not reliability. The youth culinary self-efficacy measure showed strong evidence for reliability and validity but weaker evidence for dimensionality. Conclusions and Implications: Program outcome evaluation instruments for youths and adults were developed and tested to accompany the iCook 4-H curriculum. Program leaders, stakeholders, and administrators may monitor outcomes within and across programs and generate consistent reporting.

KW - cooking

KW - dyad interventions

KW - iCook 4-H

KW - program evaluation

KW - youth

UR - http://www.scopus.com/inward/record.url?scp=85056880082&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85056880082&partnerID=8YFLogxK

U2 - 10.1016/j.jneb.2018.10.014

DO - 10.1016/j.jneb.2018.10.014

M3 - Article

VL - 51

SP - S21-S29

JO - Journal of Nutrition Education and Behavior

JF - Journal of Nutrition Education and Behavior

SN - 1499-4046

IS - 3

ER -