Center Evaluation

Our Center evaluation plan involves the systematic tracking and evaluation of our many activities. Below is our "How-are-we-doing" scorecard that presents top-level measures of interest to our target audiences; the underlying detail is below that.

OHWC at a glance

Our goal is to assess the quality, utility, feasibility, impact, and value of our research, outreach and education activities, translation to practice and dissemination efforts. Gathered via quantitative (e.g., surveys/ evaluation metrics) and qualitative methods (e.g., interviews, focus groups discussions), our program evaluation will help track our path from inputs through activities, to outcome achievement (see the OHWC logic model at the bottom of the page).  Through a continually evolving process, our program evaluation strategy is to amalgamate the data across various indicators.

OHWC's Impact (since 2011)

Intervention Effectiveness Peer-Reviewed Publications

View our complete list of publications
  • Peer-reviewed publications from OHWC-funded projects: 15
    • Number of social media mentions (based on Altmetrics): 36 with potential secondary follower reach of 506,913
  • Associated publications by OHWC researchers (peer-reviewed & others): 53

[Update schedule: monthly; last updated January 2017]


Translation to Practice: Tools & Toolkits

As part of our continuing efforts to translate research to practice, we proudly launch our Kiosks!

Our TOOLKIT KIOSK houses evidence-based resources ready for implementation within organizations. These resources were borne out of our NIOSH-funded projects where we designed, developed, and rigorously tested interventions for Total Worker Health. We currently present our four toolkits:

The Oregon Home Care Commission has committed to making the COMPASS training available to its home care workers.

SHIP
Supervisors play a crucial role in the safety, health and well-being of their employees. Access the SHIP training here.

PUSH
Young workers need Total Worker Health too! Find out how you can adopt PUSH. An adaptation of the PUSH training is in use at the Bureau of Labor and Industries.

Be Super!
How about Total Worker Health for construction workers? Learn about Be Super! and access the toolkit here.

Additionally, we present our TOOLS KIOSK, a collection of expert-recommended resources that can be used as team activities. Tools are organized by topic, industry, and format.
Among these tools, we feature the Health Impacts Safety guides, created by our Institute. Designed for use at wellness and huddles, these guides offer information and active strategies for various health topics pertinent to the workplace. A popular tool at our conferences, here are some data on the dissemination of the Health Impacts Safety guides:
--# guides handed out in person at various events: 2700*
--# visits to this webpage (housing the guides): 1108
--# guides downloaded via webpage: 668
* Since 2015
[Update schedule: quarterly]

Visit our Total Worker Health in Practice page to stay updated!

Community Education

All outreach and education outcomes reflect a composite effort of the Oregon Institute of Occupational Health Sciences (home of OHWC) and the Oregon Healthy Workforce Center.

Since 2011 (birth of OHWC):
[Update schedule: quarterly; last updated July 2016]

  • Bi-annual Symposia (twice a year)
    --Average attendance per event: 92 (plus 10-15 via webinar)
    --Average event rating by attendees: 4.4 out of 5
    --# visits to Symposia webpage: 3760*
    --# session handouts downloaded via webpage: 223*
    --# recorded sessions viewed: 109*
    *Since 2015
  • Occupational Health Psychology Summer Institute (every other year)
    --Average attendance per event: 93
    --Average event rating by attendees: 4.5 out of 5
Impact of our events: the majority of attendees reported positive feedback. For example, following the Sedentary work symposium, 79% of the 30 respondents reported making a change within their workplace and 83% reported a change within their personal life; after the Mindfulness symposium, 45% of 20 respondents reported making a workplace change and 80% reported a change within their personal life, and these changes were rated as positive. Click for more details.
  • Talks by OHWC members (Total Worker Health): 212
[Update schedule: monthly; last updated July 2016]

Website, Social Media, and Testimonials

All social media traffic reflects a composite of the Oregon Institute of Occupational Health Sciences (home of OHWC) as well as the Oregon Healthy Workforce Center.

[Updated quarterly; last updated: 2017 Q1 data]

WEBSITE TRAFFIC

SOCIAL MEDIA
TOTAL WORKER HEALTH RESOURCES


TESTIMONIALS

COMPASS
"I think anybody new coming into this field should have to take the COMPASS class…because it will help exponentially"  

"...I think of myself personally as a caregiver - I may focus on my consumer employer's needs more than my own needs, and so [COMPASS] really did bring an awareness that if my needs, you know my health…my mental health and everything, if I'm balanced, then I feel that I'm a better caregiver"

SHIP
"Employees were cautious at first but now they're the ones asking supervisors if they can revisit the team effectiveness goals. They're really enthusiastic."

PUSH

"The content in the PUSH training helps us ensure that our staff is prepared to work safely and provides information about their rights as workers and encourages them to speak up when they have questions…"

"…we believe that using PUSH as a standard training for new hires is a wise investment in our employees. Not only does it enhance the training that we require for all workers, but the online format allows us to save time and money that we would otherwise need to spend on in-person training."

Supervisor Training
"The program was fun and there was lots of good information. I particularly liked how the staff delivered the program. I would recommend this to others including our main offices…"

"…It made me more aware of being a good role model to fellow coworkers and to also always be a good safety representative…I especially enjoyed the weekly meetings and the camaraderie shared by our team…"


Outreach
"Thanks in part to our attending OHWC symposia and GOSH sessions, we are moving down the path of making everyone…aware of the benefits of a healthy lifestyle, how it relates to a better worker and combining it with safety to get a total package –a healthy and safe worker."

Knowledge Creation

What are some key lessons we have produced through our intervention studies?

  • An intervention focused on supervisor support training and a team effectiveness process can improve employee health.
  • Perceived work-family conflict, job demands, and perceived organizational support are related to the health and well-being of construction workers.
  • Health measures (e.g., body mass index, blood pressure) among older construction workers suggest that they may be a vulnerable population.
  • Together, age and perceived level of decision authority impact construction workers' satisfaction and mental health.
  • Providing increased decision authority is especially important to improving the job satisfaction of older construction workers.
  • A team-based intervention in home care workers demonstrated that we can create simultaneous changes to health and safety factors through an integrated Total Worker Health approach.
  • Feedback from home care workers and the people in the homes where they work suggests that future work should experiment with systems, policies, and advocates for home care workers to remove the barriers to safe practice
  • High retention rates (85% attendance) in an intervention for home care workers demonstrate the desirability/popularity of a group-based approach for this isolated population. Collaborative program development with partner organizations is also likely critical for high engagement in intervention program.
  • In 2014, our review showed that there were only 17 published studies on Total Worker Health. All but 1 of the 17 improved risk factors for injuries and/or chronic illnesses, and 4 improved 10 or more risk factors. Several TWH interventions reported sustained improvements for over a year, although only 1 was available for dissemination.

References

OHWC's Logic Model