{"id":802,"date":"2025-11-08T18:54:24","date_gmt":"2025-11-08T18:54:24","guid":{"rendered":"https:\/\/icra-audiology.org\/?page_id=802"},"modified":"2026-01-22T21:47:24","modified_gmt":"2026-01-22T21:47:24","slug":"guidelines-assessment-ecological-validity-outcomes","status":"publish","type":"page","link":"https:\/\/icra-audiology.org\/?page_id=802","title":{"rendered":"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO)"},"content":{"rendered":"\n<p>Working group established at the 2022 ICRA meeting in Salamanca, Spain. Co-ordinated by Karolina Smeds. Members: Michael Akeroyd, Louise Hickson, Inga Holube, Gitte Keidser, Graham Naylor. <\/p>\n\n\n\n<p>The goal is to publish our work during 2026.<br>Our aim is to develop a systematic method for assessing the ecological validity of study outcomes (EVO) to help create awareness of the importance of EVO, and facilitate study designs that support high EVO.<br>Our work builds on the definition of ecological validity presented in an earlier consensus paper (<a href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/33105255\/\">Keidser et al. 2020<\/a>).<br>\u201cIn hearing science, ecological validity refers to the degree to which research findings reflect real-life hearing-related function, activity, or participation.\u201d<br>The definition focuses on research findings, highlighting the importance of how well the results of a research study are indicative of what would happen in real or everyday life. To further emphasize this focus on research findings, we have introduced the new term \u201cEcological Validity of Outcomes\u201d (EVO). In the Keidser et al. paper, it was pointed out that ecological validity \u201cis not a binary phenomenon that is either present or absent\u2026 but each study represents a certain level of ecological validity\u201d. This implies that ecological validity can be quantified, and that experiments can have a greater or lesser degree of ecological validity. The working group is focusing on the assessment of EVO.<br>How can this assessment be performed? If we knew about for instance the \u201creal-life hearing-related function\u201d, we could simply compare our results of the study with the function in real life. However, we seldom know about that real-life function, and if we did, we would perhaps not have performed the study.<br>Instead, the basic idea for the suggested assessment tool for EVO is to compare<br>\u25cf What everyday situation a study is designed to investigate<br>with<br>\u25cf how the study design may support or limit EVO<br>Based on five methodological dimensions presented in the paper of Keidser et al. 2020, two main design areas are investigated (1. Stimuli, Environment, and Task, 2. Individual and Context of participation). In these areas, design factors that may support EVO and design factors that may limit EVO are listed. The risks associated with the limiting factors are also rated in two steps. A \u201cLow-risk\u201d limitation is one that probably does not invalidate the results. A \u201cHigh-risk\u201d limitation is strong enough to potentially invalidate the results in relation to the stated purpose of the study.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Working group established at the 2022 ICRA meeting in Salamanca, Spain. Co-ordinated by Karolina Smeds. Members: Michael Akeroyd, Louise Hickson, Inga Holube, Gitte Keidser, Graham Naylor. The goal is to [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-802","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Guidelines for increasing and evaluating ecological validity of study outcomes (EVO) - ICRA Audiology<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/icra-audiology.org\/?page_id=802\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO) - ICRA Audiology\" \/>\n<meta property=\"og:description\" content=\"Working group established at the 2022 ICRA meeting in Salamanca, Spain. Co-ordinated by Karolina Smeds. Members: Michael Akeroyd, Louise Hickson, Inga Holube, Gitte Keidser, Graham Naylor. The goal is to [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/icra-audiology.org\/?page_id=802\" \/>\n<meta property=\"og:site_name\" content=\"ICRA Audiology\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-22T21:47:24+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/?page_id=802\",\"url\":\"https:\\\/\\\/icra-audiology.org\\\/?page_id=802\",\"name\":\"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO) - ICRA Audiology\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/#website\"},\"datePublished\":\"2025-11-08T18:54:24+00:00\",\"dateModified\":\"2026-01-22T21:47:24+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/?page_id=802#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/icra-audiology.org\\\/?page_id=802\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/?page_id=802#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/icra-audiology.org\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/#website\",\"url\":\"https:\\\/\\\/icra-audiology.org\\\/\",\"name\":\"ICRA Audiology\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/icra-audiology.org\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/#organization\",\"name\":\"ICRA Audiology\",\"url\":\"https:\\\/\\\/icra-audiology.org\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/icra-audiology.org\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/ICRA_logo_transp.png\",\"contentUrl\":\"https:\\\/\\\/icra-audiology.org\\\/wp-content\\\/uploads\\\/2024\\\/11\\\/ICRA_logo_transp.png\",\"width\":295,\"height\":80,\"caption\":\"ICRA Audiology\"},\"image\":{\"@id\":\"https:\\\/\\\/icra-audiology.org\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO) - ICRA Audiology","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/icra-audiology.org\/?page_id=802","og_locale":"en_US","og_type":"article","og_title":"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO) - ICRA Audiology","og_description":"Working group established at the 2022 ICRA meeting in Salamanca, Spain. Co-ordinated by Karolina Smeds. Members: Michael Akeroyd, Louise Hickson, Inga Holube, Gitte Keidser, Graham Naylor. The goal is to [&hellip;]","og_url":"https:\/\/icra-audiology.org\/?page_id=802","og_site_name":"ICRA Audiology","article_modified_time":"2026-01-22T21:47:24+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/icra-audiology.org\/?page_id=802","url":"https:\/\/icra-audiology.org\/?page_id=802","name":"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO) - ICRA Audiology","isPartOf":{"@id":"https:\/\/icra-audiology.org\/#website"},"datePublished":"2025-11-08T18:54:24+00:00","dateModified":"2026-01-22T21:47:24+00:00","breadcrumb":{"@id":"https:\/\/icra-audiology.org\/?page_id=802#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/icra-audiology.org\/?page_id=802"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/icra-audiology.org\/?page_id=802#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/icra-audiology.org\/"},{"@type":"ListItem","position":2,"name":"Guidelines for increasing and evaluating ecological validity of study outcomes (EVO)"}]},{"@type":"WebSite","@id":"https:\/\/icra-audiology.org\/#website","url":"https:\/\/icra-audiology.org\/","name":"ICRA Audiology","description":"","publisher":{"@id":"https:\/\/icra-audiology.org\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/icra-audiology.org\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/icra-audiology.org\/#organization","name":"ICRA Audiology","url":"https:\/\/icra-audiology.org\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/icra-audiology.org\/#\/schema\/logo\/image\/","url":"https:\/\/icra-audiology.org\/wp-content\/uploads\/2024\/11\/ICRA_logo_transp.png","contentUrl":"https:\/\/icra-audiology.org\/wp-content\/uploads\/2024\/11\/ICRA_logo_transp.png","width":295,"height":80,"caption":"ICRA Audiology"},"image":{"@id":"https:\/\/icra-audiology.org\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/icra-audiology.org\/index.php?rest_route=\/wp\/v2\/pages\/802","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icra-audiology.org\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/icra-audiology.org\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/icra-audiology.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/icra-audiology.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=802"}],"version-history":[{"count":3,"href":"https:\/\/icra-audiology.org\/index.php?rest_route=\/wp\/v2\/pages\/802\/revisions"}],"predecessor-version":[{"id":820,"href":"https:\/\/icra-audiology.org\/index.php?rest_route=\/wp\/v2\/pages\/802\/revisions\/820"}],"wp:attachment":[{"href":"https:\/\/icra-audiology.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=802"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}