Work We’ve Done

October 19, 2013.


Back to the Work We’ve Done Page >>

2Project: An Assessment of the Impact of Canadian Institute for Photonic Innovations (2012).
In March 2012, TEN provided the Canadian Institute for Photonic Innovations (CIPI) a detailed logic model specific to its purposes and expected impacts on companies. The logic model resulted in measures to be used for the assessment of the impact that CIPI makes on the resources and capabilities of companies, and the impact that it makes on the market performance of companies.

The evaluation study provided an independent review of the achievements of CIPI against its mandate, and determined the impact of CIPI on industry partners:

  • On average, companies report that:
    1. CIPI achieves greatest impact on companies’ market performance by impacting their degree of innovation, applied research investments, and by reducing their time to market; and
    2. CIPI is attributed positive impact on companies’ ability to innovate by 88% of respondents
  • On average, client companies attributed CIPI’s greatest impact to be through:
    1. Access to research personnel
    2. Knowledge, information or advice
    3. Access to equipment or facilities; and
    4. Technology development.
  • The impacts attributed to CIPI on improving the resources and capabilities of companies are significantly associated with CIPI’s impacts on companies’ market performance.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

3In 2011, TEN provided the Technology Transfer and Business Enterprise (TTBE), University of Ottawa, with an impact assessment that reported the actual impact of the University of Ottawa’s research and technology partnership offerings on companies. The assessment proved to be very beneficial and insightful for TTBE, allowing further development of services to improve overall efficiency of its offerings and enabling increased impact on company clients.

“TEN provided an analysis that was very beneficial and insightful…TTBE will continue to work with TEN to further assess the efficacy of our services on our company clients.”

D. Joe Irvine

Director, Technology Transfer and Business Enterprise, University of Ottawa

4Project: An Assessment of Canada’s Tri-Agency College and Community Innovation (CCI) Program (2012)
The CCI program is supported by three agencies of Canada’s federal government. It is managed by the Natural Sciences and Engineering Research Council of Canada (NSERC) in collaboration with the Canadian Institutes of Health Research (CIHR) and the Social Sciences and Humanities Research Council of Canada (SSHRC).

The CCI Program provides funding to Canadian colleges to strengthen their applied research capacity, and to carry out applied research and technology transfer activities. The program aims to benefit companies, in particular small and medium-sized companies, in areas where the colleges have recognized expertise relevant to local or regional needs.

To assess the impact of the CCI program on companies, TEN developed a customized questionnaire based upon TEN’s proprietary impact assessment methodology and key elements of the CCI program’s Logic Model. A comprehensive evaluation of CCI’s impact was reported to NSERC and used for planning and reporting purposes


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

5In 2013, TEN provided Innovation Saskatchewan with a detailed logic model specific to TRTech’s purposes and expected impacts on companies, as well as an impact assessment that reported the actual impact that TRTech had on Saskatchewan-based companies. TEN’s analysis and impact assessment report enabled Innovation Saskatchewan to set a baseline that they will use to compare TRTech’s impact year-over-year in an effort to improve efficiencies and continue to help innovative companies grow in the region.  Not only did the analysis report on the attributed impact of TRTech, it demonstrated how TRTech achieves impact on companies, and the services that are most beneficial to its clients.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

6In 2010 and 2012, TEN provided Tekes with an impact assessment that reported the actual impact that UCLA’s Global Access Program (GAP) has on Finnish companies.  Further, in 2012 TEN conducted a comparison analysis between the two cohort years to determine whether or not the program was improving over time. Tekes is Finland’s main funding organization for research, development, and innovation.  Tekes is a repeat customer of TEN, using benchmarking comparisons to track improvements over time, learn from best practices, and implement new learnings to become more efficient.  TEN’s impact assessments have enabled Tekes and GAP to expand their reach and improve the attributed impact they have on Finnish companies.
See the impact of evidence TEN has had on the Global Access Program >>


“As Tekes tries to renew itself and change its focus it’s good to have someone from outside to evaluate the program and present factual evidence.”

Minh Lam

Senior Technology Advisor, Tekes

6In 2010 and 2012, TEN provided Tekes with an impact assessment that reported the actual impact that UCLA’s Global Access Program (GAP) has on Finnish companies.  Further, in 2012 TEN conducted a comparison analysis between the two cohort years to determine whether or not the program was improving over time. Tekes is Finland’s main funding organization for research, development, and innovation.  Tekes is a repeat customer of TEN, using benchmarking comparisons to track improvements over time, learn from best practices, and implement new learnings to become more efficient.  TEN’s impact assessments have enabled Tekes and GAP to expand their reach and improve the attributed impact they have on Finnish companies.
See the impact of evidence TEN has had on the Global Access Program >>


“As Tekes tries to renew itself and change its focus it’s good to have someone from outside to evaluate the program and present factual evidence.”

Minh Lam

Senior Technology Advisor, Tekes

6Projects: Assessments of the Impact of Tekes (2010 – 2017)
Tekes is the most important publicly funded expert organization for financing research, development and innovation in Finland. TEN worked with Tekes multiple times, conducting several projects designed to assess the impact of Tekes business support instruments on companies and research organizations. In 2015, TEN and its partner Ramboll Management Consulting (RMC) conducted an assessment of Tekes activities on researchers and research-intensive companies’ capabilities during the period October – November 2014. TEN and RMC developed a customized questionnaire for companies, and a customized questionnaire for researchers and research organizations, based upon TEN’s impact assessment methodology. TEN also conducted an extensive literature review to determine specific measures applicable to both target groups. In 2015, TEN and RMC delivered a comprehensive analysis of Tekes’ support, not only determining the impact that Tekes’ has had on these target groups, but also best practices and a list of capabilities that are most important and lead to greater performance improvements for both companies and researchers.

In 2013, TEN assessed Tekes’ Young Innovative Companies (NIY) Program. The NIY program was found to have significant impact on Finnish companies. For example, companies responding to a survey, designed and conducted by TEN, attributed €99.1 million in revenue and 1,172 jobs created to the NIY Program. The program was found to be in alignment with Finnish innovation policy in terms of increasing both the capacity of companies to perform, and their performance in the marketplace. It was found that the impact on companies’ performance increased with increasing funding from the NIY Program.

Further, TEN assessed the Global Access Program’s (GAP) impact on Finnish companies in 2010 and 2012. In addition, a comprehensive analysis was conducted to determine its performance over time. It was found that the GAP program caused positive impact on the internationalization of Finnish companies, mainly due to the strategic international expertise they are able to acquire through the program. As well, the GAP program increased its impact on companies after 2010. Benefit-cost analysis was conducted in both years. Tekes continued to support the GAP program, and has expanded it to China and SE Asia, based upon the assessments that were done by TEN.

In 2017, TEN conducted a third evaluation of the (now) Tekes Market Access Programs (TEKES-MAP) against their goals, specifically, the impact on companies and the Finnish economy that can be attributed to the programs. The final evaluation included impact analyses findings showing TEKES-MAP’s attributed impact on companies, impact analysis on revenue generation, impact on the Finnish economy, benefit-cost analysis, interpretations of results, and recommendations to increase impact (i.e., what is being done well, and what can be improved). A comparative analysis was also provided, comparing the TEKES-GAP program’s impact on graduated companies from previous assessments with results from the growth survey, highlighting the current performance of the graduated companies with the Finnish innovation ecosystem.

See the impact of evidence TEN has had on the Young Innovative Companies Program >>


“TEN’s approach to impact assessment is a significant advance on past approaches employed here at Tekes and elsewhere.”

Dr. Raine Hermans

Director, Strategic Intelligence, Tekes

7Project: Logic Model Development for the Department of Foreign Affairs and International Trade Canada (2012)
In 2012, TEN developed two innovation related logic models that articulated the role that innovation plays at DFAIT, and more specifically in the Innovation Science and Technology Division. These logic models showed how the Division and Department contribute to Canadian prosperity, and how innovation measurement is possible. TEN synthesized various logic models already in effect at DFAIT, and provided recommendations on elements that would strengthen the quality of the support and the ability to articulate the prosperity benefits generated by the efforts carried out. TEN’s logic model became the basis for the business plan of the Innovation Science and Technology Division
Project: An Assessment of the Impact of the National Research Council’s Human Health Therapeutics Program (2014 & 2017)

In 2014 and 2017, TEN provided impact evaluation strategies, including logic model reports, for the National Research Council’s Human Health Therapeutics Program (NRC-HHT)’s Portfolio. The logic models resulted in impact assessment measures consistent with the evaluation strategies, and enabled TEN to develop customized surveys that were delivered to NRC-HHT’s client companies in the bio-pharmaceutical industry. The data were analyzed using regression techniques to better understand predictors of impact that NRC-HHT has on bio-pharmaceutical companies. The 2017 assessment allowed TEN to provide a comparison analysis showing year-over-year improvements, to NRC-HHT. NRC-HHT used the assessments for strategic and operational planning, and for reporting purposes. As a result of the findings, NRC-HHT was able to leverage additional funds to expand and upgrade its Pilot Plant facilities in Montreal. TEN’s impact assessment methodology served the Human Health Therapeutic Portfolio in terms of reporting its impact to NRC corporate so much so that leadership advocated its use across all of the portfolios of NRC.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

8In 2012, TEN provided the Alberta Enterprise and Advance Education (EAE) with a detailed logic model specific to the Rural Alberta Business Centre (RABC) Pilot Program’s purposes as innovation enablers and expected impacts on entrepreneurs and small businesses. In 2013, TEN provided an impact assessment to Alberta EAE that reported the impact that the RABCs have on companies in rural Alberta.

Alberta EAE selected TEN to conduct an impact assessment in the first year of its three year RABC Pilot Program to assess the attributed impact RABCs have on companies.  The results of TEN’s analysis were used to set a baseline for the RABC Pilot Program that will be used to compare the impact year-over-year in an effort to improve efficiencies and further help entrepreneurs and small business in rural Alberta. Not only did the analysis report on the attributed impact of the RABCs, it demonstrated how the RABCs achieve impact on companies, and the services that are most beneficial to companies in rural Alberta.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

9Projects: Assessments of the Impact of Communitech (2014 – 2017)
Communitech is one of Canada’s leading business accelerators. Over three successive years, TEN assessed the impact of Communitech on companies it had served. Not only did the results provide comparisons of year-over-year performance, but also provided insights into continuous improvement interventions. As well, the degree of impact attributed to Communitech on the regional economy was determined, and found to be far in excess of Communitech’s budget. The impact assessments delivered to Communitech are being used for strategic and operational planning, and reporting purposes.

“The Evidence Network (TEN) plays a pivotal role in identifying Communitech’s impact on companies. Their comprehensive analysis keeps us a step ahead in terms of improving services to clients, and increasing our impact on the Waterloo region tech ecosystem.” – Iain Klugman, President and CEO, Communitech

Further, in 2015, Communitech, the University of Waterloo Velocity, the Wilfrid Laurier LaunchPad, and the Waterloo Accelerator Centre formed a collaborative partnership, funded by the Canada Accelerator and Incubator Program (CAIP). In 2016-2017, TEN conducted an evaluation to determine the achievements of the Communitech CAIP project in the second year (of a five year CAIP funded project), and to establish a baseline to which future years’ assessments could be compared. TEN developed a customized logic model and impact questionnaire, and delivered a comprehensive evaluation outlining the impact achieved on client companies by each of the partners. Conclusions and recommendations are being used to fulfill CAIP reporting requirements, and for the purpose of continuous program improvements. TEN will conduct an additional evaluation in the project’s final year, comparing year-over-year results and overall outcomes.

See the impact of evidence TEN has had on Communitech >>

 


“TEN plays a pivotal role in identifying Communitech’s impact on companies.  Their comprehensive analysis keeps us a step ahead in terms of improving services to clients, and increasing our impact on the Waterloo region tech ecosystem.”

Iain Klugman

President and CEO, Communitech

10In 2012, TEN provided SpringBoard West Innovations Inc. (SBWI) with a detailed logic model specific to its purposes and expected impacts on companies, as well as an impact assessment that reported the actual impact that SBWI has on companies.Results from TEN’s impact assessment were used to justify continued funding of SBWI, and to identify services that lead to the greatest impact on the performance of companies.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

6In 2013, TEN provided Tekes with a detailed logic model specific to the Young Innovative Companies (NIY) Program’s expected impacts on companies, as well as an impact assessment that reported the actual impact that the NIY Program has on companies. Tekes is Finland’s main funding organization for research, development, and innovation.  Tekes used TEN’s impact assessment to determine the outcomes of the NIY Program from the perspectives of firms themselves and from Finland’s innovation policy.  Further, TEN’s analysis was able to provide Tekes with information on how funding provided to program participant companies helped firms to find additional private funding networks.  TEN’s assessment provided evidence required by Tekes to understand the impact of the NIY Program concerning helping innovative companies with early stage funding in Finland.
See the impact of evidence TEN has had on the Young Innovative Companies Program >>


“As Tekes tries to renew itself and change its focus it’s good to have someone from outside to evaluate the program and present factual evidence.”

Minh Lam

Senior Technology Advisor, Tekes

11In 2009, TEN provided the Zhejiang University Science Park with an impact assessment that reported the actual impact the Science Park has on companies. The assessment proved to be very beneficial and insightful for Zhejiang University Science Park. TEN found that companies with less residency time in the Science Park reported greater impacts on their organizations. This finding allowed the Science Park to further develop their services and to improve overall efficiency of their offerings to company clients.

“The President of the Science Park took great interest in the report as it helped us to focus on improvements to the services we offer.”

Mingguo Shao

Director, Zhejiang University Science Park

12Project: An Assessment of the Impact of the Centre for Commercialization of Research (2012)
In 2012, TEN and its partner Nordicity conducted an economic impact evaluation for the Centre for Commercialization of Research (CCR). The analysis drew upon a variety of primary and secondary data sources, including an online survey of client companies (developed by TEN) in order to quantify the economic impact that could be directly attributed to CCR.

The report not only quantified the direct economic impacts, but also the spin-off and spill-over impacts associated with CCR client companies’ development of innovative products and services for global markets.


“We are very impressed by the clarity of results and the way TEN’s methodology naturally leads to meaningful conclusions.”

Dr. Mario Thomas

Former Senior Vice President, Ontario Centres of Excellence

13In 2011, TEN provided Wavefront Wireless Innovation Society of British Columbia with a detailed logic model specific to its purposes and expected impacts on companies, as well as an impact assessment that reported the actual impact it has on companies. The assessment proved to be very beneficial and insightful for Wavefront. The results were used to create a baseline for Wavefront, against which future evaluations are compared. The insights obtained from TEN’s analysis have allowed Wavefront to further develop its services to improve overall efficiency of its offerings to company clients.
See the impact of evidence TEN has had on Wavefront >>


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

14Projects: An Assessment of the Impact of the Centre for Excellence in Mining Innovation (2013)
In 2013, TEN provided CEMI with a logic model report, impact assessment, and impact analysis. TEN’s report has been used by CEMI to clarify its results for internal and external communication, and help secure the ongoing support of stakeholders and funders. TEN’s assessment of CEMI required significant depth of analysis, as CEMI facilitates cross-sector innovation and collaboration across a broad range of clients: Canadian and global companies, universities & colleges, governments, and innovative SMEs within the mining service and supply sector. TEN’s analysis clarified CEMI’s intended mechanisms of impact.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

14Project: A Study of Business Incubators and Business Accelerators in Canada (2012)
In 2012, TEN provided Industry Canada’s Science and Innovation Sector with an overview of the current status of business incubators (BIs) and business accelerators (BAs) in Canada.

The report included a review of the academic literature on the effectiveness of BIs and BAs, and a brief description of business incubation and acceleration activities in six comparator countries: the United States, the United Kingdom, Finland, Australia, China, and Singapore. The objective was to equip government decision makers with a synopsis of the current state of both practice, and the scientific examination of practice, so as to enable informed decision-making.
See the full report TEN provided to Industry Canada >>


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

14Projects: How Canada’s Polytechnics Impact Companies (2012)
Canada’s polytechnics are degree-granting, industry-responsive, post-secondary education institutions committed to creating jobs by helping companies grow, especially small- and mid-sized companies, through applied research and innovation. Polytechnics Canada is the national alliance among nine such research-intensive, publicly-funded colleges and institutes of technology. The alliance was established in 2003 to be the voice of colleges and institutes with a focus on advanced technology education.

In continuing to build relevant, effective, and well-funded applied research programs in support of industry, Polytechnics Canada identified the need for a rigorous approach to assessing the impact of the polytechnics. To this end, Polytechnics Canada elected to use TEN’s methodology. TEN developed a customized logic model for Polytechnics Canada that identified impact measures to be used in the evaluation of Canadian polytechnics. The logic model became the basis for future impact assessments of Polytechnics Canada.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

5Project: An Assessment of the Impact of TRTech on Saskatchewan-based companies (2013)
In 2013, Innovation Saskatchewan (IS) engaged The Evidence Network (TEN) to help assess the impact of IS investments, and in this context, to assess the impact that TRTech had on Saskatchewan-based companies. TEN provided an impact assessment evaluation of TRTech-Saskatchewan along with a customized logic model specific to TRTech. The TRTech logic model described how TRTech impacts Saskatchewan-based firms. The logic model resulted in impact assessment measures and enabled TEN to develop a customized survey that was delivered to TRTech’s client companies. The data was analyzed using regression techniques to better understand predictors of impact that TRTech has on companies. TEN determined that TRTech contributed a total of approximately $6.1 million to companies’ revenues, approximately $1.6 million to financing received by companies, and to over 132 jobs created. A benefit-cost analysis was conducted, and the impact assessment that was delivered to Innovation Saskatchewan in June 2013 was used for strategic planning and funding allocation purposes.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

8Projects: Assessments of the Impact of the Rural Alberta Business Centre Pilot Program (2012, 2014 & 2016)
The Rural Alberta Business Centre (RABC) Pilot Program was developed to provide services to small businesses in rural Alberta in an efficient and cost-effective manner. In 2012, 2014, and 2016 TEN conducted impact assessments of the Rural Alberta Business Centre (RABC) Pilot Program on behalf of the Government of Alberta. In support of these assessments, TEN developed a detailed logic model specific to RABC purposes and expected impact on their clients(entrepreneurs and small businesses). The logic model determined measures used to assess the impact of the RABC program on companies’ resources and capabilities, as well as the impact of the RABC program on the market performance of companies.

The results of TEN’s analysis were used to set a baseline for the RABC Pilot Program, compare the year-over-year impact of the centres in an effort to improve efficiencies, and further help entrepreneurs and small business in rural Alberta. Not only did the evaluation report attributed impact of the RABCs, but it also demonstrated how the RABCs achieve impact on companies, and the services that are most beneficial to companies in rural Alberta. The overall findings from these assessments were used to guide the programming decisions in an effort to effectively allocate provincial funding and resources. As a result, the Government of Alberta extended the RABC Pilot Program beyond its initial term (keeping four of the original eight centres open).


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12In 2010 and 2011 TEN provided CCR with impact assessments that reported the actual impact it had on companies.  CCR used the information provided by TEN to confirm it was fulfilling a critical part of its overall strategic objective, and aligned services to help further facilitate growth of company clients in the market.

“We are very impressed by the clarity of results and the way TEN’s methodology naturally leads to meaningful conclusions.”

Dr. Mario Thomas

Former Senior Vice President, Ontario Centres of Excellence

6In 2010 and 2012, TEN provided Tekes with an impact assessment that reported the actual impact that UCLA’s Global Access Program (GAP) has on Finnish companies.  Further, in 2012 TEN conducted a comparison analysis between the two cohort years to determine whether or not the program was improving over time. Tekes is Finland’s main funding organization for research, development, and innovation.  Tekes is a repeat customer of TEN, using benchmarking comparisons to track improvements over time, learn from best practices, and implement new learnings to become more efficient.  TEN’s impact assessments have enabled Tekes and GAP to expand their reach and improve the attributed impact they have on Finnish companies.
See the impact of evidence TEN has had on the Global Access Program >>


“As Tekes tries to renew itself and change its focus it’s good to have someone from outside to evaluate the program and present factual evidence.”

Minh Lam

Senior Technology Advisor, Tekes

12Project: An Assessment of the Impact of Business Support Programs in Vietnam and Cambodia (2016)

In 2016, the Asian Development Bank (ADB), on behalf of governments in Vietnam and Cambodia, selected TEN to assess the impact of existing business development support programs in Vietnam and Cambodia and to help make policy recommendations on how these programs can improve impact on client companies. TEN was chosen for its impact assessment methodology, which allows for benchmarking of the entrepreneurial and innovation environment across different cities within SE Asia, and also for its international impact evaluation experience. TEN provided ADB with an independent review of the achievements of incubators and business support programs in Vietnam and Cambodia against their goals, specifically, the impact on companies and the economy, and developed a series of training materials and seminars for incubator managers and government agencies on best practices pertaining to the measurement and evaluation of such programs.

ADB is using the results of this evaluation to support the implementation of policy recommendations in SE Asia, which feed directly into incubator and support program design and management. Further, as part of this evaluation project, TEN also developed a series of training materials and seminars for incubator managers and government agencies on best practices pertaining to the measurement and impact assessments to help build the evaluation capacity in the region. TEN hosted representatives from Vietnam and Cambodia from various governmental ministries and departments, and research and academic agencies for a one-week intensive training program.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

apfcAsia Pacific Foundation of Canada (APFC)

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of AllerGen (2015)
In 2015, TEN provided an impact evaluation of AllerGen NCE Inc. (AllerGen) and its network. The evaluation study provided an independent review of the achievements of AllerGen against its mandate, and determined the impact of AllerGen and its network on industry, non-profits, and government bodies. It takes substantial time before improvements to resources and capabilities to lead to improvements in market performance, especially for organizations operating in the healthcare ecosystem, where the product development life cycle is long. Therefore, it was important to AllerGen that TEN identify key performance indicators to track, in the short and long-term, and make recommendations for improvements in its performance monitoring and evaluation strategies.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of the British Columbia Innovation Council (2015)
In 2015, TEN conducted an evaluation to determine the achievements of the business support programs funded by the British Columbia Innovation Council (BCIC). TEN assessed the following support programs, incubators, and accelerators funded by BCIC: Venture Acceleration Program (VAP), which includes 13 incubators and accelerators across the province), entrepreneurship@UBC(an accelerator program and incubation space at the University of British Columbia), the BC New Ventures Competition, Launch Academy, and various other programs and workshops.

TEN developed a customized logic model and impact questionnaire based on its impact assessment methodology, and delivered a comprehensive, baseline evaluation outlining the impact achieved on client companies by the various programs and incubators. TEN also determined the economic impact of the various programs on the BC economy (overall contributions to GDP), and the attributed economic impact that was associated with BCIC funding. The baseline evaluation results will be used to compare future impacts of the programs, tracking year-over year improvements, to inform evidence-based funding decisions.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: A Baseline Impact Assessment of BioFoodTech (2016)
In 2016, TEN was commissioned to determine the impacts of BioFoodTech on companies, and to establish a baseline to which future impacts may be compared. TEN developed a customized impact questionnaire based on its impact assessment methodology, and delivered a comprehensive, baseline evaluation outlining the impact of BioFoodTech on client companies as well as its overall economic impact on the PEI economy. The baseline evaluation results will be used to compare future impacts of the programs, tracking year-over year improvements, to inform evidence-based funding decisions.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: Assessment of the Impact of Cando and Canadian Aboriginal Economic Development Officers (2015)
In 2015, TEN conducted impact assessments of the Council for the Advancement of Native Development Officers (Cando) and the Canadian Aboriginal Economic Development Officers (EDOs). TEN assessed Cando’s impact through the development of a customized impact survey, data assembly, and analysis of impact data, ultimately producing a comprehensive report identifying Cando’s attributed impact on its membership, specifically, that of its knowledge translation and engagement activities, which result from Cando’s certification process, and other knowledge exchange services offered.

The analysis also determined the economic and social impacts that result from the activities of the EDOs in Aboriginal communities. The approach taken by TEN in this evaluation ensured the identification of short-term or immediate impacts, identifying possible program gaps and opportunities for future integration into Cando’s program planning and management, and also identified longer-term impacts on the performance of its membership, and ultimately the downstream outcomes that result in socioeconomic benefits in Aboriginal Communities.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Projects: Accountability and Evaluation Framework (2015); Logic Model and Performance Evaluation Framework (2016), and An Assessment of the Impact of the Centre for Aging and Brain Health (2017)
In August 2015, Baycrest engaged TEN to provide assistance in the development of an Accountability and Evaluation Framework for CABHI. With a focus on guiding the selection, development, and ongoing use of credible performance measures, the overarching purpose of the framework was to assist CABHI in engaging with its stakeholders, and in monitoring, decision-making, and reporting as CABHI progresses towards its goals. The Accountability and Evaluation Framework was developed in accordance with the Government of Canada’s guidelines for the creation of sound management and accountability frameworks.
In 2016, TEN was again selected to work with CABHI to develop a Logic Model and Performance Evaluation Framework. This framework consists of indicators and the development of annual performance targets that the Centre will use to track its success in reaching its expected outcomes over the next five years, and beyond.

Together with commitments from the Federal and Provincial Governments, the Baycrest Foundation, and from for-profit and not-for-profit partners, CABHI will leverage $124 million over five years to achieve a goal of improving the quality of life of aging adults while stimulating economic development in the sector.

In 2017, TEN was commissioned to provide annual impact assessments over the next four years, culminating in a summative evaluation to determine the Centre’s impact on improved health outcomes for seniors and clients living with complex medical issues (e.g., dementia or other brain health related disorders), and their family, friends, and caregivers.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Consortium for Research and Innovation in Aerospace in Quebec

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of the Sylvia Fedoruk Centre for Nuclear Innovation (2016)
In 2016, TEN conducted an evaluation to determine the achievements of the Sylvia Fedoruk Centre for Nuclear Innovation (Fedoruk Centre). TEN developed a customized logic model and questionnaire based on TEN’s impact assessment methodology, and delivered a comprehensive evaluation outlining the impacts achieved on researchers, and through them, impacts on its partners in academia, industry, and other research organizations. TEN’s assessment of the Fedoruk Centre’s is being used to clarify the role it plays in facilitating innovation in a critical and sensitive area of research, inform improvements it can make to maximize its impact, and position Saskatchewan and Canada as leaders in nuclear research.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of the Finnish Ministry of Economic Affairs and Employment (2014)
In conjunction with Ramboll Management Consulting (RMC- the leading management consulting company in the Nordic countries), TEN assessed the impact of all Finland’s key business support programs on companies. TEN’s methodology was used for the survey development, deployment, data collection, and impact evaluation, while the role of RMC was in translation of the findings into policy recommendations for the Finnish government. Over 5,000 companies and entrepreneurs supported by 11 government programs were surveyed as part of the impact assessment. Based on the work conducted for MEE, TEN was recently selected along with a consortium of partners to work on behalf of the Prime Minister of Finland’s Office to strengthen Finland’s innovation policy.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of Genome Alberta (2017)
In 2017, TEN was selected to conduct an impact assessment to determine the impact of Genome Alberta on researchers. TEN developed a customized logic model, and an impact survey questionnaire, and is in the process of creating and conducting stakeholder interviews to ultimately deliver a comprehensive impact assessment report, and impact infographic that will outline the impact of Genome Alberta on researcher partners in the Province of Alberta.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of Genome Atlantic(2016)
In 2016, TEN conducted an impact assessment to determine the impact of Genome Atlantic on its two main client groups: companies and researchers. Ten developed a customized logic model, impact survey questionnaire, and created and conducted stakeholder interviews to deliver a comprehensive impact assessment report and impact infographic outlining the impact of Genome Atlantic on industry and researcher partners in the Atlantic Provinces. The response rates for this assessment were exceptionally high, which speaks to the quality of the relationship between Genome Atlantic and its clients.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of Genome British Columbia (2015)
In 2015, TEN and its partner Dennis Rank and Associates were selected to provide an impact evaluation of Genome British Columbia (Genome BC). Using our unique impact assessment methodology, TEN developed customized surveys for companies, researchers, and not-for-profit organizations, using the impact assessment indicators and measures derived from the logic model. The evaluation study provided an independent review of the achievements of Genome BC against its goals, determined the impact of Genome BC on industry, researchers, and non profits operating in BC, and developed recommendations for continuous improvement. The evaluation is being used to align Genome BC’s strategy with its operational initiatives.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Human Technology Exchange and its Health Technology Commercialization Program (2014)
In 2014, TEN provided an impact infographic along with an impact companion report to HTX. TEN developed a customized survey that was delivered to HTX’s client companies, and participants in its Health Technology Commercialization Program. Interviews were also conducted with key stakeholders to gain a deeper understanding of the MedTech industry in which HTX operates, and to provide additional context for the survey and its analysis. TEN’s assessment was used by HTX for strategic and operational planning purposes, and was figured prominently in its communications to show the value it delivers to clients and the MedTech ecosystem.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of Innoventures Canada (2015)
In 2015, TEN conducted an assessment of Innoventures Canada (I-CAN), and the research and technology organizations (RTOs) that are part of it. I-CAN is a not-for-profit organization created to improve Canada’s performance in commercializing research. Incorporated in 2006, I-CAN works with Canada’s top RTOs to address industry needs, solve complex, multi-dimensional challenges, and accelerate the successful commercialization of innovative new technologies. Through I-CAN, Canada’s RTOs are able to take on regional and national-scale projects, which would have otherwise been too costly or risky to do alone. I-CAN brings together the top RTOs to provide companies with access to world-class expertise, specialized labs, equipment, and product development resources. Through this collaborative network, I-CAN helps companies develop new products, processes, and services with commercial and societal value, and introduce these innovations into the market.

In this project, TEN provided an overview of the performance of I-CAN and most member RTOs (BioFoodTech, CRIQ, the National Research Council (NRC), Saskatchewan Research Council (SRC), National Optics Institute (INO), Research and Productivity Council (RPC), Industrial Technology Centre (ITC), Vineland Research and Innovation Centre (VRIC)). The evaluation determined the impact that I-CAN has had on companies’ resources and capabilities, company performance, and the socio-economic impacts that can be attributed to I-CAN and its member RTOs related to the acceleration of research commercialization. As part of the project, TEN delivered a partial economic impact assessment, showing the aggregate impact of I-CAN and its member RTOs on client companies they serve, along with case studies from interviews conducted, which demonstrated the economic and societal impacts of I-CAN member RTOs.


“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Projects: Assessments of the Impact of Innovacorp (2014 & 2017)
In 2014 and 2017, TEN conducted comprehensive impact evaluations of Innovacorp, assessing its venture capital investments, accelerator and incubator services, as well as its competition funding, to determine how it is supporting and accelerating the development of early-stage knowledge based companies in Nova Scotia. TEN developed a customized logic model and impact questionnaire based on TEN’s impact assessment methodology, and delivered a comprehensive evaluation outlining the impact achieved on client companies. The data was analyzed using regression techniques to better understand predictors of socio-economic impact that Innovacorp has on startup companies in Nova Scotia. Conclusions and recommendations are being used for strategic and operational planning, and reporting purposes. Results from the 2014 assessment have been posted on Innovacorp’s website.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of the Eastern Ontario Business Incubators and Accelerators (2015 & 2017)
In 2015, Invest Ottawa, L-SPARK, Queen’s University, including Industry Partnerships & Innovation Park, PARTEQ Innovations, and Launch Lab formed a collaborative partnership to create the Eastern Ontario Business Incubator and Accelerator (BIA) project, funded by the Canada Accelerator and Incubator Program (CAIP). TEN conducted an evaluation to determine the achievements of the Eastern Ontario BIA project in the first year (of a five year CAIP funded project), and to establish a baseline to which future years’ assessments could be compared. TEN developed a customized logic model and impact questionnaire based on TEN’s impact assessment methodology, and delivered a comprehensive evaluation outlining the impact achieved on client companies by each of the partners. Conclusions and recommendations are being used to fulfill CAIP reporting requirements, and for the purpose of continuous program improvements. In January 2017, TEN launched another impact survey and is in the process of conducting the second evaluation the Eastern Ontario BIA project, comparing year-over-year results of the project. TEN is scheduled to provide a final summative evaluation of the project in 2018/2019.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Ivey International Centre for Health Innovation (2013)
In 2013, TEN provided an impact infographic along with an impact companion report to the Ivey International Centre for Health Innovation. TEN developed a customized survey that was delivered to the Centre’s industry partners and non-industry partners. TEN’s assessment was used for strategic and operational planning purposes, and was figured prominently in the Centre’s 2013-2014 Annual Report.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12In 2010 and 2011 TEN provided Niagara with impact assessments that reported the actual impact it had on companies.  CCR used the information provided by TEN to confirm it was fulfilling a critical part of its overall strategic objective, and aligned services to help further facilitate growth of company clients in the market.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12In 2010 and 2011 TEN provided NRC – Human Health Therapeutics with impact assessments that reported the actual impact it had on companies.  CCR used the information provided by TEN to confirm it was fulfilling a critical part of its overall strategic objective, and aligned services to help further facilitate growth of company clients in the market.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of the Ontario Brain Institute (2015 – 2017)
In 2015 and 2017, TEN provided impact evaluations, including logic models and a logic model report, for the Ontario Brain Institute (OBI). TEN developed customized logic models, impact survey questionnaires, and created and conducted stakeholder interviews to deliver a comprehensive impact assessment report outlining the impact of OBI on industry, researchers and clinicians, and patient advisory groups and organizations. TEN determined OBI’s economic impact and the societal benefits that result from its research support and outreach initiatives, identified key performance indicators (KPIs) that predicted OBI’s economic impact, and developed recommendations for the future to ensure OBI’s continuous improvement. The results are being used in conjunction with additional evaluations to inform strategic and operational decisions.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of Ontario Genomics (2015)
In 2015, TEN provided an impact evaluation, including logic model development, for Ontario Genomics. Using our unique impact assessment methodology, TEN developed customized surveys for companies and researchers, using the impact assessment indicators and measures derived from the logic model. TEN determined the impact of Ontario Genomics’ programs and services on improvements to the capabilities and performance of companies and researchers. The comprehensive analysis not only determined the impact that Ontario Genomics has on these target groups, but also best practices and a list of key metrics that Ontario Genomics is monitoring for strategic and operational planning purposes. The evaluation results will be used to compare future impacts of Ontario Genomics, enabling year-over-year comparisons, and to inform evidence-based funding decisions.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12In 2010 and 2011 TEN provided RIC with impact assessments that reported the actual impact it had on companies.  CCR used the information provided by TEN to confirm it was fulfilling a critical part of its overall strategic objective, and aligned services to help further facilitate growth of company clients in the market.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12Project: An Assessment of the Impact of TRTech on Saskatchewan-based companies (2013)
In 2013, Innovation Saskatchewan (IS) engaged The Evidence Network (TEN) to help assess the impact of IS investments, and in this context, to assess the impact that TRTech had on Saskatchewan-based companies. TEN provided an impact assessment evaluation of TRTech-Saskatchewan along with a customized logic model specific to TRTech. The TRTech logic model described how TRTech impacts Saskatchewan-based firms. The logic model resulted in impact assessment measures and enabled TEN to develop a customized survey that was delivered to TRTech’s client companies. The data was analyzed using regression techniques to better understand predictors of impact that TRTech has on companies. TEN determined that TRTech contributed a total of approximately $6.1 million to companies’ revenues, approximately $1.6 million to financing received by companies, and to over 132 jobs created. A benefit-cost analysis was conducted, and the impact assessment that was delivered to Innovation Saskatchewan in June 2013 was used for strategic planning and funding allocation purposes.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)

12In 2010 and 2011 TEN provided VentureStart with impact assessments that reported the actual impact it had on companies.  CCR used the information provided by TEN to confirm it was fulfilling a critical part of its overall strategic objective, and aligned services to help further facilitate growth of company clients in the market.

“The Evidence Network’s assessment of the impact of innovation intermediaries on firms is the best work I’ve seen done in this area. They are succeeding in doing what others have only talked about.”

Dr. Tom Brzustowski

Chair, Institute for Quantum Computing, University of Waterloo; former President of the Natural Sciences and Engineering Research Council of Canada (NSERC)