 |
|
|
|
|
|
|
|
|
 |
 |
 |
 |
 |
 |
 |
 |
|
|
|
||||||||||||||||||
|
|
A Toolkit
for Evaluating Public R&D Investment REFERENCESAdvanced Technology Program, Report to Congress: The Advanced Technology Program: A Progress Report on the Impacts of an Industry-Government Technology Partnership, NIST–ATP–96–2 (Gaithersburg, MD: National Institute of Standards and Technology, 1996). Advanced Technology Program, Performance of 50 Completed Projects, Status Report 2, NIST Special Publication 950–2 (Gaithersburg, MD: National Institute of Standards and Technology, 2001). Austin, David, and Molly Macauley, Estimating Future Consumer Benefits from ATP-Funded Innovation: The Case of Digital Data Storage, NIST GCR 00–790 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Ayares, David, “The Five Little Pigs: A Tale of Xeno-Organ Transplant.” In Charles W. Wessner, ed., The Advanced Technology Program: Assessing Outcomes (Washington, DC: National Academy Press, 2000). Balutis, Alan P., and Barbara Lambis, “The ATP Competition Structure.” In Charles W. Wessner, ed., The Advanced Technology Program: Assessing Outcomes (Washington, DC: National Academy Press, 2000). Bass, Frank M., “A New Product Growth Model for Consumer Durables,” Management Sciences, 15(5): 215–227, 1969. Berglund, Dan, and Christopher Coburn, Partnerships: A Compendium of State and Federal Cooperative Technology Programs (Columbus, OH: Battelle Press, 1995). Branch, K., M. Peffers, R. Ruegg, and R. Vallario, The Science Manager’s Resource Guide to Case Studies (Washington, DC: U.S. Department of Energy, Office of Science, 2001). Branscomb, L., and Philip E. Auerswald, Taking Technical Risks: How Innovators, Executives, and Investors Manage High-Tech Risks (Cambridge, MA: MIT Press, 2001). Branscomb, L., and Philip E. Auerswald, Between Invention and Innovation: An Analysis of the Funding for Early-Stage Technology Development, NIST GCR 02–841 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). Branscomb, L., and G. Parker, “Funding Civilian and Dual-Use Industrial Technology.” In L. Branscomb, ed., Empowering Technology (Cambridge, MA: MIT Press, 1993). Branscomb, L., Kenneth P. Morse, and Michael J. Roberts, Managing Technical Risk: Understanding Private Sector Decision Making on Early Stage Technology-Based Project, NIST GCR 00–787 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Branstetter, Lee, and Mariko Sakakibara, “Japanese Research Consortia: A Microeconometric Analysis of Industrial Policy,” Journal of Industrial Economics 46: 207–233,1998. Bresnahan, Timothy, “Measuring the Spillovers from Technical Advance: Mainframe Computers in Financial Services,” American Economic Review 76(4): 742–755, 1986. Chang, Connie K.N., “A New Lexicon and Framework for Analyzing the Internal Structures of the U.S. Advanced Technology Program and its Analogues Around the World,” Journal of Technology Transfer 23(2): 67–73, 1998. Cohen, L., and R. Noll, The Technological Pork Barrel (Washington, DC: Brookings Institution, 1991). Cohen, Wesley M., and John P. Walsh, R&D Spillovers, Appropriability and R&D Intensity: A Survey Based Approach, Draft report, ATP, 2000. CONSAD Research Corporation, Advanced Technology Program Case Study: The Development of Advanced Technologies and Systems for Controlling Dimensional Variation in Automobile Body Manufacturing, NIST GCR 97–709 (Gaithersburg, MD: National Institute of Standards and Technology, 1996). Cook, D., and J. Stanley, Experimental and Quasi-Experimental Design for Research (Chicago: Rand McNally, 1966). Cozzens, Susan, and Julia Melkers, “Use and Usefulness of Performance Measurement in State Science and Technology Programs,” Policy Studies Journal 25: 425–435, 1975. Darby, Michael R., Lynne G. Zucker, and Andrew Wang, Program Design and Firm Success in the Advanced Technology Program: Project Structure and Innovation Outcomes, NISTIR 6943 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). den Heyer, Mollie, ed., A Bibliography for Program Logic Models/Logframe Analysis (Ottawa, Canada: Evaluation Unit, International Development Research Centre, 2001). Diabetes Control and Complications Trial Research Group, “The Effect of Intensive Treatment of Diabetes on the Development and Progression of Long-Term Complications in Insulin-Dependent Diabetes Mellitus,” New England Journal of Medicine 18:1468–1478, 1996. Donaldson, Stewart, “The Theory-Driven View of Program Evaluation.” Paper presented at Evaluating Social Programs and Problems: Visions for the New Millennium, February 24, 2001. Dyer, Jeffry H., and Benjamin C. Powell, Determinants of Success in ATP-Sponsored R&D Joint Ventures: A Preliminary Analysis Based on 18 Automobile Manufacturing Projects, GCR 00–803 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). Ehlen, Mark A., Economic Impacts of Flow-Control Machining Technologies: Early Applications in the Automobile Industry, NISTIR 6373 (Gaithersburg, MD: National Institute of Standards and Technology, 1999). Eisenhardt, K. M., “Building Theories from Case Study Research,” Academy of Management Review 14 (4): 532–550, 1989. Eisinger, Paul, The Rise of the Entrepreneurial State (Madison, WI: University of Wisconsin Press, 1988). Ergas, H., “The Importance of Technology Policy.” In P. Dasgupta and P.Stoneman, eds., Economic Policy and Technological Performance (New York: Cambridge University Press, 1987). Fahrenkrog, Gustavo, Wolfgang Polt, Jamime Rojo, Alexander Tubke, and Klaus Zinocker, eds., RTD Evaluation Toolbox—Assessing the Socio-Economic Impact of RTD Policies, Strata Project HPV1CT 1999–00005, IPTS Technical Report Series (Seville, Spain: Joint Research Centre, European Commission, 2002). Feldman, Maryann, and Maryellen Kelley, Winning an Award from the Advanced Technology Program: Pursuing R&D Strategies in the Public Interest and Benefiting from a Halo Effect, NISTIR 6577 (Gaithersburg, MD: National Institute of Standards and Technology, 2001). Feldman, Maryann, Maryellen Kelley, Joshua Schaff, and Gabriel Farkas, Reinforcing Interactions Between the Advanced Technology Program and State Technology Programs, vol. 2, Case Studies of Technology Pioneering Startup Companies and Their Use of State and Federal Programs, NISTIR 6523 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Feller, Irwin, “American State Governments as Models for National Science Policy.” Journal of Policy Analysis and Management 11:288–309, 1992. Feller, Irwin, “The Academic Policy Analyst as Reporter: The Who, What, and How of Evaluating Science and Technology Programs.” In Philip Shapira and S. Kuhlman, eds., Learning from Science and Technology Policy Evaluation (London: Edward Elgar, 2001). Florida, R. and M. Kenney, The Breakthrough Illusion (New York: Basic Books, 1990). Fogarty, Michael S., Amit K. Sinha, and Adam B. Jaffe, ATP and the U.S. Innovation System—A Methodology for Identifying Enabling R&D Spillover Networks with Applications to Micro-electromechanical Systems (MEMS) and Optical Recording, Draft Report, ATP, 2000. Fowler, Jr., Floyd J., Survey Research Methods (Newbury Park, CA: Sage, 1993). Geisler, Eliezer, The Metrics of Science and Technology (Westport, CT: Quorum Books, 2000). General Accounting Office, “Effectively Implementing the Government Performance and Results Act,” GAO Report GGD–96–118, Washington, DC, 1996. Goldsmith, H. Randall, “A Model for Product Commercialization,” Oklahoma Alliance for Manufacturing Excellence, Tulsa, OK, 1995. Gompers, Paul, and Josh Lerner, Capital Formation and Investment in Venture Markets: Implications for the Advanced Technology Program, NIST GCR 99–784 (Gaithersburg, MD: National Institute of Standards and Technology, 1999). Griliches, Z., “Productivity, R&D, and Basic Research at the Firm Level in the 1970’s,” American Economic Review, 76(1), 141–154, 1986. Griliches, Z., and M. Intriligator, ed., Handbook of Econometrics, vol. 1 (New York: Elsevier Science, 1983). Griliches, Z., and Frank Lichtenberg, “R&D and Productivity at the Industry Level: Is There Still a Relationship?” In Z. Griliches, ed., R&D, Patents and Productivity (Chicago: University of Chicago Press, 1984). Griliches, Z., Haim Regev, and Manuel Trajtenberg, R&D Policy in Israel: Overview and Lessons for the ATP, Draft report, ATP, 2000. Green, J., and V. Caracelli, “Defining and Describing the Paradigm Issue in Mixed-Method Evaluation.” In J. Green and V. Caracelli, eds., Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms (San Francisco: Jossey-Bass, 1997). Hall, Bronwyn H., Albert N. Link, and John T. Scott, Universities as Research Partners, GCR 02–829 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). Hallacher, P., “Effects of Policy Subsystem Structure on Policymaking: The Case of the Advanced Technology Partnership Program and the Manufacturing Extension Partnership,” Ph.D. Dissertation, Pennsylvania State University, 2000. Hill, C., “The Advanced Technology Program: Opportunities for Advancement.” In L. Branscomb and J. Keller, eds., Investing in Innovation (Cambridge, MA: MIT Press, 1998). Jaffe, Adam B., Economic Analysis of Research Spillovers: Implications for the Advanced Technology Program, NIST GCR 97–708 (Gaithersburg, MD: National Institute of Standards and Technology, 1996). Judd, Charles M., and David A. Kenny, Estimating the Effects of Social Interventions (New York: Cambridge University Press, 1981). Karshenas, M., and P. Stoneman, “Technological Diffusion.” In P. Stoneman, ed., Handbook of the Economics of Innovation and Technological Change (Oxford, UK: Blackwell, 1965). Kogut, Bruce, and Michelle Gittelman, Public-Private Partnering and Innovation Performance Among U.S. Biotechnology Firms, Draft report, ATP, 2001. Laidlaw, Frances Jean, Acceleration of Technology Development by the Advanced Technology Program: The Experience of 28 Projects Funded in 1991, NISTIR 6047 (Gaithersburg, MD: National Institute of Standards and Technology, 1997). Laredo, Philippe, Comments. In Richard N. Spivack, ed., Proceedings of an International Conference on the Economic Evaluation of Technological Change, NIST Special Publication 952 (Gaithersburg, MD: National Institute of Standards and Technology, 2001). Levy, David, and Nestor Terleckyj, “Effects of Government R&D on Private R&D Investment and Productivity: A Macroeconomic Analysis,” The Bell Journal of Economics 14(2): 551–561, 1983. Lide, Bettijoyce, and Richard N. Spivack, Advanced Technology Program Information Infrastructure for Healthcare Focused Program: A Brief History, NISTIR 6477 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Liebeskind, Julia Porter, Study of the Management of Intellectual Property in ATP-Grantee Firms, Draft report, ATP, 2000. Link, Albert N., “Measuring the Economic Impact of the Advanced Technology Program: A Planning Study,” Unpublished report, 1992. Link, Albert N., Advanced Technology Program: Economic Study of the Printed Wiring Board Joint Venture after Two Years (Gaithersburg, MD: National Institute of Standards and Technology, 1993). Link, Albert N., Economic Study of the Joint Venture Project on Short- Wavelength Sources for Optical Recording after Three Years of a Five-Year Research Program (Gaithersburg, MD: National Institute of Standards and Technology, 1994). Link, Albert N., Evaluating Public Sector Research and Development (Westport, CT: Praeger, 1996). Link, Albert N., Advanced Technology Program; Early Stage Impacts of the Printed Wiring Board Research Joint Venture, Assessed at Project End, NIST GCR 97–722 (Gaithersburg, MD: National Institute of Standards and Technology, 1997). Link, Albert N., and L. Bauer, Cooperative Research in U.S. Manufacturing (Lexington, MA: Lexington Books, 1989). Long, William F., Performance of Completed Projects, Status Report 1, NIST Special Publication 950–1 (Gaithersburg, MD: National Institute of Standards and Technology, 1999). Mansfield, Edwin, Estimating Social and Private Returns from Innovations Based on the Advanced Technology Program: Problems and Opportunities, GCR 99–780 (Gaithersburg, MD: National Institute of Standards and Technology, 1996). Mansfield, Edwin J., J. Rapport, A. Romeo, S. Wagner, and G. Be Ardsley, “Social and Private Rates of Return from Industrial Innovation.” Quarterly Journal of Economics 91(2): 221—240, 1976. Mark, M., G. Henry, and G. Julnes, Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs (San Francisco: Jossey-Bass, 2000). Martin, Sheila A., Daniel L. Winfield, Anne E. Kenyon, John R. Farris, Mohan V. Baal, and Tayler H. Bingham, A Framework for Estimating the National Economic Benefits of ATP Funding of Medical Technologies, GCR 97–737 (Gaithersburg, MD: National Institute of Standards and Technology, 1998). Mauskopf, Josephine A., and Michael T. French, “Estimating the Value of Avoiding Morbidity and Mortality from Foodborne Illnesses,” Risk Analysis 11(4):619–631, 1991. McCawley, Paul F., The Logic Model for Program Planning and Evaluation, CIS 1097 (Moscow, Idaho: University of Idaho Extension Program). McLaughlin, John A., and Gretchen B. Jordan, “Logic Models: A Tool for Telling your Program Performance Story,” Evaluation and Program Planning, 22:65–72, 1999. Meltsner, A., Policy Analysis in the Bureaucracy (Berkeley, CA: University of California Press, 1976). Mohr, L., Impact Analysis for Program Evaluation, 2nd ed. (Thousand Oaks, CA: Sage, 1995). Moore, Michael J., and W. Kip Viscusi, “Doubling the Estimated Value of Life: Results Using New Occupational Fatality Data,” Journal of Policy Analysis and Management 7(3):476–490, 1988. Morgenthaler, David, “Assessing Technical Risk.” In Lewis M. Branscomb, Kenneth P. Morse, and Michael J. Roberts, eds., Managing Technical Risk: Understanding Private Sector Decision Making on Early Stage Technology- Based Project, NIST GCR 00–787 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Mowery, D., ed., International Collaborative Ventures in U.S. Manufacturing (Cambridge, MA: Ballinger, 1988). Mowery, David C., Joanne E. Oxley, and Brian S. Silverman, The Role of Knowledge Spillovers in ATP Consortia, Draft report, ATP, 1998. National Academy of Sciences, The Government Role in Civilian Technology (Washington, DC: National Academy Press, 1992). National Academy of Sciences, Committee on Science, Engineering, and Public Policy, Evaluating Federal Research Programs; Research and the Government Performance and Results Act (Washington, DC: National Academy Press, 1999). Available: http://www.nap.edu/catalog/6416.html. Newman, M. E. J., “The Structure of Scientific Collaboration Networks,” Proceedings of the National Academy Science 98(2): 404–409, 2001. Office of Management and Budget, The President’s Management Agenda, available on-line at http://www.whitehouse.gov/omb. Pelsoci, Thomas, Closed-Cycle Air Refrigeration Technology For Cross Cutting Applications in Food Processing, Volatile Organic Compound Recovery, and Liquid Natural Gas Industries, Economic Case Study of an ATP-Funded Project, NIST GCR 01–819 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). Powell, Jeanne W., “The ATP’s Business Reporting System: A Tool for Economic Evaluation.” Paper presented at the Conference on Comparative Analysis of Enterprise Data Helsinki, Finland, 1996. Powell, Jeanne W., Development, Commercialization, and Diffusion of Enabling Technologies, Progress Report for Projects Funded 1993–1995, NISTIR 6098 (Gaithersburg, MD: National Institute of Standards and Technology, 1997). Powell, Jeanne W., Business Planning and Progress of Small Firms Engaged in Technology Development through the Advanced Technology Program, NISTIR 6375 (Gaithersburg, MD: National Institute of Standards and Technology, 1999). Powell, Jeanne W., and Karen Lellock, Development, Commercialization, and Diffusion of Enabling Technologies: Progress Report, ATP, 2000. Jeanne Powell and Francisco Moris, Different Timelines for Different Technologies, NISTIR 6917 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). Przybylinski, Stanley M., Sean McAlinden, and Dan Luria, Temporary Organizations for Collaborative R&D: Analyzing Deployment Prospects, Draft report, ATP, 2000. Rossi, P., and H. Freeman, Evaluation: A Systematic Approach, 4th ed. (Beverly Hills, CA: Sage, 1989). Ruegg, R., “Risk Assessment.” In R. Dorf, ed., Engineering Economics and Management (Boca Raton, FL.: CRC Press and IEEE Press, 1996). Ruegg, R. “Assessment of the ATP.” In The Advanced Technology Program, Challenges and Opportunity (Washington, DC: National Academy Press, 1999). Ruegg, R., Advanced Technology Program’s Approach to Technology Diffusion, NISTIR 6385 (Gaithersburg, MD: National Institute of Standards and Technology, 1999). Ruegg, R., “Delivering Public Benefits with Private-Sector Efficiency Through the Advanced Technology Program.” In Charles W. Wessner, ed., The Advanced Technology Program: Assessing Outcomes (Washington, DC: National Academy Press, 2000). Ruegg, R., “Taking a Step Back: An Early Results Overview of Fifty ATP Awards.” In Charles F. Wessner, ed., The Advanced Technology Program: Assessing Outcomes (Washington, DC: National Academy Press, 2000). Ruegg, R., A Composite Performance Rating System for ATP-Funded Completed Projects , NIST GCR 03–851 (Gaithersburg, MD: National Institute of Standards and Technology, 2003.) Ruegg, R., and H. Marshall, Building Economics: Theory and Practice (New York: Van Nostrand Reinhold, 1990). Sakakibara, Mariko, and Lee Branstetter, Measuring the Impact of ATP-Funded Research Consortia on Research Productivity of Participating Firms: A Framework Using Both U.S. and Japanese Data, NIST GCR 02–830 (Gaithersburg, MD: National Institute of Standards and Technology, 2002). Schachtel, Marsha R. B., and Maryann P. Feldman, Reinforcing Interactions Between the Advanced Technology Program and State Technology Programs, vol. I, A Guide to State Business Assistance Programs for New Technology Creation and Commercialization, NIST GCR 00–788 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Servo, Jenny C., Commercialization and Business Planning Guide for the Post- Award Period, NIST GCR–99–779 (Gaithersburg, MD: National Institute of Standards and Technology, 2000). Shadish, W., T. Cook, and L. Leviton, Foundations of Program Evaluation (Beverly Hills, CA: Sage, 1991). Silber & Associates, Survey of Advanced Technology Program 1990–1992 Awardees: Company Opinion About the ATP and its Early Effects (Gaithersburg, MD: National Institute of Standards and Technology, 1996). Smith, B., American Science Policy Since World War II (Washington, DC: Brookings Institution, 1990). Spender, J-C., “Publicly Supported Non-Defense R&D: The U.S.A.’s Advanced Technology Program,” Science and Public Policy, February: 45–52, 1997. Spivack, Richard N., ed., Proceedings of an International Conference on the Economic Evaluation of Technological Change, NIST Special Publication 952 (Gaithersburg, MD: National Institute of Standards and Technology, 2001). Torrance, George W., and David Feeny, “Utilities and Quality-Adjusted Life Years,” International Journal of Technology Assessment in Health Care 5: 559–575, 1989. U.S. Congress, Office of Technology Assessment, Making Things Better: Competing in Manufacturing, OTA–ITE–443 (Washington, DC: U.S. Government Printing Office, 1990). U.S. Congress, Office of Technology Assessment, Competing Economies: America, Europe, and the Pacific Rim, OTA–ITE–498 (Washington, DC: U.S. Government Printing Office,1991). U.S. Department of Commerce, Annual Performance Plan, “Science, Technology, and Information Performance Measures for the Advanced Technology Plan,” Washington, D.C. Wang, Andrew, “Key Concepts in Evaluating Outcomes of ATP Funding of Medical Technologies,” The Journal of Technology Transfer 23(2): 61–65, 1998. Wessner, Charles W., ed., The Advanced Technology Program: Challenges and Opportunities (Washington, DC: National Academy Press, 1999). Wessner, Charles W., ed., The Advanced Technology Program: Assessing Outcomes (Washington, DC: National Academy Press, 2000). Wholey, Joseph S., John W. Scanlon, Hugh G. Fukumoto, and Leona M. Vogt, Federal Evaluation Policy, Analyzing the Effects of Public Programs (Washington, DC: The Urban Institute, 1970). Yin, R., Case Study Research, 2nd ed. (Thousand Oaks, CA: Sage, 1994). Return to Table of Contents. Date created: July 15,
2004 |
 |
ATP website comments: webmaster-atp@nist.gov / Technical ATP inquiries: InfoCoord.ATP@nist.gov. NIST is an agency of the U.S. Commerce Department |
 |