I_AI_2024A 10/21/2024 09:05:06 AM Committee Summary PUBLICSTAFF SUMMARY OF MEETINGINTERIM COMMITTEE ARTIFICIAL INTELLIGENCE IMPACT TASK FORCE Date 10/21/2024 Attendance Baisley * Ruthie Barko X John Bliss E Michael Brent X Henry Claypool X David Edinger X Kjersten Forseth X Loren Furman X Grace Gedye X Margot Kaminski X Adeel Khan E Vivek Krishnamurthy X David MacLeod X Jon Nordmark X Tatiana Rice X Jefferey Riester X Anaya Robinson X Brittany Morris Saunders X Matt Scherer X Seth Sternberg X Eric Swanson X Luke Swanson X Jeff Swoboda E Weinberg X Titone X Rodriguez X Time 09:05:06 AM to 01:36:46 PM Place Old State Library This Meeting was called to order by Rodriguez This Report was prepared by Samantha Falco Hearing Items Action Taken hBusiness and Technology Panel Committee Discussion Only hPublic Interest Perspective Committee Discussion Only hBusiness and Technology Panel (cont.) Committee Discussion Only hOther Business Committee Discussion Only 09:05:09 AM Chair Rodriguez gave opening comments to the committee. Business and Technology Panel - Committee Discussion Only 09:06:24 AM Ruthie Barko, TechNet, gave the following presentation to the committee: https://leg.colorado.gov/sites/default/files/images/technet_presentation.pdf The presentation included information on TechNet, legislation addressing AI, members of TechNet, and proposed improvements to SB 24-205. 09:21:10 AM Simon Morrison, Amazon, gave a presentation to the task force detailing Amazon's use of AI. Mr. Morrison provided information on the use of AI for personalized shopping, warehouse order filling, and Amazon Web Services. The presentation continued with AI considerations being taken by Amazon and recommendations on changes to SB 24-205. 09:25:11 AM Danielle Gilliam-Moore, Salesforce, gave a presentation to the committee. The presentation included information on what Salesforce does, customer data protections, generative AI for customers, and the impacts of SB24-205. 09:31:32 AM Alice Friend, Google, presented to the task force on Google in Colorado, investments in AI, the various sectors within the company using AI, and recommendations for AI legislation and rulemaking. 09:38:02 AM Presenters responded to questions from the task force on topics such as substantial factor language, the Colorado Privacy Act, compliance staffing, hiring practices and other U.S. state legislation. Senator Rodriguez made comments to the committee. Public Interest Perspective - Committee Discussion Only 09:54:54 AM Anaya Robinson, ACLU Colorado, gave the following presentation to the committee: https://leg.colorado.gov/sites/default/files/images/algorithmic_discrimination_aclu.pdf Mr. Robinson gave information on algorithmic discrimination, SB24-205 and the bill's framework, and issues with the legislation. 10:06:34 AM Matthew Scherer, Center for Democracy and Technology (CDT), gave the following presentation to the committee: https://leg.colorado.gov/sites/default/files/images/transparency_and_accountability_in_ai_driven_decisions.pdf The presentation included information on risks when using automated decisions systems and using AI to make consequential decisions, transparency, New York City's hiring ordinance law, Cigna's automated evaluation of insurance claims, and general comments on SB24-205. 10:30:06 AM Professor Suresh Venkatasubramanian, Data Science Institute at Brown University, gave the following presentation: https://leg.colorado.gov/sites/default/files/images/operationalizing_the_safeguards_in_the_colorado_ai_act.pdf. The presentation included information on the AI Bill of Rights, a university level course in fairness in automated decision making, ongoing research for AI, government standard setting practices, model frameworks for AI governance, and open frameworks for mitigating bias. 10:41:10 AM The task force asked the panel of presenters questions regarding topics such as proposed changes to be made to SB24-205, Brown University work on opportunities to innovate responsible AI, consumer protections, mathematical inevitability of bias, anti-discrimination laws, California legislation, and implications of the use of AI by Cigna as detailed by Mr. Scherer. 11:17:53 AM The committee took a brief recess. 11:18:10 AM The committee came back to order. Business and Technology Panel (cont.) - Committee Discussion Only 11:29:45 AM Jon Nordmark, Iterate.ai, gave the following presentation: https://leg.colorado.gov/sites/default/files/images/entrepreneurship_and_startups_-_iterate.ai_.pdf. The presentation included information on Interplay by Iterate.ai, their partners, how it was made, clients, advances in technology, their generative AI system, potential for generative AI to increase GDP, and the number of AI patents. 11:39:21 AM Liz Giorgi, soona, gave a presentation to the committee. The presentation included information on the use of AI on their platform, generative imagery, logistics, and staffing. Additionally, the presentation continued with information on AI regulation, federal legislation, and the implications of small businesses and AI. 11:44:26 AM Adam Burrows, Range Ventures, gave a presentation to the committee. The presentation included information on the company, Magic School AI, SB 24-205, and concerns about the legislation from small businesses. 11:50:51 AM Luke Swanson, Ibotta, gave a presentation to the committee. The presentation gave information on the company, the use of AI in the company, discrimination legislation, the implications on small and medium sized businesses, potential unintended consequences of SB24-205, and proposed amendments to the bill. 12:00:46 PM The committee asked the panel of presenters questions including information on automated decision systems, disclosure requirements, and how small businesses test AI risk. 12:23:20 PM Questions continued with topics including disclosure requirements, sources of bias in AI, companies that are developing AI in Colorado, and the Rocky Mountain AI Interest Group. 12:52:45 PM Ryan Harkins, Microsoft, gave a presentation to the committee. His presentation included information on Microsoft's AI principals, ethics committee, standards, the implications of SB24-205, obligations to report algorithmic discrimination, and worldwide considerations of AI. 01:03:04 PM Ryan Hagemann, IBM, presented to the task force about the support of governing AI, IBM Integrated Governance process, and recommendations to improve SB24-205. 01:09:18 PM The committee asked the panel of witnesses questions on topics including both companies involvement with advisory committees, the concept of regulatory capture, AI legislation in other states, legislation that may be on the horizon, the notification provision in SB 24-205, and concerns over definitions within the bill. Other Business - Committee Discussion Only 01:36:17 PM The committee discussed future meeting dates. 01:36:46 PM The committee adjourned.