Search
Browse By Day
Browse By Time
Browse By Person
Browse By Policy Area
Browse By Session Type
Browse By Keyword
Browse Artificial Intelligence Presentations
Program Calendar
Sign In
Search Tips
This session will explore how researchers can incorporate AI into complex data-collection and analysis workflows while maintaining transparency, reproducibility, and opportunities for human review. Drawing on a project to identify school wellness centers across California, the session will walk participants through the development of a pipeline that identifies and downloads Local Control and Accountability Plans (LCAPs) across school districts and extracts information about wellness centers from hundreds of documents. The project illustrates a hybrid approach in which deterministic methods, web scraping and AI are used selectively rather than relying on AI for every task. The underlying workflow prioritizes cheaper and more reproducible methods first, uses tiered fallbacks when websites differ, and records failures. The downstream document analysis similarly favors traditional text processing methods over AI-generated synthesis when reproducibility is more valuable. The training will use a “Build the Workflow” activity. Participants will work with a simplified research scenario involving information scattered across websites and PDFs. They will map a workflow and decide which tasks are best handled through traditional code, AI/LLMs or human review. We will then discuss tradeoffs involving accuracy, scalability, cost, and reproducibility. By the end of the session, participants will be able to identify appropriate roles for AI within research workflows, design fallback and validation strategies, and recognize situations where conventional methods or human review may be preferable to AI.