Back to Cases
Case ReportPublished curriculum / implementation paper2023
AAB-CASE-2026-RV-117

Beyond Black-Boxes: Teaching Complex Machine Learning Ideas through Scaffolded Interactive Activities

Existing approaches to teaching artificial intelligence and ma- chine learning (ML) often focus on the use of pre-trained models or fine-tuning an existing black-box architecture. We believe ML techniques and core ML topics, such as opti- mization and adversarial examples, can be designed for high school age students given appropriate support.

This page documents an AI literacy or AI education case for registry purposes. It is descriptive and does not imply AAB endorsement of any specific tool, provider, or intervention.
01

Implementation

Source publication / research team or educational organization described in paper

02

Learning context

In-school (K-12)

03

AI role

Learning object / concept model

04

Outcome signal

Conceptual understanding

Registry Facets

0
Education Level
  • 9-12
Subject Area
  • K-12
  • ML concepts
  • interactive activities
  • ML concepts / supervised learning
  • Explainable AI / robustness
Use Case Type
  • Curriculum / course design
  • Teacher professional development
Stakeholder Group
  • Students
  • Teachers
AI Capability Type
  • ML concepts / supervised learning
  • Explainable AI / robustness
Implementation Model
  • In-school (K-12)
Evidence Type
  • Design / conceptual evidence
Outcomes Domain
  • Conceptual understanding
  • Teacher readiness

Implementing Organization

1
Organization Type

Source publication / research team or educational organization described in paper

Location

Not specified in extracted text

Primary Facilitator Role

Researchers, educators, instructors, or facilitators as described in the source publication

Learning Context

2
Setting Type
  • In-school (K-12)
Session Format

Classroom, course, or resource-based AI education activity

Duration

Not specified in extracted text

Group Size

rch on appropriate strategies and pedago- gies for teaching ML, especially to K-12 students is still evolving with little clarity on how—and at what depth— to teach these complex ideas to younger learners (Evang

Devices

ML concepts / supervised learning, Explainable AI / robustness

Constraints
  • Teacher readiness, time, support, and classroom integration may affect implementation quality.
  • Use with minors requires attention to privacy, consent, data minimization, and adult supervision.

Learner Profile

3
Age Range

9-12

Prior AI Exposure Assumed

Mixed or not explicitly specified; infer from target learner group and intervention design.

Prior Programming Background Assumed

Varies by intervention; not specified unless the paper explicitly describes prerequisites.

Educational Intent

4
Primary Learning Goals
  • Document the AI education intervention, course, tool, or resource described in the source publication.
  • Extract the learner context, AI role, pedagogy, outcomes, and constraints for AAB registry comparison.
  • Existing approaches to teaching artificial intelligence and ma- chine learning (ML) often focus on the use of pre-trained models or fine-tuning an existing black-box architecture.
Secondary Learning Goals
  • Support AAB comparison across AI literacy, AI education, teacher training, higher education, and workforce contexts.
  • Capture evidence maturity, transferability, and limitations rather than treating the publication as product endorsement.
What This Was Not
  • Not an AAB endorsement of the tool, curriculum, provider, or result.
  • Not a direct replication record unless the source paper reports implementation details sufficient for replication.

AI Tool Description

5
Tool Type

ML concepts / supervised learning, Explainable AI / robustness

Languages

Not specified in extracted text

AI Role
  • Learning object / concept model
User Interaction Model
  • Primary interaction pattern inferred from publication: Curriculum / course design, Teacher professional development.
  • AI capability focus: ML concepts / supervised learning, Explainable AI / robustness.
Safeguards
  • Use age-appropriate framing and teacher/facilitator oversight for any classroom deployment.

Activity Design

6
Activity Flow
  • Review the publication’s reported context, learner group, AI tool or curriculum, implementation process, and outcome evidence.
  • Map the case to AAB registry fields for comparison across educational levels and AI capability types.
  • Use the source publication and PDF for any manual verification before public registry release.
Human Vs AI Responsibilities
  • Human educators/researchers remain responsible for instructional design, supervision, interpretation, and ethical safeguards.
  • AI systems or AI concepts provide the learning object, support tool, evaluator, simulator, or automation context depending on the paper.
Scaffolding Strategies
  • Game-based learning, Hands-on / experiential learning
  • Registry extraction emphasizes explicit learning goals, observed outcomes, constraints, and safety limitations.

Observed Challenges

7
Educators Reported
  • Teacher readiness, time, support, and classroom integration may affect implementation quality.
  • Use with minors requires attention to privacy, consent, data minimization, and adult supervision.

Design Adaptations

8
Adaptations
  • Case classified under: Published curriculum / implementation paper.
  • Pedagogical pattern: Game-based learning, Hands-on / experiential learning.
  • Any additional adaptations should be verified against the full paper before public-facing publication.

Reported Outcomes

9
Engagement
  • Engagement evidence should be interpreted according to the source paper’s reported method and sample.
  • We believe ML techniques and core ML topics, such as opti- mization and adversarial examples, can be designed for high school age students given appropriate support.
Learning Signals
  • We believe ML techniques and core ML topics, such as opti- mization and adversarial examples, can be designed for high school age students given appropriate support.
Educators Reflection

Existing approaches to teaching artificial intelligence and ma- chine learning (ML) often focus on the use of pre-trained models or fine-tuning an existing black-box architecture. We believe ML techniques and core ML topics, such as opti- mization and adversarial examples, can be designed for high school age students given appropriate support.

Ethical & Privacy Considerations

10
Privacy
  • Use age-appropriate framing and teacher/facilitator oversight for any classroom deployment.

Evidence Type

11
Evidence
  • Design / conceptual evidence

Relevance to Research

12
Potential Research Use
  • Can be used as an AAB evidence record for cross-case comparison, standards drafting, and evidence-maturity mapping.
  • Supports identification of recurring patterns in AI literacy, AI education implementation, teacher preparation, assessment, and responsible AI learning.
Relevant Research Domains
  • Conceptual understanding
  • Teacher readiness
  • Curriculum / course design
  • Teacher professional development
  • ML concepts / supervised learning
  • Explainable AI / robustness

Case Status

13
Case Status
  • Completed

AAB Classification Tags

14
Age

9-12

Setting

In-school (K-12)

AI Function

ML concepts / supervised learning, Explainable AI / robustness

Pedagogy

Game-based learning, Hands-on / experiential learning

Risk Level

Low to Medium

Data Sensitivity

Medium

Source Publication

15
Title

Beyond Black-Boxes: Teaching Complex Machine Learning Ideas through Scaffolded Interactive Activities

Authors
  • Brian Broll
  • Shuchi Grover
Venue

Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37 No. 13, EAAI-23

Year

2023

Doi

10.1609/aaai.v37i13.26898

Source URL

https://ojs.aaai.org/index.php/AAAI/article/view/26898

Pdf URL

https://ojs.aaai.org/index.php/AAAI/article/view/26898/26670

Pdf Filename

089_Beyond Black-Boxes_ Teaching Complex ML Ideas through Scaffolded Interactive Activities.pdf

Page Count

9

Abstract

Existing approaches to teaching artificial intelligence and ma- chine learning (ML) often focus on the use of pre-trained models or fine-tuning an existing black-box architecture. We believe ML techniques and core ML topics, such as opti- mization and adversarial examples, can be designed for high school age students given appropriate support. Our curricular approach focuses on teaching ML ideas by enabling students to develop deep intuition about these complex concepts by first making them accessible to novices through interactive tools, pre-programmed games, and carefully designed pro- gramming activities. Then, students are able to engage with the concepts via meaningful, hands-on experiences that span the entire ML process from data collection to model optimiza- tion and inspection. This paper describes our AI & Cyberse- curity for Teens suite of curricular activities aimed at high school students and teachers.

Transferability

16
Best Fit Contexts
  • In-school (K-12)
Likely Failure Modes
  • Teacher readiness, time, support, and classroom integration may affect implementation quality.
  • Use with minors requires attention to privacy, consent, data minimization, and adult supervision.

Cost And Operations

17
Time Cost Notes

Not specified in extracted text unless noted in duration field.

Staffing Notes

Requires educators/researchers/facilitators with sufficient AI literacy and pedagogy knowledge for the target learners.

Infra Notes

Infrastructure depends on AI tool type, learner devices, data access, and institutional policy context.

Extraction Notes

18
Confidence

High

Missing Information
  • duration
Reasoning Limits

This entry was automatically extracted from the PDF text and manifest metadata. Fields should be manually verified before public registry publication, especially group size, location, duration, and outcome claims.

Duplicate Check Against Uploaded Cases Json
Closest Existing Title

Artificial Intelligence teaching and learning in K-12 from 2019 to 2022: A systematic literature review

Similarity Score

0.441

Likely Duplicate

false

Registry Metadata

19
Case ID
AAB-CASE-2026-RV-117
Publication Status
Published curriculum / implementation paper
Tags
case9-12Not specified in extracted textIn-school (K-12)ML concepts / supervised learningK-12ML conceptsinteractive activitiesML concepts / supervised learningExplainable AI / robustnessCurriculum / course designTeacher professional development