A seamless experience for test-takers, securely delivered anywhere.

AI agents and commercial cheating services: Building a test security framework to address today’s threats

Wednesday November 19 | 2.30pm 

Join us for a classified briefing on today’s exam security threats. During this high-energy and hands-on session, exam security professionals will walk you through the high tech and low tech threats to test integrity and score validity facing the credentialing space today. Attendees will be introduced to the various methodologies test takers and contract cheating services are employing to undermine exam security – from sophisticated AI agents acting autonomously to complete exams, to organized cheating services providing a host of cheating tools (complete with snacks), as well as less-sophisticated and more common attempts to use surrogates or other unauthorized aids to circumvent testing rules.

Together, we’ll explore the cheating services learners are exposed to during their education and training journey as well as the vulnerabilities that different administration and delivery types present. Security experts will then shift to exploring the tools credentialing programs have at their disposal to combat these threats. We will discuss how to view exam security holistically and evaluate threats across the testing lifecycle.

Discussions will emphasize the foundational capabilities programs must have in place to act when an incident is detected as well as emerging tools and the importance of relationships with vendors. This will be an engaging and eye-opening briefing that you won’t want to miss!

Learning objectives:

• Identify high tech tools such as ai agents and meta glasses that are growing threats to test integrity, item bank assets, and score validity.
• Identify how learners are employing ai agents and using commercial cheating services to circumvent testing rules.
• List foundational capabilities that testing programs should have in place to address these threats.
• Identify opportunities to work with vendors and other entities to address these threats.

Speakers:

Rachel R. Watkins Schoenig, JD
CEO, Cornerstone Strategies, LLC

Jarret Dyer
VP, Test Security, Surpass Assessment

Ray Nicosia
Cornerstone Strategies, LLC

Michael Clifton, JD
Vice President, Cornerstone Strategies, LLC

Certification and licensure programs in the age of artificial intelligence: What it means for our roles

Thursday November 20 | 9am 

The introduction of AI tools into the process of developing and validating assessments has brought about significant changes, enhancing efficiency, accuracy, and personalization. AI is undeniably transforming the field of assessments and exams. By understanding its impact and addressing the ethical considerations, we can harness the power of AI to create more effective and equitable assessments, and possibly to use assessments in areas where they have historically been impractical.

This panel session aims to provide valuable insights and foster discussions on the future of AI in assessments and the evolving role of industrial-organizational psychologists.

In this 60-minute discussion, panelists will discuss:

• AI in assessment design and development: The use of AI in item generation and quality evaluation is still in its early stages, but it holds great potential for future advancements. From item generation to adaptive testing, AI enables the creation of more efficient and effective assessments.
• AI in assessment delivery and maintenance: AI enhances the delivery and maintenance of assessments by providing real-time feedback, personalized experiences, and automated scoring. This not only improves the candidates’ experience but also ensures the integrity and reliability of the assessments.
• Ethical and legal considerations of using AI: The ethical use of AI is often debated but can be an afterthought with respect to its use in assessments. Additionally, using AI for assessments has several legal implications. The panel will share examples of these considerations as they incorporate AI into their assessment processes.
• The evolving role of industrial-organizational psychologists: AI is changing the role of industrial-organizational psychologists by automating routine tasks and providing deeper insights through data analytics. The panel will discuss how they can leverage AI to enhance their work and the skills that will be needed as AI becomes part of our day-to-day work lives.

Speakers:

Andy McAnulla
Co-CEO, Surpass Assessment

Tara Myers, PhD
Director, Measurement Services, American Nurses Credentialing Center

Phara Rodrigue, MA
COO at the Dental Assisting National Board

Kriste Buchanan
Senior Scientist, HumRRO

It takes two: Harmonizing AI innovation with accreditation standards

Thursday November 20 | 10.15am 

As artificial intelligence transforms the certification landscape, organizations face the dual challenge of leveraging innovative tools while preserving integrity and meeting accreditation requirements. This session brings together an accreditation expert and a testing technology specialist to demonstrate how these seemingly opposing forces can work in harmony.

See how organizations can utilize AI to enhance multiple certification processes—including exam development, job analysis, standard setting, scoring, and quality assurance – with processes that meet rigorous accreditation standards. Attendees will discover practical methods for configuring AI tools with appropriate human oversight, proper validation, and quality control throughout the certification lifecycle.

Through real-world examples, the session will address critical documentation needs for program policies, records retention, and verification procedures when AI tools are employed. Participants will gain insights into creating transparent audit trails that demonstrate responsible implementation across all stages of certification development and maintenance. Presenters will also discuss strategies for meeting guidance and standards provided by the National Commission for Certifying Agencies (NCCA).

Whether your organization is currently using AI tools, planning implementation, or still in the investigation stage, this presentation will provide practical strategies to successfully balance innovation and compliance through proper configuration, documentation, and oversight processes.

Learning objectives:

• Describe how AI technologies can enhance various certification processes including exam development, job analysis, standard setting, and quality assurance.
• Establish effective documentation and audit processes that demonstrate appropriate AI usage across certification program stages.
• Implement practical human oversight practices that maintain program integrity when using AI-assisted tools.
• Identify potential compliance issues with AI implementation and develop practical solutions that satisfy NCCA accreditation requirements.
• Understand how to configure AI tools to capture appropriate evidence of human oversight, validation, review, and quality control throughout the certification lifecycle.

Speakers:

Todd Galati
Principal and Founder, Galati Consulting Services

John Dight
VP, Business Development, Surpass Assessment