AI Practical Workshop – Test & Evaluation of LLM & Gen AI Applications

This practical half-day workshop is designed to provide participants with a practical understanding of the process of testing and evaluating large language models and related generative AI applications for use in a business context.

Key Information:

• Face-to-face Workshop
• Half-Day
• Workshop date: 10th of July, 12.30pm to 4.30pm
• Price: $500 ex-GST

Workshop Topics:

SESSION 1: Evaluating Large Language Models

⚡ Introduction to Large Language Models

Overview of LLMs, Key Characteristics of LLMs

⚡ Testing Large Language Models

Testing in LLM Development, Types of Tests, Test Case Design

⚡ Evaluation Metrics and Techniques

Common Metrics, Qualitative Evaluations, Challenges

⚡ Practical Exercise

Hands-on Exercise, Group Discussion

SESSION 2: Practical Techniques and Best Practices in LLM Testing

⚡ Advanced Testing Techniques

Uncovering Biases & Ensuring Fairness, Testing for Robustness, Scenario-based Testing

⚡ Optimizing LLMs Through Iterative Testing

Iterative Development, Feedback Loops, Case Studies

⚡ Best Practices and Future Directions

Best Practises, Emerging Trends, Ethical Considerations & Responsible AI

⚡ Interactive Session

Applying Advanced Testing Techniques

⚡ Wrap up

Key Takeaways, Resources, Conclusion

What's included?

🌀 Expert Workshops
Learn from leading industry experts in tech and business.

🌀 Interactive Sessions

Engage in interactive sessions that facilitate collaborative learning and discussion among participants.

🌀 Networking Opportunities

Connect with peers and industry who share a common interest in AI deployment and governance. Lunch will be provided at the beginning of the workshop.

Who is it for?

💡 This workshop is intended for technical practitioners and any professionals looking to understand the process of testing and evaluating LLMs and related generative AI applications for use in a business context.

Where is it delivered?

📍 The Precinct, 315 Brunswick St, Fortitude Valley QLD 4006 - Warra Room (Level 2)

Participants have to join in-person to attend the program.

More questions?

📭 There are only 20 seats available for this cohort.

Reach out to KJR at [email protected] if you have any questions.

This program is delivered by KJR. KJR is a founding member of the Queensland AI Hub.

KJR is an Australian Software Quality Engineering Consultancy and a leading practitioner in Responsible AI implementation. Founded on over 26 years of experience in quality assurance and verification, KJR has always understood the importance of managing IT risk and especially do so now with the steady maturation of various emerging technologies. We recognise the potential of Artificial Intelligence and Machine Learning and see the specific challenges these technologies pose to traditional forms of quality assurance. We have harnessed our expertise to develop practical approaches to assuring compliant and successful deployments of AI solutions.

Host or Publisher KJR