100% Plagiarism-Free
+1-727-416-5453

Sign In

Access your dashboard and order activity.

Forgot password?

Create Account

Register to place orders and track every step.

EN.605.734

Human-in-the-Loop AI: Crowdsourcing, LLMs, and Evaluation

Johns Hopkins University 3 credits Computer Science

Course Description

Human-in-the-Loop AI: Crowdsourcing, LLMs, and Evaluation explores how modern AI systems are built, improved, and audited through the combined strengths of people and machines. As large language models reshape the way organizations collect data, make decisions, and deploy intelligent systems, this course examines when human judgment still matters, when AI can automate complex tasks, and when hybrid human-AI workflows produce the best results. Students will study crowdsourcing, task and prompt design, data quality, inter-annotator agreement, evaluation methods, and bias in both human- and AI-generated outputs. Through hands-on assignments and applied projects, students will compare crowd workers, LLMs, and human-AI pipelines on realistic problems in classification, annotation, conversational systems, and responsible AI evaluation. The course emphasizes practical skills in designing reliable workflows, measuring quality, and identifying failure modes in intelligent systems. By the end of the course, students will be able to build and assess human-in-the-loop AI systems that are effective, scalable, and trustworthy.

Code
EN.605.734
Credits
3
Subject
Computer Science

Get expert help with EN.605.734 Human-in-the-Loop AI: Crowdsourcing, LLMs, and Evaluation

Our subject experts help with essays, research papers, case studies, discussion posts, and capstone projects for these programs β€” written from scratch to your course requirements.

Get Help Now

Program and course information is reproduced from each university's published academic catalog for informational purposes and may change. Always confirm current requirements with your university. We are an independent academic support service and are not affiliated with or endorsed by the universities listed.

Academic Resources

Latest from the Blog

Expert guides on essay writing, citation styles, study skills, and academic success.

View All Articles