PromptRank

dak-v1/promptrank

PromptRank is an AI-native assessment platform designed to evaluate a skill that traditional assessments increasingly fail to measure: whether people can work effectively with AI without blindly trusting it. Candidates enter simulated workplace scenarios where an AI agent assists them but is intentionally seeded with realistic contextual, logical, and data-related flaws. The candidate's response becomes the assessment itself and PromptRank evaluates whether they detect, verify, challenge, and correct the AI's output. PromptRank is built around a multi-agent evaluation architecture. A Scenario Architect controls a hidden flaw schedule, a Simulator Agent conducts the live multi-turn interaction, a Behavioural Observer analyses the candidate's actions against the seeded flaws, and an Executive Grader converts behavioural telemetry into structured rubric scores. This enables PromptRank to measure behaviours such as time to detect errors, resistance to AI overconfidence, auditing rigor, and correction quality, rather than simply evaluating a candidate's final answer. The platform currently supports the complete assessment lifecycle, from candidate intake and AI-driven simulation through automated evaluation, individual skill-gap reporting, session history, learning recommendations, and employer/institution-level cohort analytics. The application is deployed with the core multi-agent assessment loop operational. Reviewers should pay particular attention to the assessment paradigm: PromptRank does not evaluate whether a candidate can simply use AI; it evaluates whether they can collaborate with, question, and verify AI when the AI itself is wrong. This human-AI interaction layer is the core innovation and creates a foundation for scalable, role-specific and enterprise-customized AI-readiness assessments.