{"name":"Ask the index: public eval set","rule":"A question passes when the expected anchor is in the top 3, or when \"none\" is expected and the index says not in the index.","questions":[["Has he run RAG in production?","about-1"],["Which AWS services has he used?","grp-g-cloud"],["Does he know Kubernetes?","none"],["Has he led a team?","r-cstreet-0"],["How many developers has he taught?","h-udemy"],["Where is he based?","footer"],["Has he worked with GraphQL?","grp-g-apis"],["Does he do mobile?","cap-g-web"],["What did he do at Pasha Bank?","r-pasha-0"],["Is he certified on AWS?","h-aws"],["Has he built CI/CD pipelines?","r-grapevine-4"],["Does he use Docker?","r-grapevine-1"],["What degree does he have?","h-edu"],["Has he written about MySQL?","post-w-mysql"],["Does he know Elasticsearch?","r-travolic-4"],["What courses does he teach?","course-c-mern"],["Has he mentored engineers on LLM APIs?","r-grapevine-5"],["Does he know Rust?","none"],["Which databases has he used?","grp-g-apis"],["Has he built agents with tool calling?","r-grapevine-6"]],"measured":{"pass":20,"total":20,"misses":[]}}