Why Tricky Job Interview Questions Are Actually Useless, According to Experts

If you have ever been asked "How many golf balls fit in a school bus?" or "What is your biggest weakness?" during a job interview, you are not alone. Tricky interview questions have been a staple of the hiring process for decades, but a growing body of research says they are essentially useless at predicting whether someone will actually succeed in a role. According to experts in industrial-organizational psychology, these questions generate noise rather than insight, and they may even signal deeper problems with a company's hiring culture. At Metaintro, we track hiring trends closely, and this shift away from gimmick-based interviewing is one of the most important changes happening in the job market today. Here is what the research says, why it matters for both employers and job seekers, and what you should do the next time you face a curveball question.

What Counts as a "Tricky" Interview Question?

Tricky interview questions, sometimes called brainteasers, gotcha questions, or curveball questions, are intentionally unexpected, abstract, or only loosely related to the actual job requirements. They are designed to surprise candidates, test composure, or supposedly signal creativity. Some of the most common examples include:

• Estimation puzzles: "How many windows are in New York City?" or "How many golf balls can fit in a school bus?"
• Pressure role-plays: "Sell me this pen" — popularized by The Wolf of Wall Street, this reinforces the myth that great sales is about fast talk rather than listening, diagnosing needs, and building trust.
• Disguised personality tests: "What is your biggest weakness?" — less a test of self-awareness than an audition for plausible humility, where everyone rehearses the same polished non-answers.
• Failure narratives: "Tell me about a time you failed" — this rewards storytelling ability more than actual learning agility or resilience.

These questions share a common flaw: they measure how comfortable someone is with improvisation, not whether they can actually do the job. At best, they capture a candidate's ability to perform under artificial pressure. At worst, they measure how similar the candidate is to the interviewer, introducing bias rather than eliminating it.

What Does the Research Actually Say About Trick Questions?

The evidence against brainteaser-style interview questions is overwhelming, spanning decades of peer-reviewed research in industrial-organizational psychology.

The landmark study by Frank Schmidt and John Hunter, published in the Psychological Bulletin, analyzed 85 years of personnel selection research and found that unstructured interviews, the kind where interviewers improvise questions or throw out brainteasers, had a validity coefficient of just .38 for predicting job performance. Structured interviews, by contrast, scored .51. In plain terms, structured interviews are roughly twice as useful as freewheeling, trick-question-heavy approaches at identifying who will actually excel in a role.

More recent research has reinforced this finding. A 2022 meta-analysis by Sackett and colleagues found that structured interviews may actually be the single strongest predictor of job performance, outperforming even cognitive ability tests, which had long been considered the gold standard. This is a significant update because it means that the interview itself can be the most powerful tool in a hiring manager's toolkit, but only when it is done right.

A particularly striking study from Bowling Green State University examined the validity of brainteaser interview questions specifically and found very little empirical evidence that they capture information relevant to an applicant's personality, cognitive ability, or future performance. The study found that brainteaser questions were essentially measuring random noise rather than meaningful job-related skills.

Perhaps the most uncomfortable finding comes from a study published in Applied Psychology that investigated why some interviewers gravitate toward brainteasers. The researchers found that narcissism and sadism were significant predictors of who chose to use brainteaser questions. In other words, interviewers who use trick questions may be doing so to feel smart or to enjoy watching candidates squirm, not because the questions produce better hiring outcomes. The study described it as "a callous indifference and a lack of perspective-taking" underlying what amounts to abusive behavior in the employment interview.

Why Did Google Ban Brainteaser Questions?

No company was more synonymous with brainteaser interviews than Google. For years, candidates reported being asked questions like "How many gas stations are in Manhattan?" and "Why are manhole covers round?" The practice became so famous that books were written about how to crack Google-style interview puzzles.

Then Google looked at its own data, and the results were damning. Laszlo Bock, who served as Google's senior vice president of people operations, told the New York Times that brainteasers were "a complete waste of time." He was blunt: "They don't predict anything. They serve primarily to make the interviewer feel smart."

Google officially moved away from brainteasers and adopted structured behavioral interviews with consistent scoring rubrics. A Google spokeswoman confirmed the shift happened because "candidates hate them, answers leak easily, and most importantly, research on the connection between being able to correctly solve a brainteaser and future job performance is questionable and inconsistent."

This is significant because Google was not some small company following trends. It was the company that popularized brainteaser interviews in the first place. When even the originator of the practice abandons it based on internal data, it should tell every employer something important about the effectiveness of trick questions.

What Interview Methods Actually Predict Job Performance?

If trick questions are out, what should employers use instead? The research points clearly to structured behavioral interviews, and the data behind them is strong.

A structured interview means every candidate is asked the same set of questions, the questions are directly tied to skills and competencies required for the role, and responses are scored using a predetermined rubric. According to the U.S. Office of Personnel Management, interview questions based on specific job competencies identified through job analysis demonstrate "high levels of validity, rater reliability, and rater agreement." The more controlled and consistent the interview process, the more accurate it is as a hiring tool.

Here is how the most effective hiring methods compare, based on decades of meta-analytic research:

• Structured interviews combined with cognitive ability tests yield a predictive validity of .63, meaning they correctly identify strong performers about 63% of the time.
• Work sample tests — where candidates perform tasks they would actually do on the job — paired with cognitive ability tests achieve a validity of .63.
• Integrity tests combined with cognitive ability tests reach .65, the highest predictive validity of any combination.
• Unstructured interviews (including trick-question-heavy formats) score just .38, making them roughly half as effective as structured approaches.

Research has also found that the type of question matters within structured interviews. A study published in the Journal of Business Research compared four types of structured interview questions and found that background questions, situational questions ("What would you do if..."), and past behavioral questions ("Tell me about a time when...") all significantly predicted job performance. Job knowledge questions, however, did not predict future performance ratings, suggesting that even within structured formats, some question types are more valuable than others.

The takeaway for employers is clear. One structured interview administered by a single interviewer yields the same level of validity in predicting job performance as three or four unstructured interviews. Companies that replace trick questions with structured, competency-based questions are not just being kinder to candidates. They are making objectively better hiring decisions.

How Do Trick Questions Hurt the Hiring Process?

Beyond their lack of predictive value, trick questions create real damage to the hiring pipeline in several ways that employers should take seriously.

They drive away qualified candidates. Research on applicant reactions to brainteaser questions shows that they actively discourage otherwise qualified workers from accepting offers. In a tight labor market where top talent has options, a bad interview experience can be the deciding factor. Candidates talk, and companies known for gotcha interviews develop reputations that make recruiting harder over time. According to research from the IO at Work blog, many applicants find brainteaser questions unfair and irrelevant, breeding resentment that damages employer brand long after the interview ends.

They introduce bias. When there is no scoring rubric and the "right" answer is whatever the interviewer finds clever or impressive, the door opens wide for unconscious bias. Candidates who share the interviewer's communication style, cultural background, or sense of humor score better, regardless of their actual qualifications. This undermines diversity and inclusion efforts and can expose companies to legal risk.

They waste valuable interview time. Most interviews last 30 to 60 minutes. Every minute spent on a brainteaser is a minute not spent learning whether the candidate can actually do the job. Given that research shows behavioral and situational questions are the most predictive, every trick question represents a missed opportunity to gather genuinely useful information.

They create a false sense of rigor. Many hiring managers believe that trick questions test "critical thinking" or "problem-solving ability." But the research is clear: what they actually test is a candidate's comfort with ambiguity and improvisation, which may or may not be relevant to the role. A software engineer does not need to estimate the number of piano tuners in Chicago to write excellent code. A marketing manager does not need to sell a pen on command to develop effective campaigns.

Related Articles

• 45+ Behavioral Interview Questions and Answers
• 50 Company Questions to Ask in Interviews
• 15 Management Interview Questions You Must Master
• 34 Business Development Manager Interview Questions
• 50 Flight Attendant Interview Questions and Answers
• 25 Teacher Interview Questions That Land You the Job
• How to Answer Your Greatest Accomplishment Interview Question
• How to Negotiate Salary After a Job Offer: 15 Scripts That Win
• How Many Job Applications Should You Send Per Day?
• Chronological vs Other Resume Formats: 2025 Guide

What Should Job Seekers Do When Faced With Trick Questions?

Even though the trend is moving away from trick questions, plenty of companies still use them. If you encounter one in your next interview, here is how to handle it effectively.

Do not panic. The interviewer is rarely looking for a specific correct answer. For estimation questions, they want to see your thought process. Take a breath, acknowledge the question, and start breaking it down logically. Saying "Let me think through this step by step" shows composure and analytical thinking, which is exactly what the interviewer is trying to evaluate.

Think out loud. For brainteaser-style questions, narrate your reasoning. State your assumptions, explain your logic, and walk through your approach step by step. The interviewer cannot see inside your head, and a thoughtful process matters more than the final number you arrive at.

Redirect to your strengths. For questions like "What is your biggest weakness?" or "Tell me about a time you failed," use the STAR method (Situation, Task, Action, Result) to give a structured answer that highlights what you learned and how you grew. The goal is to transform a potentially awkward question into a genuine showcase of self-awareness and professional development.

Pay attention to what the question tells you about the company. If an interviewer relies heavily on gotcha questions with no clear connection to the role, that can be a signal about the company's hiring culture. A disorganized, unstructured interview process often reflects broader organizational issues. If every question feels designed to trip you up rather than learn about your qualifications, consider whether this is a place where you would actually thrive.

Prepare for the questions that actually matter. Instead of spending hours practicing brainteaser answers, invest your preparation time in behavioral interview questions. Review the job description, identify the core competencies the role requires, and prepare two to three specific examples from your experience that demonstrate each competency. This preparation will serve you well regardless of whether the company uses structured or unstructured interview methods.

People Also Asked

Q: Why do employers still use trick questions if research says they do not work?

A: Many hiring managers are unaware of the research on interview effectiveness, and trick questions have become an ingrained part of interview culture at many organizations. Some interviewers also use them because they believe the questions test critical thinking, even though studies show they primarily measure comfort with improvisation. Additionally, research has linked the use of brainteaser questions to narcissistic personality traits in interviewers, suggesting that some use them simply because it makes them feel smart or in control.

Q: What is the best type of interview question for predicting job performance?

A: Structured behavioral questions are the most effective, according to decades of meta-analytic research. These are questions that ask candidates to describe specific past experiences relevant to the job, such as "Tell me about a time you managed a conflict within your team." When scored using a consistent rubric, these questions achieve a predictive validity roughly twice that of unstructured or trick-question-based interviews. Situational questions, which present hypothetical job scenarios, are also highly effective.

Q: Should I refuse to answer a trick question in an interview?

A: No, refusing to answer would likely hurt your candidacy. Instead, engage with the question calmly and show your thought process. For estimation puzzles, think out loud and break the problem into logical steps. For personality-based trick questions like "What is your biggest weakness?", give a genuine but strategic answer that demonstrates self-awareness and growth. Use the experience as information about the company's culture, and focus your preparation time on behavioral questions that highlight your real qualifications.

Prepare to stand out in your next interview. Metaintro gives you the tools, data, and insights to ace your job search, from interview prep to salary negotiation to real-time hiring trends. Whether you are facing brainteasers or behavioral questions, knowing what employers are really looking for puts you ahead of the competition. Sign up today and get the edge you need to land your next role.