Close

Member Login

Logging In
Invalid username or password.
Incorrect Login. Please try again.

not a member? sign-up now!

Signing up could earn you gear and it helps to keep offensive content off of our site.

FAA Knowledge Test Failures Skyrocket

By Pia Bergqvist / Published: Mar 09, 2011
Rate it! 100% or 0%
Flying Magazine | The World’s Most Widely Read Aviation Magazine
Photo: Mid Island Flight School

A letter was issued to the FAA last week by the National Association of Flight Instructors (NAFI) and AOPA criticizing the recent unannounced but significant changes to the FAA knowledge test question database. Noticeable changes have appeared for the airline transport pilot (ATP), flight engineer (FE) and fundamentals of instruction (FOI) tests, and others may have been affected as well.

As a result of the question bank amendments, the failure rate for the tests quadrupled. The letter from NAFI and AOPA requested that the FAA revert back the questions, allow the students who failed to retake the exam and have those students' failures removed from their records. Furthermore, the organizations requested that the FAA coordinates any changes in the question bank with the industry, and allows time for changes in the methods of instruction for the knowledge test to be implemented prior to activation of the new questions.

Apparently the modifications to the FOI test were made to align it with the newly revised, 228-page Flight Instructor Handbook. While NAFI and AOPA don't promote rote memorization for the tests, they feel that the number of possible questions generated from such a large pool of information makes it too difficult for students, and that some guidance is needed, similar to the Practical Test Standards provided for the oral and flight portions of flight ratings.

Comments (8) Post a comment

All Comments

Arsenio's picture

I am glad the FAA did this! I am embarrassed that AOPA (I'm a member) is essentially advocating ROTE MEMORIZATION. They are trying to sugar-coat it, but the reality is, that the failure rate indicate that there was no UNDERSTANDING or APPLICATION of principles. WAY TO GO, FAA!!!! They should do this with the other ratings, also.

tom connor's picture

How can anyone be for or against the changes without specifics? Did they change the KT questions to similar but related topics and problems or items unrelated to the topics mandated by the FAA.? It matters. It also matters if the questions are of a complexity unnecessary to that of the license in question or relevant to reality: Does the instrument test still cover the MLS? ADF?

Personally, my opinion of the private and instrument knowledge tests is that they cover darn little regarding how to fly a plane, decision making and the stuff an instructor and evaluator look for in a flight student.

Maybe we should be asking what the KT contributes to student safety and proficiency rather than how to keep a good stick with bad study habits from carrying a license.

veryhrm's picture

(Note: i'm only a stalled student and the FAA has NOT yet messed w/ me and/or ruined my life so i haven't yet internalized the negative feelings industry people generally seem to have about dealings with the FAA. (though just from reading over the years it certainly seems they need to be feared) )

That said, i'll comment anyway... because this is the web.

a) I generally second Arsenio's comments. Some of the FAR and or definition of terms questions are hard/annoying, but the ones about reading a chart or calculating fuel etc ? Come on... a pilot had BETTER be able to do those... and you only need a 70% to pass anyway!

b) That "failure rates have quadrupled" line w/o the context of what the values are made me curious. if it went from 20% failure to 80% failure that's something... if it's from 1% to 4%... less interesting.

But check it out, the FAA actually publishes some statistics: http://www.faa.gov/data_research/aviation_data_statistics/test_statistic... (2009 seems to be the latest available on the site)

in 2009 ... for FE of all kinds... the pass rate was 100.00% so a failure rate as a multiple there is mathematically undefined. and only about 70 people even took these tests.

For FOI (fundementals of instruction) 5000 people took it w/ a pass rate of 98.49%... 4x increase there would mean a pass rate of 94%... not GREAT, but doesn't seem like something to write home about.

ATP had a pass rate of 92% for 4000 people. 4x failure rate there would take it down to 68%... that would be pretty bad.

Overall that gives a pre-change failure rate of 400 out of 9000 people or 4.4% and a new failure rate of 17.7% if it's 4x . Clearly though given the very different failure rates of the different groups mentioned, further breakdown should have been provided in the report (and the letter).

wesherring's picture

Okay, it seems I am the first one to comment that was actually affected by this change. First, the reason I have a desire to become an instructor was because of the poor instruction that I received. Most instructors were looking to build time and get on to what they felt were bigger and better things.

I studied for weeks on the FOI exam. I spent hundreds of dollars on study material. Just to find I had studied the wrong information. I have consistently scored very high on all of my knowledge exams until this one, which I actually failed. Meaning there were drastic changes. In a few instances, the answer choices that were given were not actually correct, and the incorrect answers were so similar that there was no clearly correct answer, which goes against what is taught in the "Aviation Instructor's Handbook". Chapter 2

I agree that at this level you should be way beyond Rote learning for theses exams. I don't see how anyone is advocating rote learning. But at $150 for the fee, you should at least be offered a road map.

wesherring's picture

Not to mention that any multiple choice exam is going to have a certain level of rote learning to it, which is precisely why we have the oral and practical exam to determine understanding and application. These knowledge tests help to determine weak areas to work on.

Alaskancub's picture

First of all, Arsenio's original comment "WAY TO GO FAA" is incredibly insensitive as well as a clear indication of that poster's ignorance.
I've been flying for over 15 years, and finally decided to get my CFI; my story is identical to wesherring in that I was incredibly frustrated as well as I honestly felt misled when I failed my FOI written with a 62% after getting high 80's to mid-90's on my practice tests. I obviously studied the wrong material, but there was NO guidance, and NO preparation for the complete difference in material BEING tested in the "New" FOI test bank. Did I learn anything? NO. Was my knowledge on the subject accurately depicted by my test result? That answer is subjective: WHAT SUBJECT? If I had been actually tested on the subject material that I had studied, a completely different depiction of my knowledge would have resulted.

Shame on the FAA for their clearly un-ethical standards without working with the industry. Forget mine and all the other students $150 dollars thrown away on a completely different test; what bothers me the most is they violate THEIR OWN Publication AIH (Aviation Instructor's Handbook, which incidentally is the book from which their NEW test questions are taken, and make sure it is edition FAA-H-8083-9A) which discusses how damaging and de-motivating it is to students when an instructor does the VERY thing they've done with the FOI test.

I'd also like to know the hard statistics on the "Quadrupled failure rate", especially since I am now a member of that auspicious pool of fine people. :)

kd1984's picture

I appeared in the FOI test in feb 2011 and failed with flying colors .scored of 68%.
On the Gliems test prep i was scoring in mid and high 90s.And i had studied from the AIH book too.But frankly i depended on Gliems test prep more than the handbook ,as i was told by my fellow cfii students and the instructor himself to study important topics from AIH .
so the first 25 questions of the test were those that i had not seen in test prep at school.
if it helps anyone,there were questions from topics like skill acquisition ,fatigue and test preparation material.so study the AIH in details is the only way to score good on the new test.
Most of the questions were opinion based.For example ,according to the AIH book ( sec 8-3) ,the minimum acceptable standards for passing the checkride should not be introduced until the 3 hours of preparation for the checkride.And there is a question from this topic which i obviously got wrong.
This is like keeping a student in dark and none of my instructors right from my student pilot days followed this. I was told right from the indtoduction what the min acceptable standards are.
I'm going to retake the test and spend $ 150.00 again. It hurts when your money goes wasted,specially when you are working two jobs to support your dream.So this time i will answer the questions based on the AIH.Wish me luck.

Lucas72's picture

Most of the material out there either only teaches you how to memorize questions and answers or requires you to read a very large amount of information.

On the other hand we at Pilot Training Solutions have been teaching in classes the material required to pass your knowledge tests by explaining the material itself, using multiple tricks to make even the hardest questions answerable in seconds.

Problem is not everyone can spend a weekend in NJ with us to help you, so we developed software that replaces the classes completely, and so far our customers have really enjoyed it and obviously passed the test with flying colors.

To this day we still have not seen anybody fail the test using our products, and thus far we offer the Private, Instrument, and Commercial prep for both PC and Mac, with the ATP coming out probably towards the end of May this year.

Please feel free to download our free demos at http://passfaaexams.com/ and tell me what you think

Here is a short video to show you how our courses work
http://www.youtube.com/embed/9CHfx7LWDCI

Good luck with your test

Lucas

Top Rated

Your Comment
CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
All submitted comments are subject to the license terms set forth in our Privacy Policy and Terms of Use