For two years, I served as a representative to my medical school's Student Affairs committee. My job was to convey medical student concerns and problems. As part of that role, I had a lot of time to think about how and why many medical students experience depression and stress, which is an incredibly large problem. At one school, prior to intervention, 27% of students had depression and over 55% had anxiety. Two recent articles have led me to write about the issue now.
I'll address medical student mental health here, and physician mental health in a later post.
Many see medical student mental health as a simple problem: bad doctors and bad residents are mean and abusive. Punish them, fire them, and the problem will go away. But that's like seeing the flooding in New Orleans after Katrina and thinking, "We should really have improved the sewage system". It didn't matter how good the drains were- once the levees broke, the game was up. We need to look at the problem in a manner similar to root cause analysis- something I've written about in the past. Of course, as we are not dealing with a single incident, the formal process is less applicable here.
Let me posit that most medical schools have the following characteristics:
1) Medical students face fierce competition for residency spots. They are constantly told they risk not matching in their desired specialty, their desired program/geographical location, or at all if they do not perform at a very high level academically. In short, their dreams of what kind of medicine they wish to practice is determined by their academic performance relative to their peers.
2) Academic performance consists of two main parts: the Step 1 exam taken after Year 1, and Clinical Grades during Year 3. (Some schools also have pre-clinical grades, which I will not go into here) Clinical Grades consist of some combination of
Schools restrict how many students in any class can get the highest grade (Honors) in a clerkship. This may be the top 5%, top 10%, or 25%. The next category (High Pass) will typically encompass 60-70% of the class, with Pass or lower reserved for those students with serious deficiencies.
3) Evaluations by residents and attendings can be highly arbitrary, and small variations can lead to drastic differences. (80-94% is High Pass, 95-100% is Honors, etc.)
What does a system set up like this result in? A perceived need to be “perfect”. Medical students widely feel the need to both be clinically good but also socially adept- to be able to get their residents to “like” them in order to get a good grade. Many feel that a single screw-up or forgetting of a “pimp” question is enough to ruin their chance for an Honors- particularly from attendings who have limited contact with them throughout the rotation.
One student who I talked to felt so anxious about getting her resident to like her that she literally could think of nothing to say to her residents for days at the start of her rotation. Many students describe chronic, toxic stress from the need to be “on their game” and completely attentive to anticipating and fulfilling every conceivable need of their residents and attendings- in the hope of a better grade. This on top of the need to study at night, and the need to constantly volunteer to stay late, come in early, and do as much extra work as possible to demonstrate one's capacity for work.
Now, is this rational behavior? Probably not. It's impossible to say how much one's social skills and ability to smooze and hang out with the residents affects one grade- after all, the ones with the best social skills may also be quite good at conversing with patients. But, when small changes in evaluations (93% vs 95%) can lead to large differences in grade (Honors vs High Pass), many medical students face this chronic, toxic stress to be a social butterfly when they are with the residents- who they spend 10-16 hours a day with for weeks.
Added on top of this can be poor, "abusive" behavior by some residents and attendings. Such behavior I believe stems from the pain they face from taking care of patients in a system that treats them as cogs in a machine, but that is a post for another day.
But a far worse problem is this: medical students under such horrific, constant stress to seek approval and make their residents happy every second of every day are completely unprepared to deal with anything but the most gentle and kind negative feedback. When a resident makes a throwaway comment like "You forgot to check the pathology. In a post-op visit, you must check the results on whatever we took out. It could be cancer. You could kill someone the next time you forget", it becomes something that a medical student obsesses over for days.
What if that one incident will lead to that resident giving the student a lower grade? What if the student just ruined her chance for her dream residency in ophthalmology in the Bay Area? What if she ends up breaking up with her boyfriend because she won't make AOA and be competitive enough for a couples match? What if she never marries or has kids and dies alone because she didn't meet anyone because her boyfriend broke up with her and she will be too busy to date during residency and too old after, all because she forgot to check the pathology in a post-op visit? (That sequence was slightly in jest, but really only slightly- I changed some small details to protect the hysterical. And I suspect every medical student can think of "that person in our class who would totally say this").
But the reality is that mistakes which are normal and expected in the course of training become things that in medical students' minds can never be allowed to occur- instead they push themselves to be perfect on day one- the most obsequious assistant, the most eager learner, the most knowledgeable student, and the most funny, charming, and perfect person to be around- all in the hopes of getting that precious 97 instead of 93, and securing a grade of Honors.
Thus I believe is the real source for much of the stress felt by many medical students in this country is ultimately the grading system and what it is used for- residency matching.
One thought is to simply get rid of subjective evaluations as part of clinical grades, and base clerkship grades on the objective shelf exam scores. This would certainly reduce stress that comes from being evaluated by residents. But, it would also lead to a loss of something important in the evaluation of a doctor. Medicine is art and science- and there are many medical students who are terrible test takers, but outstanding communicators, thinkers, and eventually doctors. These students would be lost, unable to prove their worth in any objective sense if grading was solely based on tests. Some more elite medical schools practice a softer version of this- they give very few, or a large number of honors, making the grade somewhat meaningless and relying upon the strength of their school's name to help all of their students match. This option is not really available to any school outside of the top 10-15 ranked medical schools in the country, as judged by research funding, and again masks clinically astute students.
But another and more promising thought is to make evaluations only a little less subjective, where "perfection" is impossible and not expected. As part of an overall shift in medical education, grading would be changed from residents and attendings giving medical students a number from 0 to 100 (or some equivalent thereof). Instead, the medical student will have an online or paper card with items to sign off during the course of their rotation, like below:
"Is this student capable of performing an appropriate history and physical at a medical student level for a complaint of back pain?"
"Is this student capable of performing an appropriate history and physical at an intern level for a complaint of a complaint of back pain?"
"Is this student capable of performing an appropriate history and physical at a senior resident level for a complaint of a complaint of back pain?"
"Is this student capable of performing an appropriate history and physical at an attending level for a complaint of a complaint of back pain?"
When they meet the expectation, they get the appropriate box signed off. Then, instead of compiling a clerkship score, residency program directors would simply be handed a grid with the answers: where the student was a little behind, where they are a little ahead. The key element here is that students would continuously be getting items checked off throughout the rotation- residents should not get an email a week after the end of the rotation telling them to fill out an eval in the next day on their recent medical student OR ELSE. The latter likely leads to arbitrary grading as residents rush to get through yet another task.
This I think is the best solution. While still somewhat subjective (how does one decide what an intern-level H&P is vs a senior resident H&P), it would significantly reduce subjectivity, give students who are clinically astute a place to shine, and reduce overall stress levels. It would be entirely impossible for every student to function at an attending-level for everything. But here and there, there would be bonuses. The minimum expectation would be to have the medical-student level items all signed off.
Is this a perfect system? Of course not. So long as competitive and more desirable residencies restrict the number of residency spots, there will need to be some need to stratify medical students, and that will create competition and stress. But a more objective system where no one can be perfect will allow medical students to be less anxious about being only average, and reduce the toxic stress. I have heard rumblings about such a system being in the works, and I can only hope that it will happen sooner rather than later.
I'll address medical student mental health here, and physician mental health in a later post.
Many see medical student mental health as a simple problem: bad doctors and bad residents are mean and abusive. Punish them, fire them, and the problem will go away. But that's like seeing the flooding in New Orleans after Katrina and thinking, "We should really have improved the sewage system". It didn't matter how good the drains were- once the levees broke, the game was up. We need to look at the problem in a manner similar to root cause analysis- something I've written about in the past. Of course, as we are not dealing with a single incident, the formal process is less applicable here.
Background
Let me posit that most medical schools have the following characteristics:
1) Medical students face fierce competition for residency spots. They are constantly told they risk not matching in their desired specialty, their desired program/geographical location, or at all if they do not perform at a very high level academically. In short, their dreams of what kind of medicine they wish to practice is determined by their academic performance relative to their peers.
2) Academic performance consists of two main parts: the Step 1 exam taken after Year 1, and Clinical Grades during Year 3. (Some schools also have pre-clinical grades, which I will not go into here) Clinical Grades consist of some combination of
- Evaluations by residents and attendings
- Shelf exam
- OSCEs
- Other tests
Schools restrict how many students in any class can get the highest grade (Honors) in a clerkship. This may be the top 5%, top 10%, or 25%. The next category (High Pass) will typically encompass 60-70% of the class, with Pass or lower reserved for those students with serious deficiencies.
3) Evaluations by residents and attendings can be highly arbitrary, and small variations can lead to drastic differences. (80-94% is High Pass, 95-100% is Honors, etc.)
Analysis
What does a system set up like this result in? A perceived need to be “perfect”. Medical students widely feel the need to both be clinically good but also socially adept- to be able to get their residents to “like” them in order to get a good grade. Many feel that a single screw-up or forgetting of a “pimp” question is enough to ruin their chance for an Honors- particularly from attendings who have limited contact with them throughout the rotation.
One student who I talked to felt so anxious about getting her resident to like her that she literally could think of nothing to say to her residents for days at the start of her rotation. Many students describe chronic, toxic stress from the need to be “on their game” and completely attentive to anticipating and fulfilling every conceivable need of their residents and attendings- in the hope of a better grade. This on top of the need to study at night, and the need to constantly volunteer to stay late, come in early, and do as much extra work as possible to demonstrate one's capacity for work.
Now, is this rational behavior? Probably not. It's impossible to say how much one's social skills and ability to smooze and hang out with the residents affects one grade- after all, the ones with the best social skills may also be quite good at conversing with patients. But, when small changes in evaluations (93% vs 95%) can lead to large differences in grade (Honors vs High Pass), many medical students face this chronic, toxic stress to be a social butterfly when they are with the residents- who they spend 10-16 hours a day with for weeks.
Added on top of this can be poor, "abusive" behavior by some residents and attendings. Such behavior I believe stems from the pain they face from taking care of patients in a system that treats them as cogs in a machine, but that is a post for another day.
But a far worse problem is this: medical students under such horrific, constant stress to seek approval and make their residents happy every second of every day are completely unprepared to deal with anything but the most gentle and kind negative feedback. When a resident makes a throwaway comment like "You forgot to check the pathology. In a post-op visit, you must check the results on whatever we took out. It could be cancer. You could kill someone the next time you forget", it becomes something that a medical student obsesses over for days.
What if that one incident will lead to that resident giving the student a lower grade? What if the student just ruined her chance for her dream residency in ophthalmology in the Bay Area? What if she ends up breaking up with her boyfriend because she won't make AOA and be competitive enough for a couples match? What if she never marries or has kids and dies alone because she didn't meet anyone because her boyfriend broke up with her and she will be too busy to date during residency and too old after, all because she forgot to check the pathology in a post-op visit? (That sequence was slightly in jest, but really only slightly- I changed some small details to protect the hysterical. And I suspect every medical student can think of "that person in our class who would totally say this").
But the reality is that mistakes which are normal and expected in the course of training become things that in medical students' minds can never be allowed to occur- instead they push themselves to be perfect on day one- the most obsequious assistant, the most eager learner, the most knowledgeable student, and the most funny, charming, and perfect person to be around- all in the hopes of getting that precious 97 instead of 93, and securing a grade of Honors.
Thus I believe is the real source for much of the stress felt by many medical students in this country is ultimately the grading system and what it is used for- residency matching.
Solutions
Now, what can be done about it? The reality is that so long as medical students are judged in any way based on their clinical performance in the 3rd year, and so long as that judgement is used to determine residency allocations, some amount of stress will continue to be present.One thought is to simply get rid of subjective evaluations as part of clinical grades, and base clerkship grades on the objective shelf exam scores. This would certainly reduce stress that comes from being evaluated by residents. But, it would also lead to a loss of something important in the evaluation of a doctor. Medicine is art and science- and there are many medical students who are terrible test takers, but outstanding communicators, thinkers, and eventually doctors. These students would be lost, unable to prove their worth in any objective sense if grading was solely based on tests. Some more elite medical schools practice a softer version of this- they give very few, or a large number of honors, making the grade somewhat meaningless and relying upon the strength of their school's name to help all of their students match. This option is not really available to any school outside of the top 10-15 ranked medical schools in the country, as judged by research funding, and again masks clinically astute students.
But another and more promising thought is to make evaluations only a little less subjective, where "perfection" is impossible and not expected. As part of an overall shift in medical education, grading would be changed from residents and attendings giving medical students a number from 0 to 100 (or some equivalent thereof). Instead, the medical student will have an online or paper card with items to sign off during the course of their rotation, like below:
"Is this student capable of performing an appropriate history and physical at a medical student level for a complaint of back pain?"
"Is this student capable of performing an appropriate history and physical at an intern level for a complaint of a complaint of back pain?"
"Is this student capable of performing an appropriate history and physical at a senior resident level for a complaint of a complaint of back pain?"
"Is this student capable of performing an appropriate history and physical at an attending level for a complaint of a complaint of back pain?"
When they meet the expectation, they get the appropriate box signed off. Then, instead of compiling a clerkship score, residency program directors would simply be handed a grid with the answers: where the student was a little behind, where they are a little ahead. The key element here is that students would continuously be getting items checked off throughout the rotation- residents should not get an email a week after the end of the rotation telling them to fill out an eval in the next day on their recent medical student OR ELSE. The latter likely leads to arbitrary grading as residents rush to get through yet another task.
This I think is the best solution. While still somewhat subjective (how does one decide what an intern-level H&P is vs a senior resident H&P), it would significantly reduce subjectivity, give students who are clinically astute a place to shine, and reduce overall stress levels. It would be entirely impossible for every student to function at an attending-level for everything. But here and there, there would be bonuses. The minimum expectation would be to have the medical-student level items all signed off.
Is this a perfect system? Of course not. So long as competitive and more desirable residencies restrict the number of residency spots, there will need to be some need to stratify medical students, and that will create competition and stress. But a more objective system where no one can be perfect will allow medical students to be less anxious about being only average, and reduce the toxic stress. I have heard rumblings about such a system being in the works, and I can only hope that it will happen sooner rather than later.
No comments:
Post a Comment