Balkinization  

Tuesday, July 23, 2013

How "The Million Dollar Law Degree" Study Systematically Overstates Value: Three Choices that Skewed the Results

Brian Tamanaha

Michael Simkovic and Frank McIntyre (S&M) have created a sensation with the release of their new study purporting to show that a law degree has a value of $1,000,000. Legal educators cheered and skeptics jeered.

S&M pitch the article as a crushing empirical refutation of the argument I press in Failing Law Schools that getting a law degree today can be financially risky, especially for students who attend expensive low ranked law schools. Simkovic writes, “we disagree with [Tamanaha’s] conclusions about the riskiness of a law degree because data on law degree holders does not support his conclusions.” So confident are they in their findings that they warn prospective students: “many college graduates who follow the critics’ advice and skip law school will forego a lucrative career and face higher long-term risks of financial hardship.”

All sides in this debate carry the same responsibility, of course, because if S&M are wrong, people who follow their advice risk serious financial hardship. Thus it is incumbent on all of us to consider these issues carefully and honestly.

Everyone agrees that many lawyers make a good living, so the significance of their study is at the bottom, where the greatest risk lies. S&M assert that even law graduates at the lower end of the earnings spectrum, including grads who don’t land jobs as lawyers, stand to earn “hundreds of thousands” of dollars over what they would have obtained with a bachelor’s degree alone. Great news for all!

Unfortunately, it’s not true.

Let me state up front that their study contributes to the debate over the value of a law degree. Let me also confirm that their study is far more sophisticated than my admittedly crude efforts. But as the saying goes, it is far better to be approximately right than precisely wrong. Despite having the external trappings of precision and rigor, their study is faulty and misleading.


S&M OVERSTATE THE ECONOMIC VALUE OF A DEGREE OVER THE PAST TWO DECADES

Their analysis is based upon data provided by United States Census Bureau’s Survey of Income and Program Participation (SIPP), which tracks earnings over time by educational degree. The authors examine the earnings of people with law degrees from 1996 to 2011, and compare this to the earnings of people with bachelor’s degrees (in selected majors) over the same period. The “JD earnings premium” they identify is the difference between the two.

The great strength of their study, S&M say, is that it is a “long term” examination which establishes “historic norms”—thereby providing a much more reliable picture of lawyer earnings than my own immediate short term focus. The credibility of their study rests entirely upon this claim.

All their talk of “historic norms,” however, is puffed up exaggeration: 16 years is neither “long” nor remotely enough time to establish “historic norms.”

Had S&M extended their study by just four years—to 1992, covering twenty years in all—they would have found reduced “earnings premium” for law grads. This is because the legal job market suffered a severe recession from 1992 to 1998, while the general economic recession had ended in early 1992. (The downturn in the legal market is visible in Figure 2, p.9.) Since the “earnings premium” is the difference between the earnings of bachelor’s degree holders and law degree holders, it constricts when the general economy does relatively well while the legal market does relatively poorly. That was precisely the situation between 1992 and 1998.

There is no doubt that including 1992 to 1995 in their study would measurably reduce the “earnings premium.” In Figure 6 (p. 35), S&M set forth the earnings premium in four blocks: 1996-99, 2000-03, 2004-07, and 2008-2011. 1996-99 has the lowest earnings premium among the four (substantially below average)—and it is likely that the 1992-95 premium would be lower still because the legal market was down for all four years, whereas it was beginning to recover in 1998. Had 1992-95 been included, it would have constituted 1/5 of the total, undoubtedly bringing down the overall “earnings premium” by no small amount.

As other critics have pointed out, furthermore, their study does not include the earnings of the graduating classes of 2009, 2010, and 2011 (not to forget 2012 and 2013)—which have suffered devastatingly poor job results. (The earnings included in the study through 2011 are only for 2008 grads and earlier.)

To be clear, I’m not asserting that S&M began to count income in 1996, rather than 1992, deliberately to boost the “earnings premium” by shaving off four of the worst law degree earning years in the past two decades, although it had this effect. No doubt they can offer reasons to explain their decision. (Although SIPP was redesigned in 1996, there are surveys for 1993 and 1992, which allow continuity; SIPP reports go back to the mid-1980s, first appearing in the middle of yet another recession in the legal market.) And they cannot be blamed for leaving out post-2008 law grads because the latest SIPP was from 2008—though this information will be available when the next SIPP is released.

Why these crucial gaps in information are present in their study is irrelevant to the more pressing issue of the reliability of their findings. As a consequence of these gaps, their study overstates the actual JD “earnings premium” over these 20 years. Had the very same study been done, but with full earnings data from 1992 through 2011 on all people with law degrees, law grad earnings would be lower. This is certain.

This conclusion completely undermines the validity of their figures. Why should anyone put stock in “earnings premium” numbers derived from a study limited to 16 years, when extending the study just 4 more years, to 20, would produce notably lower figures? Why should we take these numbers as reliable indicators when forthcoming SIPPs will begin to show the devastating economic results suffered by recent law grads (2009, 2010, 2011, 2012, 2013 and counting), none of which are reflected in S&M’s figures?

Genuine long term historical studies span multiple cycles, several generations, because only then can the distorting impact of contingencies—like starting near the end of a recession (1996) versus at the beginning (1992)—even out over multiple up-and-down cycles. This may require data over several centuries. Their study does not even cover one full recession in the legal market. In fact, their 16-year slice is unrepresentative of long-term trends because, while it leaves out significant negative effects from two recessions, it fully captures the positive effects of the boom years in the legal market of the mid 2000s. (A fortuitous slice indeed for a study that aims to prove the high value of a law degree.)

It is exceedingly rare to find reliably predictive “historic norms” in the social sciences because social life is too complex and circumstances are constantly changing. (That’s why economists are so often wrong in their predictions.) Industries rise, transform, and expire; trades and professions wax and wane; formerly dominant national economies fall into decline while others take over prominence. S&M’s bold assertion that their 16-year study establishes valid “historic norms” on law degree earnings would be scoffed at by social scientists who take the notion of “historic norms” seriously. That is more than enough time to confirm norms governing the mating behavior of fruit flies, but 16 years is laughably inadequate for predicting something as complex and subject to change as the lifetime earnings of future law grads.

S&M have produced a narrow, partial, time-bound study that has zero predictive relevance for anyone thinking about attending law school today. The most we can glean from it is that a bunch of law grads will probably end up doing well financially—but we knew that already. This criticism on its own is sufficient to debunk the entire validity of their study, but it suffers from additional flaws that merit mention.


THEIR EARNINGS PREMIUMS ARE ARTIFICIALLY INFLATED IN TWO WAYS THAT FAIL TO ACCOUNT FOR ABILITY

Picture two groups of recent college graduates with bachelor’s degrees. One group achieved above average GPA’s and standardized test scores, they attended better colleges, attached greater value to education, had higher expectations about future salaries, and came from wealthier families. The second group was average on all these characteristics.

Most people would assume that over time the first group on average would earn more money than the second group. And they would be right. In addition to the fact that people in the first group have greater ability and motivation, the offspring of people with more money tend to do better because they have more social and economic advantages to leverage (that’s American meritocracy in action).

As S&M confirm, law grads as a group are above average in all these characteristics. They also find (using National Education Longitudinal Survey data) that these characteristics, individually and collectively, are associated with higher earnings—entirely apart from the law degree itself. This is relevant to their study because, as they observe, “If ability sorting is positive, then some portion of the earnings premium associated with a law degree is due to differences in ability levels, and the causal effect of the law degree on earnings will be smaller than the observed differences in earnings.”

After running their analysis, S&M find that “a typical law degree holder would earn 10.3 percent more than a typical bachelor’s degree holder, even if the law degree holder had chosen to terminate his education with a bachelor’s degree. Column 2 suggests a slightly lower 8 percent, as it ignores differences in expectations.”

Thus, typical law grads can expect roughly 10% higher earnings than average bachelor’s degree holders, entirely apart from the JD, because as a group they are smarter, more motivated, and come from wealthier families, etc. According to their study design, S&M should therefore subtract this 10% because that amount cannot be counted as part of the “JD earnings premium.”

Surprisingly, without explanation, S&M do not subtract this amount. They downplay the size of earnings attributable to ability, saying, “we find evidence of modest ability sorting that explains only a small fraction of the observed law degree earnings premium.” [Comment: 10% of average bachelor’s earnings is a sizable chunk.] They add that if they stripped away their controls the difference falls to 5% (as if it is fine to strip away controls). Then S&M include the entire amount within the JD earnings premium, forgetting their earlier statement that earning attributable to ability should not be counted. This move, of course, gives the “earnings premium” an under-the-covers boost. (Elsewhere in the paper they speculate that SIPP understates earnings at the high end, so perhaps they ignore the “ability earnings”10% as a rough compensating trade off; if so, this would introduce yet another distortion, because the earnings we care about are at the low end, which they say are over-reported in SIPP.)

For what purports to be a rigorous empirical study, S&M’s treatment of this factor is ad hoc, and, most problematically, it slants the findings in favor of the thesis they set out to prove: that a law degree has positive value even at the low end. This move on their part was not a design flaw but a departure from their stated design. Empiricists who aspire to rigor don’t get to ignore inconvenient findings and make fudges in their favor.

Even if earnings attributable to ability are “small” (which does not appear to be the case), they cannot be included in the “JD earnings premium” not only because it is false to do so, but also because the values they come up with are used to identify the point at which law grads begin to reap a negative return from their law degree (i.e. when they would have been better off skipping law school altogether). So it matters.

There was a simple way for S&M to account for the 10% ability earnings: increase the average bachelor’s earnings figures by 10%; whereupon, the JD premium they calculate would be the difference between how much law grads earn and this higher figure. Obviously, had they done this, the JD premium would fall. That they failed to do this is not right.

S&M did something else related to ability that produced an even greater distortion. They claim the “JD earnings premium” is the amount law grads earn over what they would have earned had they only gotten a bachelor’s degree. In order to figure out this difference, we must know what they would have earned without the JD.

Recall that law grads as a group have above average GPA’s, test scores, and motivation, they have more family wealth and went to better colleges, etc. And keep in mind that many bachelor’s degree holders would not get into law school because they lack the requisite motivation and credentials—most SIPP interviewees obtained their law degree in the 1970’s, 1980’s, and 1990’s, when there were far fewer law schools and a large percentage of applicants were rejected (compared to the loose 80% admittance rate at bottom schools today).

Based upon these considerations, it is reasonable to surmise that the people in the “smarter-more-motivated-pool of potential law students” who choose to forgo law school would earn at least as much as the median earnings of a bachelor’s degree holder. After all, S&M found that their characteristics correlate with 10% earnings above average bachelor’s earnings (and average is higher than median).

When S&M selected the baseline to calculate the earnings premium, however, they did not use the median bachelor’s earnings, but instead they compared the earnings between law grads and bachelor’s holders at each quartile: law grad earnings at 25th percentile were compared to bachelor’s at 25th percentile; law grads at 50th percentile were compared to bachelor’s at 50th percentile; law grads at 75th percentile were compared to bachelor’s at 75th percentile.

But this raises a large objection: Why should we expect that bottom quartile law grads would earn at the bottom quartile of bachelor’s degree holders had they not gone to law school? S&M already told us that law grads in general have above average characteristics that correlate with earnings 10% above average bachelor’s holders!

If S&M had instead compared law grad earnings at all three quartiles to bachelor’s earnings at 50th percentile, the earnings premium of law grads at the 75th percentile would go up, the premium at the 50th percentile would remain unchanged, and the premium at the 25th percentile would plummet.

This conclusion casts huge doubt on S&M’s results and bears repeating. If S&M had assumed that potential law students who forgo law school would have earned what median bachelor’s holders earn—which seems the most logical assumption given the superiority of the law student pool—then the “earnings premium” for law grads at the 25th percentile falls significantly.

S&M might respond that just because the pool of law grads is superior on average doesn’t mean bottom law grads are more capable than median bachelor’s holders. Perhaps. But then they should compare the 25th percentile law grad earnings to bachelor’s earnings at, say, the 40th percentile.

S&M might then say that they only have quartile numbers, so comparisons against intermediate percentiles are not possible. Fine. Then run two comparisons (at 25th and at 50th of bachelor’s earnings), display the results, and let readers decide which is the more apt comparison. When faced with these two choices, most prospective law students (a smart bunch) would correctly surmise that it makes more sense to compare the 25th percentile of law students against bachelor’s holders at the median.

In light of the momentous implications of this choice for their findings, it is remarkable that S&M do not even discuss whether they have made the correct comparison. They simply assert that it is appropriate to examine “the 25th percentile of earners with a given level of education [bachelor’s] compared to the 25th percentile of earners with a higher level of education [law degree]. Such a distributional analysis would test claims that advanced degrees may not benefit less capable students as much as they benefit average or above average students.” What S&M apparently failed to appreciate (or decided to ignore) is that, given the higher-level talent pool of law grads, “less capable” law grads can still be as capable as median bachelor’s degree holders. This seems elementary.


A COMPROMISED STUDY

A striking feature of S&M’s study is their chest-pounding confidence. Social scientists usually are very cautious about making causal claims owing to the complexity of social factors and how they interact, unobserved influences, and limited data points. No false modesty for S&M. They claim they have proven a direct causal relation between a law degree and specified lifetime earning values. They claim they have established reliable “historic norms” for law degree earnings (based upon a “long term” study covering only 16 years). They warn prospective students who do not accept their findings—instead foolishly believing benighted critics of legal education—that they will foreo a lucrative career and risk future financial hardship. And their original title blared, “The Million Dollar Law Degree.”

S&M gush about their robust showing that law grads, including those on the low end, reap oodles of surplus value from a law degree:

These results suggest that even at the 25th percentile, the value of a law degree exceeds typical net-tuition costs by hundreds of thousands of dollars.” At the mean and 75th percentiles, the difference is close to one million dollars. We therefore reject the claim that law degrees are priced above their value. Indeed, the value compared to net-tuition prices suggests that legal education is a competitive market in which surplus redounds to the benefit of student-consumers. (41)
Not really. Their study is full of holes and they made a series of dubious choices that were mostly hidden. Rather than conduct an open-minded inquiry into the economic value of a law degree, it appears that S&B were hell bent on proving that a law degree pays off handsomely for nearly all law grads. This orientation compromised the soundness of their study.

The paragraph quoted above oozes exaggeration. According to S&M, the present lifetime value of the JD earnings premium for law grads at the 25th percentile is $350,000. Minus federal taxes (following their formula), this comes to $262,500. Subtracting three years of tuition (they calculate scholarship discounted average tuition at $30,000 x 3) leaves us with $172,500. For male law grads at the 25th percentile, the same calculation comes to $147,000. Needless to say, that’s not hundreds of thousands of dollars. Overstatement runs through their article.

And these numbers are further inflated by other questionable choices they made. Providing no support whatsoever, S&B assert that law students earn $24,000 while in law school (1st year $5,000; 2nd year $7,000; 3rd year $12,000)—this is an implausibly high figure at a time when many law students work in unpaid externships during the summer and wait tables on the side. (S&B reduce opportunity cost by $24,000.) They do not include living expenses in the cost of a law degree because, they reason, students must pay this even if do not attend law school (ignoring the higher cost urban areas many law schools are located in); we can let that pass, but that does not explain why they take no account of the interest on loans taken out to pay for living expenses (borrowing in the $50,000-plus range for living alone), which working people cover with current income. Making adjustments for these fudges would bring the net earnings premium down even more.

Still, one might think, a net lifetime premium of $125,000 is pretty good. Keep in mind, however, this is earned over 42 years. Three years of law school at this earnings premium gets you an additional $250 a month (over a bachelor’s degree), and hopefully a rewarding career. Nothing to sniff at, to be sure, but this is hardly a generous “surplus value” redounding to the benefit of law grads that S&M so proudly mention. (Tellingly, Figure 1 shows that lawyer earnings have remained flat in real terms since 1998, while law school tuition has risen far above the rate of inflation, so we have been absorbing an ever greater share of this surplus value over time.)

Now, this discussion is completely artificial because it takes S&M’s stated JD earnings premiums at face value, when I have already shown that the $350,000 figure is substantially overstated owing to three major flaws in their study: 1) they do not count the full effects of 2 significant bouts of reduced lawyer earnings in the past twenty years (4 years of legal recession from 1992-95, and the dismal fate of law grads from 2009-2011); 2) they should have subtracted the 10% increase in earnings correlated with higher ability, motivation, etc., from their “JD earnings premium;” and 3) when calculating the JD earnings premium at the 25th percentile, they should have used bachelor’s degree earnings at the 50th percentile as the baseline.

Fixing any one of these flaws would bring the $350,000 down by amounts that matter (moving the total after taxes and tuition ever closer to the negative line); fixing all of them would flip their results from reassuring to positively worrisome. And we must keep in mind that the issue at stake does not stop at the 25th percentile. Let’s say that—after fixing these flaws and netting costs and taxes—law grads at the 25th percentile still get a positive gain of $25,000. S&M don’t get to declare victory and walk away, saying they have proven critics of legal education wrong. What about 20th percentile law grad earnings? If those folks are in the negative, it is hardly a vindication of the economic value of a law degree to say that “only” 1 in 5 law grads would make a bad financial decision by going to law school.

Although S&M present their findings as empirically robust, applying sophisticated econometrics and the latest theories of labor economics, it is plain that these three flaws were choices they made, mostly beneath the surface, which had the effect of artificially inflating their reported JD earnings premiums. This study well illustrates why many people are properly skeptical of proclaimed statistical findings (“lies, damn lies, and statistics”).

If S&M want to fairly determine “The Economic Value of a Law Degree” (their new more sober title), they should correct all three flaws and let us see how the numbers turn out. (A legitimate empirical journal, I assume, would require them to address these questions.) Their results would still have zero predictive value (these findings are not historic norms), but at least they would be less distorted and the information might be interesting. Remember, it was S&M who ominously warned that the financial futures of thousands of potential law students are at stake. If S&M correct these flaws, there is no doubt that the JD premium they tout will come down substantially, and a sizable percentage at the bottom will show negative value.

In this post, I have exposed how S&M substantially overstated the value of a law degree at the bottom quartile. In a follow up post I will show how they significantly understate the risk law students face. To briefly preview the argument, I will make two quick points.

S&M cannot properly assert (as they do now), “See, historical norms prove lifetime results are great, even at the bottom, so go to law school now.” This ignores a critical consideration. Economists agree that people who enter job markets during a recession experience lower lifetime earnings as a result. Given that the legal job market is mired in a severe multiyear recession that shows no real signs of easing (and multiple informed observers of the legal profession believe this is the new normal), S&M must offer a risk adjusted assessment of the chances that someone who enters the job market three years from now (after starting law school this fall) will obtain the “historic earnings norms” they claim exist. Students who entered law school 3-6 years ago, graduating in the heart of the legal recession, have a reduced chance of obtaining the lifetime earnings values S&M identify. S&M say nothing about the necessity to adjust their earnings figures to account for this risk.

Second, a useful risk assessment must be done on a school-by-school basis. Law grads from Harvard, Chicago, Penn, etc., have a great chance at high lifetime earnings, while grads of Thomas Jefferson are likely to end up with poor lifetime earnings. That is how my book examines the risk of attending law school, while S&B say absolutely nothing about particular schools. For this reason, my analysis is far more useful than their broad reassurances that law grads at the 25th percentile can expect “hundreds of thousands of dollars” in net lifetime earnings.


Comments:

Brian, keep up the good work. As I have been reading S&M and your responses, the phrase "Follow the money" comes to mind. There is quite a bit of money at stake, not just of potential JD students. There is of course the public interest in the delivery of competent legal services for all in need thereof, not just those served by "Big Law." Noam Scheiber's The New Republic article "The Last Days of Big Law" does not address the impact on "Little Law" with respect to the the discussion on JDs. Many rely upon and need "Little Law." So the economic issues addressed by you and S&M are of vital public interest. The issue of income inequality is also involved, heavily.

By the way, some may object to your reference to "S&M" for obvious reasons but this should not detract from the substance of your critique. (In several places reference is made to "S&B" which you might wish to correct.)
 

This debate reminds me of stock analysts trying to make the bull and bear case for something like Apple. It's partly empirical, but it's also party psychological.
 

Two additional things I noticed from the powerpoint I wonder if you could comment on.

1) The top line lifetime premium seems to include additional earnings from additional hours worked (seemingly around 8500 hours over a career).

2) The analysis seems to be only made from the perspective of a student going to law school at 22 right out of college. Given that an older student bears the same or higher costs (including opportunity costs) but have fewer years to earn any premium, the total premium would be lower.
 

Substitute, in Gerard's comment, law schools for Apple, and then ask if the analysts, both bulls and bears, may have vested interests in their analyses. (Some interests may be more vested than others.) Are the law school students (the investors of time and money) being impressed by the empirical or the psychological part?
 

ABA rules prohibit law students from working the first year of law school. AND "The Million Dollar Law Degree" ignores the opportunity cost, those same more capable students who chose to attend law school, could have pursued a post-graduate degree in a different field rather than stopping with a bachelors. Further eroding the validity of their study.
 

I take it they don't compare to ROI on other ways to invest three years and a hundred thousand or two.
 

Brian,

I appreciate your analysis and look forward to your future posts, but I think your first argument about time frame is unpersuasive. As you acknowledge, SIPPs was redesigned in 1996. Aggregating data pre- and post-1996 would have made any discerned earnings premium far less reliable.

More importantly, I think you make far too much of the exclusion of the period from 1992-1995. Entry-level employment was similar to 1995-98 (as indicated by table 2 on page 9). But this does not necessarily mean that the earnings premium was the same or lower. One cannot form conclusions about all JD holders based solely on entry-level employment numbers. As S&M's data suggests, the earnings premium tends to be larger during recessions and their immediate aftermath and the U.S. economy only began an economic recovery in late 1992.

Lastly, even if you are right about the earnings premium from 1992-1995, what about 1987-91 when the legal economy appeared to be quite strong (as illustrated by the same chart referenced above)? Your suggestion to look at a twenty year period excludes this time frame even though it might offset the diminution in the earnings premium that would allegedly occur if S&M considered 1992-95.
 

I'm glad the SM article is getting careful comment, but the 1992 vs. 1996 criticism isn't a big criticism. A study always has to choose a sample period. Choosing just the most recent years isn't always the best idea, nor is choosing the longest span of years. What is needed is a representative span of years. Thus, the famous economics Harberger Triangle paper of 1954 used 1928 data, not more recent data, because it wanted to look at a normal year in the economy, and 1929-1953 was full of depressions, wars, a post-war boom, and price controls.

Thus, you can't say, "If we pick years X, we get different results."If you can pick your own span of years, that's not surprising. You have to argue that their years are less representative than your years.

For a very simple example of my trying to deal fairly with this, see the memo on longterm stock market returns I wrote for a school board I'm on that is wondering how to invest its capital funds: http://rasmusen.dreamhosters.com/b/stock-market-returns-and-risk-returns-from-various-years-until-2013/
 

Thanks, Shag. I fixed the mistakes. I put the post up late last night.

Gerard is right of course that we are seeing things through very different lenses, but still there are bottom line questions about risk that can be answered.

Milan and Eric,

I agree with both of you. Of course you must start somewhere and wherever you start will affect the results. The issue is whether the numbers they provide us are a reliable guide to prospective students thinking about law school today. I say no.

I was trying to make two basic points:

1) This 16 years is not a representative slice because it measures the full effect of the boom years in big law, while only partially measuring the results of the down years that surrounded these years.

It doesn't really matter why they could not measure the full effect--what matters is only that the numbers they report are higher then they would be if the full effect of these bad years were captured. Hence the real earnings picture was not as high as what they reported.

At the very least they should have made a convincing argument that this 16 slice is representative before calling it "historical norms," but they did not address this issue at all.

I don't believe a plausible case for this can be made in such a short span of time because you need to see a number of cycles before you can establish what "representative" is.

Indeed, I believe (implicit in Eric's comments) that we can only determine this with hindsight. 16 years might be enough, if one looked at a hundred years to pick out 16 years that seem representative one what occurred over those hundred.

2) I'm highly skeptical that the very notion of "historic norm"--as a reliable indication of what people who enter law school today are likely to obtain as lifetime earnings--has any application at a dynamic time of change in the legal market like the present.

Their study reflects earnings during the best years of big law in the past generation (without the full effect of the down years), which report after report tells us will not coming back. Read today's New Republic article, "The Last Days of Big Law."

Historic norms, assuming they are reliably established, might have some value if a long term stable period lies ahead that looks like the period the norms were derived from. But they are useless at a time of transition simply because they reflect the past, not the future. The future of the legal market is fuzzy, but there is general agreement that it is not likely to look like the past. That's the fundamental problem with their claim about the value of their study.



 

Brian,I have been one of your supporters.

However, your points here are wrongs. I read carefully the slides published by Simkovic and your claim about the 10% premium doesn't hold. The authors have studied 3 groups: JDs (a), bachelor degree holders who look like JDs based on different variables (b), and the broader bachelor degree holder population (c). The authors have compared group (a) to group (b) in estimating the premium. You are saying that they have compared (a) to (c). So your conclusions are pointless, because that's not what the study did.

Also I think that your choice of referring to the authors as "S&M" sounds offensive and it will ultimately reflect poorly on you.

I understand that your points about the problem with law school are touching the heart of many students who are having a rough time. However it's important that you don't mislead people on this important issue.
 

Thanks for your comments, Carlos. You are right that they discussed two different bachelor's groups, but I believe their NELS ability premium compared the same backgrounds.

As for S&M, I honestly did not think about it. Perhaps I should have. But it seems to me that no serious person reading this would think anything but their names. Spelling it out would have been tedious. M&S feels forced to me because S&M is the order of their names on the article--and it is standard to follow this order.


 

Brian, thanks for your analysis. I add one personal factor. Mr. Pasquale doesn't allow comments on his posts. That doesn't give me confidence that he's willing to face criticism.
 

Eric Rasumusen: "Thus, the famous economics Harberger Triangle paper of 1954 used 1928 data, not more recent data, because it wanted to look at a normal year in the economy, and 1929-1953 was full of depressions, wars, a post-war boom, and price controls. "

Two things - first, the period of 1992 would still be 'normal'; there wasn't an excuse to exclude it. Second, Brian's point is that this analysis has some major sensitivity issues. Given that the question is whether or not to invest several years of one's life and $100K-$250K, the risk is severe.

As has been pointed out, we're seeing four years now of cohorts where 40% have seen their careers stunted right at the start; IIRC, it's a pretty solid conclusion of labor economics that these effects are permanent.
 

Lots of bloggers do not allow comments. It is neither good nor bad. I suppose you could email him.
 

Many of Frank's posts at this Blog are cross-posted at Concurring Opinions where comments can be made to Frank's posts. But not all of Frank's posts at this Blog are so cross-posted. So perhaps it is convenient for Frank not to cross-post to avoid comments here to his critiques of Brian's posts. Frank's posts are available to the internet public. Perhaps for consistency Frank should - if he is permitted - provide for comments here at this Blog when he does not cross-post. The suggestion of E-mail fails to address this inconsistency. It might be more consistent - and fair - if Frank consistently did nor permit comments at this Blog and at Concurring Opinions.
 

Small typo in the sentence reading: Rather than conduct an open-minded inquiry into the economic value of a law degree, it appears that S&B were hell bent on proving that a law degree pays off handsomely for nearly all law grads.

I think you mean S&M
 

Very well comprehensive content you have putted on your blog Brian, all of these terms were really necessary for us to know to learned those systematic form of study that overslates the good value of it.

essay services in australia list.
 


My name is Clara O'brian, I want to use this possible means to give all the praise and thanks to one person, in whom my loyalty lies He is the ONLY one man i trust so much and has done great things for me, LORD WAKAMAN has done great things for me and other people too numerous to mention even in my family, All the chains of Poverty has been broken and my Husband is back to me for settlement just as Lord Wakaman said to me. His words are real and they come to pass. He fore sees this, And tell you things to happen Next in your life. My friends out there, Search no more, You the remedy to you problem is right before you as you contact Lord Wakama to solve your problems. Search no further for spammers who act as real spell casters, the REALEST AND MOST TRUE SPELL CASTER is LORD WAKAMAN THE WORLD GREATEST. he is so true to his words and his words are substantial. contact him now on greatestlordwakaman@gmail.com he is more than willing to assist anyone who needs his help. greatestlordwakaman@gmail.com. I AM GRATEFUL LORD WAKAMAN.
 


My name is Clara O'brian, I want to use this possible means to give all the praise and thanks to one person, in whom my loyalty lies He is the ONLY one man i trust so much and has done great things for me, LORD WAKAMAN has done great things for me and other people too numerous to mention even in my family, All the chains of Poverty has been broken and my Husband is back to me for settlement just as Lord Wakaman said to me. His words are real and they come to pass. He fore sees this, And tell you things to happen Next in your life. My friends out there, Search no more, You the remedy to you problem is right before you as you contact Lord Wakama to solve your problems. Search no further for spammers who act as real spell casters, the REALEST AND MOST TRUE SPELL CASTER is LORD WAKAMAN THE WORLD GREATEST. he is so true to his words and his words are substantial. contact him now on greatestlordwakaman@gmail.com he is more than willing to assist anyone who needs his help. greatestlordwakaman@gmail.com. I AM GRATEFUL LORD WAKAMAN.
 

Hi, you explained the topic very well. The contents has provided meaningful information thanks for sharing info
online masters degrees
 

This comment has been removed by the author.
 

, I want to use this possible means to give all the praise and thanks to one person, in whom my loyalty lies He is the ONLY one man i trust so much and has done great things for me, LORD WAKAMAN has done great things for me and other people too numerous to mention even in my family, All the chains of Poverty has been broken and my Husband is back to me for settlement just as Lord Wakaman said to me. buy fifa 14 coins  lol elo boost  fifa coins online  league of legends boost


 

There are so many aspects to this, and you have opened up another train of thought for me to examine. Thank you for your insight.
http://resepkulinerkreatif.weebly.com/
http://resepmaku.weebly.com/
http://Sukaku71.blog.com
http://bibiku.blogs.fi/
 

Attention Please,

This is to announce to the General public about a genuine lender online that helped me when i was in financial difficulties. I am Mrs Giselle Dawn living in Virginia, Manassas, USA. I was stuck in a financial situation and i needed to refinance my business and also to buy a home. I tried seeking loans from various loan firms both private and corporate but never with success, and most banks declined my credit. But as God would have it, i was introduced to a private loan lender by names Mr. Crist Luis who gave me a loan of $500,000USD and today my business has improved and I'm now a owner of a home. So, I'm here to let you know that if you must contact any firm with reference in getting a loan with low interest rate of 2% and better repayment plans and schedule, please contact Mr.Crist Luis. He doesn't know that I'm doing this but i will like others to know that there are still some good persons out there who is still willing to assist those in financial difficulties so i decided to let people know more about him. You can contact him through his email at {cristluisloanservices@outlook.com} to get a genuine loan offer today.
 

Great blog! I really love how it is easy on my eyes and the information are well written. I am wondering how I might be notified whenever a new post has been made. I have subscribed to your rss feed which really should do the trick! Have a nice day! Modern Home Interior
 

Good day to everybody My name are Lynn Janet, I want to thank this great loan company who helped me to get a loan. For the past three months, I have been searching for a loan to settle my debts and also to start a business, everyone i met scammed and took my money until i finally met Mr Gabriel Owen. He was able to give me a loan of $330,000 dollars. He can also help you with any amount of loan you wish to get. He has also helped some other colleagues of mine. If you need any financial help, kindly contact his company through email: (gabowenfinance@yahoo.com) i believe they can help you. Contact him to get help just as he helped me. He does not know that i am doing this by spreading his goodwill towards me but i feel i should share this with you all to free yourself from spammers, please beware of impersonators and contact the right loan company to get any kind of loan of your choice.
 

Hello,

I am Mr. Doro Smith loans Service Lender, we are a legit, registered and guaranteed loan company and we give out loans to individuals, companies, government establishments, churches and business organizations and people of all sorts. Are you in need of a loan for any purpose? Are you in a financial problem? Do you need financial solution? Doro Smith loans Service is the solution to all your financial problems, our loans are easy, cheap, and quick. Contact us today for that loan that you desire, we can arrange any loan to suit your budget at only 3% interest rate. If interested, contact us immediately via email,(dorosmithloanfirm@outlook.com)
 




I want to give a special thanks to the prophet that helped me got my partner back. my name is Danielle steven, early this year, i and my wife started having some issues and she left me and the kids even when i loved her so much. I was frustrated to the extent that i started looking for links on the internet on how to get her back. One day i came across a testimony in which a lady was testifying of how this prophet helped her got her man back i was able to contact this DR VOVOLA and helped me put everything in order and my wife came back to me just as i wanted. this prophet is great if you know you have any problem here is his email address vovolaspellcast@yahoo.com if you are out there passing through any of this problems listed below:

1) If you want your ex back.
(2) if you always have bad dreams.
(3) You want to be promoted in your office.
(4) You want women/men to run after you.
(5) If you want a child.
(6) You want to be rich.
(7) You want to tie your husband/wife to be yours forever.
(8) If you need financial assistance.

you can contact him via: website: http://vovolaspellcast-com.webs.com/

 



Very awesome post , i am really impressed with it a lot
When I first visited your blog, I liked the concept of your blog posts. It is very well portrayed as well as depicted


Arts de la table
recette tiramisu
gateau aux pommes
creme patissiere
creme anglaise
recette chantilly
recette gaufre
recette galette des rois
mélatonine
pate a crepe
recette crepe
 

Its a great pleasure reading your post.Its full of information I am looking for and I love to post a comment that "The content of your post is awesome" Great work Agen Sbobet Terpercaya
 

Thanks For share this post awesome information you share.Help for college assignment
 

I’m impressed by the details that you have on this post. law Essay
 

As a rule, the kind of London space transformation you can actualize relies on upon your home sort and regulations actualized by your neighborhood arranging administrative bodies. Our preeminent associations with London wards and boards truly do go to the fore in this admiration, sparing you time and cash.
loft conversion plans
 

I have been trying to get a loan for some time now but i was unable to get a loan due to my credit score All other corporation/bank turned me down due to my credit score. Till i was introduced by a family friend to Nathan Dylan Services (NDS) and i was able to get a loan from them without any delay. So i am using this opportunity to inform everyone out there both individuals/company etc to contact this trust worthy firm were i was able to get my loan from to solve any financial issue you might be passing through now. If interested feel free to contact Mr. Dylan now via email (nathdylan@outlook.com) to obtain any amount of loan you need today and i assure you that they will fulfill your request and make your dreams come through and Please note, they give out loans to all parts of the world at low interest rate. Contact them now to get any type of loan you need now.

Thank you.
Mrs. Jucy Holmes.
 

I HAVE READ IT. LAW ASSIGNMENTS
 

Hello Everybody,
My name is Mrs Anita. I live in UK London and i am a happy woman today? and i told my self that any lender that rescue my family from our poor situation, i will refer any person that is looking for loan to him, he gave me happiness to me and my family, i was in need of a loan of $250,000.00 to start my life all over as i am a single mother with 3 kids I met this honest and GOD fearing man loan lender that help me with a loan of $250,000.00 U.S. Dollar, he is a GOD fearing man, if you are in need of loan and you will pay back the loan please contact him tell him that is Mrs Anita, that refer you to him. contact Mr.Robert,via email:(robertfinancial_loancompany@yahoo.com)Thank you
 

Hello everyone am here to testify how i got my loan from Mr Akisu. after i applied several times from various loan lenders who claimed to also testify right in this forum,i thought the testimonies where real and i applied but they never gave me loan. I was in need of an urgent loan to start a business and i applied from various loan lenders who promised to help but they never gave me the loan.Until a friend of mine introduce me to Mr Akisu. who promised to help me and indeed he did as he promised without any form of delay.I never thought there are still reliable loan lenders until i met Mr.Akisu,who are indeed helped with the loan and changed my belief.I don't know if you are in any way in need of a genuine and urgent loan,free feel to contact Mr.Akisu via his email{Akisuloancompany@gmail.com} Thank you may God bless you
 

Very well comprehensive content you've putted on the blog Brian, all of these conditions have been really necessary for you to learn to be able to figured out those step-by-step form of analyze which overslates the good value of the usb ports.
Essay Writing Help
 

I enjoy reading through a post that will make men and women think. Also, thank you for allowing for me to comment!
Agen IBCBET Terpercaya
 

Debra Orr by names from United States, Am here to guide everyone out there looking for a loan such as Business loans, Mortgage loans Real estate loan, Personal loan and all other kinds of loan to contact this awesome loan firm owned by Mr Viggo Davis who supported me and my family with a business loan and also with a mortgage loan worth $740,000 which put our lives back on track again. Thanks to Mr Viggo Davis because i never believed that such genuine lender still exist for till i found Mr Davis. Am very grateful for what he has done for us that's why am doing all this to make others benefit from his wonderful service he renders to both individuals/company. So am using this moment to inform anyone above 18yrs to contact Mr. Viggo Davis via email (viggodavis@zoho.com) or (viggodavis@gmail.com) to get his/her loan today with better repayment schedule, no social security number required and no credit check required, 100% Guaranteed.
 

I am preparing
Assignment Help
and gathering information on this topic. Your post is one of the better that I have read.
 

DO YOU NEED AN URGENT XMAS LOAN, A LOAN TO START UP A NEW LINE OF BUSINESS CONTACT US NOW VIA EMAIL: fredcollinsloanoffer@gmail.com


Dear Applicant,
i am Mr. Fred Collins a private loan lender, who gives out loan in a very low interest rate of 2%. we give out all kind of loan like Educational loan, Business loan, home loan, Agricultural loan, Personal loan, auto loan and other good Reason, I give out loans from the range of $5,000USD- $90,000,000.00USD in both Dollars Euro and Pounds at a 2% interest rate. Duration of 1- 15 years depending on the amount you need as loan. contact us via email: fredcollinsloanoffer@gmail.com
NOTE:we give out loan in any country
 

Dependable betting is the nearly all effective selection that will the person can think about online. Providing you will quickly realize businesses that will got your money so in purchase in order to be able to believe in your hard earned dollars pick the particular right one and luxuriate in wagering.
European Soccer
 

Yes agreed with type of comment and thank you for sharing nice content. all the comments are good. Here we discussion is about ""How "The Million Dollar Law Degree" Study Systematically Overstates Value: Three Choices that Skewed the Results"", So If some body want to buy assignment help in australia. please visit assignmentprime
 

This blog was... how do you say it? Relevant!! Finally I've found something which helped me. Thanks!
cybola.loveslife.biz
 

There are so many aspects to this, and you have opened up another train of thought for me to examine. Thank you for your insight.


https://lukmanfi.wordpress.com/
 

Dependable betting is the nearly all effective selection that will the person can think about online.


aluminium wow

Providing you will quickly realize businesses that will got your money so in purchase in order to be able to believe in your hard earned dollars pick the particular right one and luxuriate in wagering
 

Experience the online betting and try your luck and win. Look for trusted betting sites to secure your money.
Agen Sbobet
 

Hi sir, thank you for sharing.. This article is very helpful for me.
lauragecko
 

Excellent article!! please notify me when you post something new here!
feel free to visit my webpage : Cara Login Maxbet
 

There are such a large number of angles to this, and you have opened up another line of reasoning for me to look at. Much obliged to you for your knowledge. Instant Essay Writing
 

Great post, I love the whole concepts, each steps explained clearly. In the same manner we are providing best assignment help and writing service in Australia. All Assignment writing experts providing top rated and cheap assignment services.
 

lovely post and wonderful photos.the james proessaywriting.com essay writing service
harriot home looks very cosy.your baking and knitting are soooooooooooo beautiful. and your choco-cherry cake on instagram look delicious. http://www.proessaywriting.com/

 

Angkasa Bali Office Supplies, Furniture And Interior in Bali Indonesia. As Table Office , Office Chair , Office Partition , Safe , Filling Cabinet , Locker , iron Shelves , Filing Cabinets , Sofa , credensa , lounge chair , desk computer , Electronic, and ect . Contac marketing Office Phone : 0361 8947611.Email : akb_oe@yahoo.co.id / akb_oe1@yahoo.co.id . Web : http://www.angkasakantor.com/
Angkasa Bali Distributor alat furniture kantor meja kursi kantor di Bali
Distributor Peralatan Furniture Kantor Jual Meja Kursi Kantor Bali
Jual Peralatan Kantor Furniture Meja Kursi Kantor Bali
Angkasa Bali Distributor alat Kantor Furniture
Angkasa Bali jual alat Kantor Furniture Meja Kantor Bali
Angkasa Bali jual furniture Kantor
Angkasa Bali jual furniture dan alat Kantor

 

What a nice post I like your post . I read your post and received a clear idea . I say your blog is very nice . I have a similar blog like to your blog . To get more information
follow us
 

Post a Comment

Older Posts
Newer Posts
Home