Google AI overviews are misleading or inaccurate in 43% of finance-related searches, according to our study. This is causing consumer confusion, and potentially harming Americans’ finances. It’s especially bad when it comes to tax and financial aid related queries.
We have seen numerous instances across our Facebook Pages and sub-Reddits of users posting misinformation, and when asked about it, they all say they saw it in Search. We’re used to bad information coming from social media sources (looking at you TikTok), but Search was historically a way for users to find the correct information. Until now…
Here’s a recent thread from our Facebook Group where a user believed that she could convert her 529 plan to a Roth IRA in California:
What’s Happening:Â Over the last year Google as rolled out AI-driven answers to search results – called AI Overviews. These results are featured prominently at the top of the search results page. They’ve also been under fire previously for providing dangerous and wrong answers.
Here’s what they look like:
It’s important for searchers to realize that Google is simply analyzing the existing web results and trying to “guess” an answer based on what it knows and what it finds. It links to some of the resources it finds on the right side.
However, at the end of the day this information is not vetted by a professional or anyone with knowledge of personal finance. It may not be accurate. Even Google alludes to it with their disclaimer (which was recently added to some finance-related queries):
Key Issues With Google AI-Overviews And Personal Finance
We tested 100 personal finance-related queries across multiple areas of personal finance, including banking, credit, investing, insurance, student loans, and financial aid. You can jump to every query we tested below.
Out of 100 searches, we found that Google AI Overviews were correct in 57 instances, and provided misleading or inaccurate information in 43 instances.
We labeled the incorrect answers three ways:
- Misleading: The AI answer provided could be interpreted in a way that causes financial harm.
- Missing Key Information: The AI answer was semi-correct, but also missed key information that could cause financial harm (such a key exceptions).
- Incorrect: The AI answer was simply incorrect, typically using outdated or incorrect values or information, which could lead to financial harm.
We found the the AI-Overviews were completely incorrect in 12 instances. This included issues such as providing outdated information on products and services and outdated information on student loan repayment plans.
The remaining 31 errors were either misleading results or the results were missing key information.
When Google Gets It Right
Generally, the AI Overviews were correct for basic 101-level questions, such as “what is” or “how to”. They had the most correct answers when covering basic personal finance topics, including banking and insurance.
When Google Gets It Wrong
AI Overviews struggled the most with anything that has nuance – which is most of personal finance.That’s harsh, but most of the incorrect answers involved navigating more complex tax topics, investing topics, and student loan topics.
What Surprised Us The Most
We were surprised to see that AI Overviews had a grasp of recent trending topics, such as the “Chase Glitch”.
But at the same time, it was surprising that the overviews had outdated information for student loan repayment plans, and things like savings and CD rates.
It also appeared that Google placed some type of manual block on some AI overviews related to the ongoing SAVE student loan repayment plan litigation and Biden’s loan forgiveness plan. We believe this because the AI box appeared, but messaging said “not available for this search”. You can see the example here.
What Google Is Saying
We reached out to Google for comment before publication of this article, and the have not yet responded. We will update this with a response if they provide one.
However, a Google spokesperson previously told Business Insider when asked about the earlier issues with misinformation that the “vast majority of AI Overviews provide high-quality information.”
We don’t disagree – the majority of answers in our test were correct. However, when it comes to personal finance, a 40% error rate is not good.
Our Take
Historically, Google Search has served a key role in helping people navigate their personal finances – especially in light of bad information floating around on social media.
For us, it’s always been important to provide the right information to readers. That’s why we’re frustrated. I would really hate to see someone pay taxes and a penalty because Google AI said they could convert their 529 plan to a Roth IRA (but they live in California, so they can’t).Â
Or see someone cancel their car insurance because Google doesn’t mentioned it’s required to drive a vehicle – and then they get in an accident or even worse, hurt someone else as an uninsured motorist.
If Google continues to present bad or misinformation about money topics to searchers, not only could it hurt their personal finances, but it could weaken already poor financial literacy in the United States.
We strongly believe that Google should turn off these AI Overviews on finance related topics, especially tax and investment related queries where the outcome can be especially costly for users. Its likely someone at Google will go in and fix the searches we pointed out – but the problem keeps happening. And it keeps getting called out. Eventually someone high up internally needs to say “hey, this is wrong and bad for users.” We hope that happens soon.
AI Overviews
All AI overviews were categorized as follows:
- âś…Â Correct – The AI answer provided would be correct and helpful, and would not cause financial harm.
- 🔶 Misleading – The AI answer provided could be interpreted in a way that causes financial harm.
- 🔶 Missing Key Information – The AI answer was correct, but also missed key information that could cause financial harm (such a key exceptions).
- ❌ Incorrect – The AI answer was simply incorrect, typically using outdated or incorrect values or information, which could lead to financial harm.
General Personal Finance
These are topics related to general personal finance, such as banking, budgeting, and credit. It was interesting to see timely topics generate AI overviews, such as the Chase Glitch.
Verdict: Correct
As a side note, notice the image that was used from The Balance without credit or links to their website in the AI overview.
Â
Verdict:Â Missing Key Information.
We believe that not enough information was provided about interest rates and interest charges that could impact the consumer.
Verdict:Â Incorrect
Of course, our opinion is never Wells Fargo. But regardless, there are lots of free checking account options and this list is misleading at best.
Â
Verdict:Â Missing Key Information
Since Google AI Overviews pull from sources, these results are missing the actual best rates and accounts. This is a perpetual problem in the savings space, since the big names dominate their lists with paid placements. This isn’t a terrible AI Overview, but definitely missing some of the best savings accounts.
Â
Verdict:Â Incorrect
This list is very outdated. There have not been 12-month CD rates over 5% for some time since the Fed has been cutting rates.
Â
Verdict:Â Missing Key Information
This is a very odd list of places to include, and doesn’t really provide any information about why you should apply at any of these.
Â
Taxes
These are topics related to taxes. These topics are concerning to us the most because they have large financial implications for incorrect or misleading answers.
Verdict: Misleading
This AI overview is misleading because it only mentions the lower limits. Roth IRA income limits phase out starting at $146,000 but actually cap at $161,000 for single filers. Married filers cap out at $240,000.
As a side note, the AI overview does get this correct in the Mega Backdoor Overview.
Â
Verdict:Â Missing Key Information
This query is missing the key 529 plan annual gift tax exclusion limit. It has a lot of other limits, but missed the most obvious limit that families rely on annually.
Â
Verdict:Â Misleading
This AI overview of qualifying 529 plan expenses includes student loan repayment, which is not an eligible expense in all states.
Â
Verdict:Â Misleading
The answer to whether you can use a 529 plan for elementary school is “maybe”, depending on your state. The AI Overview leads with “Yes”, which is misleading, however, it does mention that some states may not consider it qualifying in the third bullet point.
Â
Verdict:Â Incorrect
This answer completely ignores that one-third of states (including large states like California and New York) do not allow this. Unlike the elemtary school query, this answer does not include the exceptions in the bullet points. The bottom line is there are very specific 529 plan to Roth IRA rollover rules.
If California residents were to do this, they would faces taxes and penalties.
Â
Verdict:Â Correct
However, the second bullet point doesn’t really appy.
Â
Verdict:Â Missing Key Information
The maximium amount you can contribute to a solo 401k is $69,000 technically, the the real amount is very nuanced. The second bullet point alludes to it, but this answer is missing a lot of key information.
Â
Verdict:Â Incorrect
This has been a common TikTok trend, but the reality is the there’s no good reason to own your own house in an LLC, and since it is pass-through, it would not help with taxes. Rather, it would add cost and complication to your life.
Â
Verdict:Â Incorrect
While the sentence is correct that you don’t get a Federal tax deduction, 34 states currently offer a tax deduction or tax credit to a 529 plan. This is mentioned in bullet point three, but since the actual sentence is “No”, we view this as incorrect.
Â
Verdict:Â Misleading
An S Corp is simply a tax election for an LLC.
Also, notice that the common “For Financial Advice, Consult A Professional” is not present.
Â
Verdict:Â Incorrect
Since an LLC is a pass-through entity, it has no impact on your taxes. Bullet Point #2 is incorrect, and Bullet Point #5 is incorrect.
Â
Verdict:Â Incorrect
The answer is almost always no.
Â
Investing
These are topics related to investing and investment vehicles.
Verdict: Missing Key Information
The three step process for a backdoor Roth IRA, while correct, misses many parts of the process and doesn’t highlight any pitfalls that get a lot of investors in trouble. Messing up the backdoor Roth IRA can lead to taxes and penalties.
Also, note the infographic from The White Coat Investor, which is not linked in the AI Overview.
Verdict: Missing Key Information
This information about the Mega Backdoor Roth IRA is also semi-correct, but misses a lot of key information and pitfalls. As a side note, it does get the IRA contribution limits correct.
Â
Verdict:Â Missing Key Information
This information is correct, but it misses key nuances, such as the fact the wash sale rule doesn’t apply to cryptocurrency, nor retirement accounts.
Â
Verdict:Â Misleading
You do not have to have earned income to open a Roth IRA, but you do to make the contribution during that year.
Verdict:Â Misleading
While most of this information is accurate, the last bullet point implies that someone needs to have earned income to open a 529 plan. That’s incorrect.
Â
Verdict:Â Missing Key Information
There are a lot of nuances here that are just missing from this AI overview, and the taxes implications can be harsh.
Â
Verdict:Â Misleading
Some of this information is not correct – like you typically cannot open an IRA at a life insurance company (unless they do more than insurance). Also, you likely don’t want to open an IRA at a bank.
Â
Verdict:Â Correct
Not a bad list, but honestly missing some of the best brokerage firms. There are also no links for the AI Overview, so it’s unknown where Google is pulling this data from.
Â
Verdict:Â Missing Key Information
This is not a bad list, but it doesnt’ tell you why you should open an account at any of these places. There’s no fee listing, no account minimums, where does a consumer even start?
Â
Student Loans
These are topics related to student loans. It was interesting to see a mix of both outdated information, and good answers to current queries (such as about the pending SAVE litigation).
There also appears to be “blocks” on specific queries that try to generate an AI Overview, but then stop. This is different than simply not showing an AI Overview. Queries related to the SAVE repayment plan and Biden’s plans all deliver this error message:
Verdict: Misleading
There is no need to apply for federal loans since they are awarded via your financial aid award from filling out the FAFSA. How much in federal loans you’re eligible for depends on your student status (dependent or independent), along with what year of college you’re in.
Verdict:Â Missing Key Information
Yes, you can be fired for student loans under numerous situations, but simply having them is not a reason. This AI overview does mention one reason, but there are many more.
Â
Verdict:Â Incorrect
The REPAYE student loan repayment plan no longer exists, it was replaced by the SAVE plan (which is also currently paused). This is all incorrect.
Verdict:Â Correct
This is correct, but there is no context in this AI Overview about the pending litigation and problems processing repayment plans.
Â
Verdict:Â Misleading
There are various features here that need to be elaborated on. While the links are helpful, incorrect information in this program, specifically repayment plan options, have been a huge problem.
Â
Verdict:Â Incorrect
Yes, a 60 day processing forbearance does count towards PSLF.
Â
Verdict:Â Correct
We would like to see a little more clarification, but the answer is correct.
Â
Verdict:Â Misleading
You do not have to apply each year, you only need to certify all 120 payments (and you can do this one time if desired). However, it is recommended to submit your PSLF Form annually.
Â
Verdict:Â Missing Key Information
While you “can” consolidate your student loans at those times, you can also do it other times. And the query was “when”, which implies does it make sense to. Furthermore, the result doesn’t highlight details like PSLF credits, interest capitalization, and access to repayment plans.
Â
Insurance
These are topics related to insurance. We discuss life insurance and related products, but also homeowners and other types of insurance.
Verdict: Misleading
The key sentence at the beginning, while factually correct, makes it sound like it is not worth it.
Verdict:Â Misleading
While it touches on some of the negatives of an IUL, it present it as there is a 50/50 comparison, when the reality is that an IRA is better 99% of the time.
Â
Verdict:Â Incorrect
The correct answer is “as long as you drive a vehicle, no.” While there may be some options to not have car insurance, most drivers will need it.
Verdict:Â Correct
It’s interesting that, compared to other similar queries, they don’t promote a specific brand here.
Â
Home Ownership And Mortgage
Here are some topics related to home ownership and mortgages. We also included topics related to home buying.
Verdict:Â Misleading
It answers a little bit about why it’s misleading in the bullet points, but the answer is “it depends”.
Verdict:Â Missing Key Information
This can be a costly mistake to simply state “yes”. Furthermore, some states have non-refundable earnest money.
Â
Verdict:Â Missing Key Information
This is such a vague query that an AI overview probably should not populate. The amount will vary greatly across the United States and ignores deposits that may be required like due diligence money.
Â
Verdict:Â Missing Key Information
The rules have changed in the last 6 months and none of this is accurate any longer.
Â
Verdict:Â Correct
But notice the image that was used and not cited.
Â
Financial Aid And Paying For College
Here are some financial topics relating to paying for college, including about the FAFSA and other financial aid tools.
Verdict: Missing Key Information
The article is missing the nuance that the FAFSA may not open on time on December 1 because of the testing period currently happening.
Verdict: Incorrect
This article doubled up information from both a martial arts weapon and a financial aid tool. But even the definition of Student Aid Index is not complete.
Â
Verdict:Â Misleading
This information is inaccurate as it pulls from various sources that estimate what four years of specific colleges (not even the most expensive) would cost if they were full paid for out of pocket. It appears these results add in room and board and other costs.
The correct list of the most expensive colleges is here, based on tuition.
Â
Verdict:Â Incorrect
Based on the previous query, we wanted to get a more specific answer based on the colleges with the highest tuition. Again, the answer provided by the AI Overview was incorrect and simply provided a similar result. Here is the correct list of colleges with the highest tuition. Kenyon College should be the most expensive, and it’s not on the list.
The numbers provided in this AI Overview aren’t even accurate.
Verdict:Â Misleading
While the answer does break down the criteria for filing independent for FAFSA, we see this as one of the biggest mistakes that families make filing the FAFSA. The answer is “No” for most undergraduate students.
Â
Verdict:Â Missing Key Information
The last bullet point is the most important – a Roth IRA is NOT reported on the FAFSA, but income from it can count.
Â
Verdict:Â Misleading
The CSS Profile does count retirement accounts like the Roth IRA in their own separate area, and schools may use this information.
Â
These AI overviews were generated on October 15 and 16, 2024. We focused on major questions in each personal finance topic area, along with trends of questions we’ve seen being asked on social media.