We hope you enjoyed that fun TikTok. It's one of the many examples of organic learner-generated content that goes viral every day without any involvement from us. And we love to see the creativity and enthusiasm of creators like this, which continues to drive our brand awareness and word-of-mouth growth. And now let's get on with today's call.
Good afternoon, and welcome to Duolingo's Fourth Quarter and Full Year 2022 Earnings Webcast. [Operator Instructions]. Today, after market close, we released our year-end shareholder letter with our Q4 and 2022 results and commentary, which you can find on our IR website at investors.duolingo.com.
On today's call, we have Luis von Ahn, our Co-Founder and CEO; and Matt Skaruppa, our CFO. They will begin with some brief remarks before opening the call to questions. [Operator Instructions]. And please note, this event is being recorded.
Just a reminder that we'll make forward-looking statements regarding future events and financial performance, which are subject to material risks and uncertainties. Some of these risks have been set forth in our risk factors of our filings with the SEC.
These forward-looking statements are based on assumptions that we believe to be reasonable as of today, and we have no obligation to update these statements as a result of new information or future events. Additionally, we will present both GAAP and non-GAAP financial measures on today's call.
These non-GAAP measures are not intended to be considered in isolation from, or substitute for or superior to, our GAAP results. And we encourage you to consider all measures when analyzing our performance. And now I will turn it over to Luis..
the first is generative AI, which will power a higher-tier Duolingo Max subscription as well as help us reduce content creation costs; and the second is improving how we teach and monetize English learners. I'd like to emphasize that we are excited about these initiatives, but they are still in the early stages.
And I also want to touch on profitability. Coming off a strong 2022, we are well positioned to grow users and bookings rapidly while also delivering higher profitability. We plan to continue to compound the returns we've seen from our past R&D investments, so we don't plan to hire as many people as we did last year.
Just to remind you, we've never gone nuts with hiring. And in fact, we've grown revenue at about twice the rate of head count in the past 4 years. This year, we plan to show operating leverage across all costs, R&D, sales and marketing and G&A.
Given those strengths, we're guiding to a 10% to 12% adjusted EBITDA margin for the year, up from about 4% in 2022. And with that, I'll turn it over to Matt to talk more about our financial outlook..
Thanks, Luis. To quickly recap the highlights of our impressive Q4 and full year 2022 results. In the fourth quarter, we delivered 39% bookings growth year-over-year, which was about 46% on a constant currency basis. We saw a 42% revenue growth year-over-year, which was 47% on a constant currency basis.
We had a net loss of $13.9 million compared to a net loss of $17.5 million in the year ago quarter. We posted our highest quarterly adjusted EBITDA of $5 million, which was a 5% adjusted EBITDA margin, and we had a free cash flow margin of about 11%.
For the full year, we delivered 46% bookings growth year-over-year, which was about 52% on a constant currency basis. We saw 47% revenue growth, which was about 51% in constant currency. We had a net loss of $59.6 million compared to a net loss of $60.1 million last year.
We saw adjusted EBITDA positive $15.5 million compared to an adjusted EBITDA loss of $1 million last year, and we had a free cash flow margin of about 12.5%. In 2023, we expect to continue delivering strong bookings growth, and we will do so while making progress towards our long-term profitability goal of an adjusted EBITDA margin of 30% to 35%.
For the full year 2023, we are guiding to $530 million to $542 million in total bookings; $486 million to $498 million in revenue; and an adjusted EBITDA margin of 10% to 12%, which translates to about a 32% incremental margin at the midpoint.
And for Q1 2023, we are guiding to $127.5 million to $130.5 million in total bookings, $111 million to $114 million in revenue and an adjusted EBITDA margin of 9% to 10%. Our guidance assumes current prevailing foreign exchange rates.
As a reminder, roughly half of our revenue comes from outside the U.S., so every 1% increase or decrease in the value of the dollar versus our basket of currencies has about a $2 million headwind or tailwind, respectively, on full year total bookings.
At the prevailing exchange rates we've used in our guidance, foreign exchange is expected to be a 3-percentage-point headwind to Q1 2023 year-over-year bookings growth. In terms of quarterly cadence of our bookings for the remainder of the year, we expect our year-over-year growth for total bookings in Q2 to be about the same as Q1.
We expect Q3 year-over-year growth rate to be slightly higher, and we expect Q4 to be our biggest quarter in terms of dollar bookings. Given our outperformance in Q4 of this year, it will be a slightly lower growth rate.
After pricing in 2022, we lowered pricing -- prices in several countries to get our prices more in line with each country's GDP per capita. This initiative and our intentional mix shift from monthly to annual plans was to increase the overall LTV of our platform, and that drove down subscription revenue per paid sub.
But we're done, for the most part, with lowering prices globally. And in fact, based on strong conversion trends, we believe we have the opportunity to raise prices in some places and are experimenting with pricing as we speak.
We have not included any material amount of bookings or revenue from Duolingo Max in our guidance since we've only just started testing it, but we'll provide you with an update when we report our Q1 results. I'd like to emphasize that we are focused on managing the business so that we achieve our full year adjusted EBITDA margin of 10% to 12%.
We'll be making spending decisions throughout the year based on our revenue and gross margin trends to ensure that we are in this range for the full year. Also to remind you, given the seasonality of our revenue, our Q2 and Q3 margins will be slightly lower than Q1, and Q4 will be higher.
We will continue to run the business with discipline and prudently manage our expenses. Starting in Q1, we expect to see meaningful leverage in total non-GAAP OpEx compared to the fourth quarter of last year. And in 2023, we expect to achieve about 7 to 9 percentage points of operating leverage in total non-GAAP OpEx.
For both periods, the improvement is mostly in sales and marketing and G&A and, to a lesser extent, R&D. We ended the year with approximately 48 million fully diluted shares outstanding using the year-end closing price.
In 2023, we expect to end the year with about 2% dilution from equity issued to employees, which is less than the roughly 3% dilution we had in '22. And with that, I'll turn it back to Luis..
Thank you, Matt. Before we get into Q&A, I'd like to thank our very talented team of Duos, who continue to find new ways to innovate and delight our learners. And now we would be happy to take your questions. I'm going to turn it back to Debbie to manage the queue, and here we go..
Okay. Thanks, Luis. [Operator Instructions]. And the first question comes from Ralph Schackart of William Blair..
First question, the shareholder letter, I think you called it a "Super" end to 2022. I think that may incorporate some of the beginning of the year campaign that you run to attract new users.
Just curious, what drove the really strong performance in the year-end? And then how did your New Year's campaign compare to expectations? And I have a follow-up..
Thank you. That's a great question. So yes, we had a great Q4, great year-end. The main reason -- there's 2 main reasons. The first one is just our compounding product improvements. I mean we've just been getting better and better at making our products stickier and attracting more users. We have a very high-performing growth team that does that.
That's one thing. And then another one is some of our marketing campaigns, we just did really well. A good example of that was our year-end review campaign where towards -- around December 14 or so or December 10 to December 14, all the users got a summary of what they did throughout the whole year.
And they're expected -- well, they're encouraged to share it. We got a lot of shares, millions and millions of shares. And we hit top trending topics on Twitter, and stuff like that, by just having people share their Duolingo stats over several days. So stuff like that really helped us do the outperformance.
In terms of New Year's campaign, we started -- just for reference, we start a New Year's campaign on December 28 usually every year, and it goes all the way to January. So for this quarter, it's about 3 days-ish of campaign, and they performed better than we expected.
And the reason for that outperformance just has to do with the fact that every year, we take the learnings from the previous year of the campaign, and we just get a little better. So every year, we run a few A/B tests to try to make that campaign more effective, and we take those learnings for the next year. So that worked out pretty well for us..
Great. Maybe just a quick follow-up. Just in terms of DAUs, I think you reaccelerated for 6 consecutive quarters, which is pretty tough to do. But just maybe some color what's driving the strong acceleration and growth. I think in the prepared remarks, you talked about sort of broad-based.
But were there any sort of 1 or 2 regions that's stronger growth than others?.
Yes, it's a great question, too. So in terms of regions, it really is growing in every single region in the world. If you want to know stronger regions, the U.S. is particularly strong. Asia is particularly strong, and Western Europe is particularly strong in terms of growing DAUs. And in terms of why it is, I mean it's again the same 2 reasons.
It is continued product improvements that just compound over time. The product is just better and stickier, and then we just get better and better at figuring out what strikes a chord with marketing. So things like our social media campaigns like our TikTok campaigns and our Twitter campaigns and also some of the influencer work that we do.
And some of the stuff, we don't even do. For example, you just saw this video at the beginning of this call. These are entirely organic videos that other people make. It's almost every single day.
I don't know if it is a fact that every single day in the world, but almost every single day, there is an organic video that goes viral that mentions Duolingo. So all of that just keeps getting -- keeps growing our users..
Thanks, Ralph. And the next question comes from Justin Patterson of KeyBanc..
Great. Luis, recently, there was a really interesting post on the Duolingo blog about just using data science to optimize DAUs. I think current user retention rate was that the metric you've been optimized in the past few years.
Would love to hear more about just how you're using a lot of these top-down statistical models to really drive DAU growth, link the product team together. And then now that you've gone pretty far with the current metric, how you're thinking about tailoring that to individual cohorts.
So more of a bottoms-up approach to take advantage of things like, say, Gen Z, having much shorter attention spans and making sure they're still having healthy engagement..
I'm glad you read that blog post. We're very proud of our growth model. Over the years, we've just gotten significantly more sophisticated at analyzing our user base and making changes that improve certain cohorts.
In this post, we mentioned what has been -- I would say the single most important metric for this company over the last several years, which is called -- something we call CURR, or current user retention rate.
And what that is, it is the rate of people that if they were here today and they were here over the last one other time, at least over the last 7 days, what is the probability they're going to come back tomorrow, that's current user retention rate. That number is around 80% right now, and we've increased it.
Over the last 2, 3 years, we've increased that number from about 65% to about 80%, and every 1% increase of CURR increased our DAUs by a lot. And so that model has been -- really helped us, and we keep getting more and more sophisticated.
You are right, we're starting to -- this was a model -- at first, when you're just -- before this growth model, we would just treat all our users in one cohort. Then we started getting more sophisticated, and we treat kind of new users, current users, et cetera. Now we're getting even more sophisticated than that.
I don't think we have a specific thing for Gen Z that we do. But we are -- relatedly, we are making our sessions shorter and shorter because, like you said, they have a shorter and shorter attention span..
Great. The next question comes from Andrew Boone of JMP..
Great. Can we start off with just any learnings from in-app purchases? I saw that it doubled this last quarter. Can you talk about what successes are there? And then how we should think about that for 2023? And then secondly, on profitability, Matt talked about real contribution margin kind of [indiscernible] in the back half of this year.
Is there any reason to think that, that steps down as we think about kind of a 3-year plan or something beyond this upcoming year?.
I can take the IAP question, Matt, and then you can take the next one. So for in-app purchases, yes, we have a very high-performing team behind this that is just making in-app purchases more and more prominent, more and more successful in the app. As you saw, they've been growing very rapidly. We expect them to continue growing rapidly this year.
And in terms of learnings, the main way we do in-app purchases, by the way, is by selling gems. So there's this in-app currency called gems that you can either earn by doing stuff on the app or you can also buy them. And then you can use gems to buy other stuff, kind of power-ups in the app.
One of the main power-ups that we use in the app is the timer boosts that help for certain timed lessons. So we have these -- most lessons on Duolingo are not timed, but there are some lessons that you can do -- some practice lessons that are timed.
And the idea is that if you're not very fast, you run out of time or you can buy these timer boosts with gems. And those timer boosts get a lot of people to spend on in-app purchases. This is the type of stuff you're going to get to see us do.
So in general, for us, for in-app purchases, we're not going to be selling content within our purchases, but mainly we're going to be selling gamification things that people really like. And so far, that strategy has been working pretty well..
Great. And then on profitability. So Andrew, the profitability increased in 2022 by about 450 basis points from 2021 on an adjusted EBITDA basis, which was good progress towards our long-term profitability goal, of that 30% to 35%. This year, we're guiding to 600 to 800-basis point improvement over that.
And so as we look out kind of into the longer term, our goal hasn't changed. We want to be at a 30% to 35% adjusted EBITDA margin. And between last year and what we're guiding to this year, we think we're showing the right progress towards that goal..
Thanks. And then the next question comes from Ryan MacDonald of Needham..
Congrats on a strong close to the year. Luis, let me start with you on the Duolingo English test. There was recently a ban in China from the government on online degrees, kind of a Chinese citizen essentially taking a fully online degree from an international university. They're no longer recognizing that degree.
And it seems like this is going to start creating sort of a shift in an inflection point, and more Chinese learners looking to go in person overseas. I'm just curious if you've seen any impacts of this thus far on sort of applications or sign-ups for the Duolingo English test and how you think -- or what your expectations for that are in 2023 here..
So well, thank you for the question. We have not seen any impact based on this, and I think there's many reasons. I mean, for one, yes, China is a relatively large chunk of the Duolingo English test takers, but we really have test takers all over the world. The other thing is the reasons for taking the tests are very varied.
Some of them is people who are applying for international undergraduate admissions. There's also graduate admissions. There's transnational education. There's all kinds of different pockets. And maybe one pocket has some sort of policy implications to it. But in general, the pockets are pretty healthy. That's just kind of one thing.
The other thing is we are still -- we are not the leader in this market. We're coming into this market with an online test, and it is a market that usually has had all these off-line tests.
So given that we are still in the kind of growth phase of this, we don't -- it doesn't affect us too much when there's something that changes the full volume of it because we're coming in with whatever percentage of tests we have, which is significantly under 25%.
We're still growing quite a bit and pretty fast, so this is not something that we're seeing yet..
That's helpful. Appreciate it. And then maybe as a follow-up. You talked a lot about generative AI and the use of that, and I'm very curious around the content creation. You mentioned an increased focus on sort of more advanced English content for non-English speakers or basic English speakers.
How quickly do you think that the generative AI can compress your content creation time line? And how do you manage for quality in that? And then for Matt, are you assuming any -- within the leverage that you're showing this year on the profit margin side, are you assuming any leverage from that content creation from generative AI?.
Yes. Thank you for the question. So we're very excited about generative AI. And just to put things into context, at Duolingo, we've always leaned into AI from the beginning. I mean a lot of our products are built based on AI, et cetera.
Over the last couple of years, generative AI has become significantly better, and we're definitely going to lean into this as well. You mentioned content creation. That's one of the places where we think that it can help us a lot and speed things up quite a bit.
It's a bit early for me to give you a precise estimate of how much you can speed it up, but we are certain -- I mean it's already happening. We're already speeding things and also lowering costs. One of the places where we're using that is to be able to create a much more English learning content. So you'll see us create a lot more of that.
In terms of quality assurance, we're still going to have humans go over it. But the time frame, it used to be the case that all of this was almost entirely generated by humans. By now, it just has to be reviewed by humans, and it's a lot quicker to review than to generate.
So in terms of time frame, we're going to get a massive increase in that, and I assume it's the same for cost. So yes, this is something we're very excited about. And the other thing I should mention about generative AI, so content creation is one of them, and we're going to definitely use that.
But it also is going to help us just create better experiences to our users, kind of more online conversational practice that we're going to be able to do. And that's the type of stuff that we're putting into our new higher tier subscription, Duolingo Max. So this is something we're very excited about.
As a company, we've partnered with open AI, and we're going to be working very hard on this..
Yes. And Ryan, Luis answered the question for the guide. I mean we only included in the guide things we have direct line of sight into. It's not -- generative AI is so new. We don't have a ton of line of sight into direct savings yet. But as Luis said, over time, that's probably the way to bet..
Thanks, Ryan. And the next question comes from Aaron Kessler of Raymond James..
A couple of questions. Maybe for Matt. On the paid conversion rate, it was very strong in Q4. Can you just talk about that? Was that family plan a part of that? And then how should we think about paid conversion in 2023? And then maybe any update on a given test, maybe kind of human tutoring as well.
Is there any kind of thoughts on that direction as well, especially as maybe it relates to Duolingo Max, how you're talking about -- thinking about integrating that as well?.
Sure. Yes. I'll let Luis answer that last part. For the payer penetration, we had mentioned, I think throughout most of last year, so we expected a 1% to 2% increase each quarter year-over-year in that metric.
And that's coming from all of the things that Luis has described before, that all the product improvements that compound over time to make our free-to-pay conversion go up, in general. There wasn't any one particular item like family plan or this or that. It was all of them compounding over time.
I think going forward, as we mentioned on, I think, the Q2 or Q3 call last year, given the growth in MAU, so that denominator of that number is just growing really, really nicely, and the retention trends, we would expect it to actually instead of adding 1 or 2 points every quarter year-over-year, be closer to 1% this year, just because, again, that denominator is growing really nicely.
So it will ultimately turn into subscribers over time. But in the short term, it will be about 1 point.
And then, Luis, you want to talk about Max and tutors?.
Yes, on human tutoring. I mean the first question was about human tutoring -- or the second question was about human tutoring. This is over the years, we've waffled with human tutoring. At first, we launched Duolingo with no humans involved. Then we tried it. We tried putting it in.
We tried -- and over the last year, we've made the decision that I think is the right decision that we are not going to get into human tutoring at all. We've tried it. We are out. There's a number of reasons for that. There's nothing -- it's not like we have anything against human tutors.
It's just on our end, we are a technology company, and that's what we excel at. And in addition to that, if you look at it, human tutors are great, but they're not getting any better. They're just there. Whereas technology, in particular AI, and in particular a lot of the stuff coming from generative AI, is just getting better and better every year.
So we're going to bet on that. Much in the same way, like 10 years ago, we were told we could not teach a language with synthesized computerized voices. We bet on that, even though 10 years ago, synthesized computerized voices still sounded kind of robotic. Today, they sound excellent.
We feel the same with AI that in 5 years, I don't know, 5, 10 years, we will be very happy that we'll have that on technology rather than humans..
And next question comes from Nat Schindler from Bank of America..
Yes. I actually want to just go a little deeper on some of the questions you had before, really about how the users have changed. You saw a dramatic acceleration in both users and paid subscribers over this year versus the prior year.
Has there been a real change in the demographics of those? Is there anything substantially different about users this year than there were last year?.
It's a great question. If there has been, it's small. There's -- generally, our user base is very wide. We have users from every single country in the world. Every single country in the world is represented. We have users from every single socioeconomic status from all ages as long as they know how to read. So it's kind of from 6 years to about 100.
Just -- we just really have users from all over the place, and it's a very wide user base. So it hasn't changed too much. The one thing we've noticed is it has gotten slightly, ever so slightly younger, and that probably has to do with our -- a lot of our prominence on social media like TikTok, but that's it.
So we haven't really noticed too much of a change..
And as those changes towards going slightly younger, has that happened in both free users and paid?.
The honest answer is I don't know. I know that it's -- free users is getting slightly younger. I don't know for paid. Maybe....
Yes. I'd have to go back and double check, Nat, on the paid. I think what we've seen on paid is that the conversion trends haven't really changed. Some have accelerated. For example, just overall conversion of kind of cohorts across the board has increased over the course of last year.
So folks who are new to the platform in the first couple of months, they converted more rapidly than in 2021. Folks that have been on the platform for a long period of time, they converted a little bit faster than they had in the past. We've always seen that people who use the app more convert more. That stayed the same or got a little bit better.
So yes, it was kind of a broad base. Just like our users grew around the world in a pretty broad-based way, the same trend on the free to paid conversion..
Thank you very much. And once again, very impressive..
Thanks, Nat. And next question comes from Mark Mahaney of Evercore..
Two questions. You had this line in the release about how the number of returning users is roughly the same as the number of brand-new users. I would just have assumed that, that has always been the case or it's been the case for a while.
But is that something new that's happened? Because I get your point about how people will use it, and then they'll either come back to it when they realize importance in learning a new language or there'll be another opportunity. Maybe they're traveling to a different country.
So is that a new trend or not? What's the so what out of that? And just real quickly, Duo Math, though, that math product, just where is that? Are you still tweaking it? Is it far from being where you want it to be? Just talk about kind of adoption, how much interest you've really seen in that..
For your first question, this is not a new thing. It's been a while since returning users are the same as new users. I'm going to assume at the very early of Duolingo, that was not the case. But it's been a while that has been like that. And you're right. It's because it is rare for us to see a user that uses Duolingo goes away and never comes back.
That is rare. Usually, people may even go away for 2 years and then come back. It's just because there's such a little friction. So we see that. And the reason we put that there is mainly to emphasize that it is not right to think of our users as coming, having churn and been gone forever. That is rare. It's more that they come.
They stay for a few months or something, then they may take a break for a couple of months and they come back or something. So something like that. In terms of math, we're very happy with the progress. It's growing rapidly. We're happy with that.
Just to remind you of the plan, we are -- right now, the goal is to grow our math product organically for it to grow by itself. Once we get to a pretty decent number of users, call it 1 million daily active users, this is kind of -- it doesn't have to be exactly a million. Once we get there, we're going to say, okay, great. We have good product market.
It is time to start monetizing. We're not there yet, but it is growing pretty nicely, and so we're happy with the results. In terms of tweaking guests, we're working very hard on tweaking the app. We're adding a lot of the features that we know work well on the main Duolingo app to the math product. So improvements to the Street.
We're thinking of adding things like leaderboards, better notifications. So a lot of the stuff that we've learned over the last 10 years on Duolingo and that we have the code for, we're starting to add to the math app to get it -- to have higher retention. We're also adding more content to it.
One of the things that happens with the math app right now is people actually run out of content because if you are very -- it turns out we have some very heavy users that use the whole thing, and then they kind of run out of content. So we're adding more content to it. So you'll see us over the next year just make the product better and better.
And because of that, it will continue growing..
Next question comes from Eric Sheridan of Goldman Sachs..
Great. Maybe first question would be following up on something that was implied in Mark's first question. Travel has obviously been a big tailwind, and the shift to services over goods has been a big tailwind in the macroeconomic environment.
Can you talk a little bit about what you've seen with travel potentially as a catalyst for usage, both top of the funnel and the bottom of the funnel as that's continued to build momentum and how maybe as a result of cross-border travel continuing to return, that could be a nice tailwind for the business going forward over 2023 and beyond.
And then the second dynamic would be, you talked a lot about virality in TikTok.
Can you talk a little bit about where you are excited to experiment and think about marketing or building virality on platforms on the content side or the distribution platform side, maybe even away from TikTok and how we should be thinking about that building in the years ahead?.
Great question, Eric. Let's see. In terms of travel, we don't see in our metrics that more and more people are using Duolingo for travel. We did see a very temporary dip in the height of COVID a couple of years ago. That is like a fewer -- slightly fewer. Since then, it's been about the same. And we just -- travel is interesting.
For a lot of people like us that are, to be honest, from the worldwide perspective, pretty wealthy. I think travel is like a big motivation for using Duolingo. But for a lot of our users, they're using it to learn English or as a hobby or something.
So we don't see these things that's like, "Oh, my god, travel has opened up, and therefore, Duolingo is exploding." That just -- we just haven't seen much of that. We do ask when people sign up, why they're using Duolingo. And some fraction tell us they're using it for travel.
I don't know the number off the top of my head, I'm going to assume it's something like 15% to tell us that they're using it for travel. But it's just not something that we look too much to. In terms of your second question about virality. So, so far, we have experimented with a few social media platforms to get our word out, by the way.
And this is mainly organic, as in we don't pay for this stuff. We just make really good content. TikTok has been really good for us. Not just TikTok in the U.S., we've actually localized our TikTok to Portuguese and Spanish and other languages. So one of the things that we're excited about is TikTok accounts in the other languages.
They're actually growing really fast. And it's actually amazing how -- by the way, this is just amazing thing about Brazil. Anything you do with social in Brazil does well. And so as soon as we put TikTok in Portuguese, it just kind of went nuts. And if you go see those videos, they're amazing.
We just had Duo dressed up as Wednesday from the Netflix show, Wednesday. And we got, I don't know how many, 10 million views or something. So we're excited about platforms like TikTok and actually also Twitter. We're doing pretty well in Twitter.
Now when you ask about virality in general, another thing that we're doing is we're just adding a lot more things inside the product. This is not social media or anything, inside the product to get more people to share things. And we now have a team behind it. It's a really good team, too, and they are able to get a lot more people to share things.
One of the main things that people share, there's now a way to share sentences much more easily. One of the main things people share are weird sentences that they see on Duolingo. So some of the courses, for one reason or another, have a very weird sentences. I don't know if I can think of one of them.
Like the German course has something like -- the sentence has something like, "right next to the bed, lay the body of the husband," or something like really weird stuff that people share. And that just gets a lot of people. So we're working on getting people to share like that, and it's working out pretty well.
I want to say Matt probably wrote that question about the -- that sentence about the husband. But, okay..
Next question comes from Mario Lu of Barclays..
Great. So the first one is on app store fees. Just curious to your thought on the recent trend of apps bypassing the app store. For example, games like Fortnite and apps like Spotify, Netflix have done this for a while. But more recently, more traditional mobile games are implementing like a direct-to-consumer payment method.
Just curious your thoughts on any initiatives that you guys have on your end..
We're not currently working on that. For us, we love the app stores. Obviously, it's hard to say that we wouldn't love it if they decrease their fees. Of course, we would. But we do really well with the App Stores. They're an amazing distribution mechanism. And the thing when you go off app stores is that it's harder to distribute your product.
And also, it has quite a bit of friction. One of the amazing thing about the app stores is that people already have the credit card in there, and they just have to tap once and it gets to there. So you may be able to lower your fees, but you add so much friction to your users. But it's not clear to us that we would make that much more money.
It's something that we're always thinking about and may eventually do it, but it's not something that we're currently working on too much..
And remember, Mario, we did get a quite significant bump from Google lowering their app store fees last year. So....
Got it. Helpful. And then second one just on kind of changes to the Duolingo app itself. I believe past few quarters, you talked about the change to the single learning track being at parity.
Any updates to that? And just in general, how do you balance between kind of optimizing for learning and versus having a more casual app that kind of attracts the masses? So I think just user feedbacks, could be like a lab minority. But the removal of like things like oral prompts or type answers, I believe got some negative feedback.
I just wanted to hear your thoughts there..
Mario, you read Reddit..
I do..
Yes. So it's a great question about the changes to the app. So we made some pretty significant changes. We're always making the app better. I mean this is what we work on. This is why we spent so much on R&D. We're literally always making the app better.
Over the last year, we made this large change to our home screen, going from -- giving a lot of choice about what to learn next to this linear path. The main reason we did that linear path, by the way, was to teach better.
We noticed that we were -- when we were giving people so much choice, what was going on was a significant fraction of them, we're just coming in to extend the streak with really easy lessons that we're not actually getting them to learn.
Whereas now with the linear path, we've encouraged a significantly larger fraction of users to whenever they come to increase their streak, they actually also learn something. So the main reason we did that was actually to teach better and also to simplify our product, which has really helped us. But that was actually to teach better.
The way we think of it is when we're making changes, we look at -- we have 3 things that we're improving. We're improving how well we teach. We're improving how engaging the app is, so basically, how much time people spend on it, how -- retention, et cetera, and we're improving how well we monetize.
And we have large teams behind each one of these kind of group of metrics. And what happens is that each team, for example, there's the monetization team, what they're trying to do is get more people to subscribe. Whenever they run a test to try to get more people to subscribe, what we enforce is that they cannot screw up the other metrics.
So yes, you can get more people to subscribe, but you cannot decrease our number of DAUs. You cannot decrease the time people spend learning, or you cannot decrease the learning outcome.
Similarly, when we get people to -- the group of people that is dedicated to teach better, we tell them, okay, you can make changes that teach better, but you cannot screw up the monetization or you cannot screw up the user engagement. That's how we balance it. And we found that, that works pretty well.
And most every change in the app, you can actually trace it down. That change was made by the group or by the team of people that is trying to make us grow faster or make us make more money, et cetera. And so that's how we do it. Hopefully, that gives you some color..
Our next question comes from Arvind Ramnani from Piper Sandler..
I guess my first question is, among the management team, who has the longest streak in terms of usage? But let me now ask that..
But I don't know the answer to the question, but I'm willing to bet it's me, but I don't know the answer to the question..
We can be pretty sure about that..
Yes, yes. So a really good metric with user engagement and kind of the revenue growth and bookings. But I know there's a whole lot of other metrics you track that -- beyond what you'll share with us.
So can you -- conceptually, if you're not able to share hard numbers, are you able to conceptually share a bit more underneath on some of the metrics that's giving you confidence in kind of the shape of the growth for this year?.
Yes. I mean I don't know if we can share precise numbers of -- there's certain things that we share and stuff that we don't share, but we do track a lot of metrics. In general, as I was saying before, there are 3 groups of metrics. There is what we call the growth metrics, which is just usually our entire user base.
Are they using the product more? Do we have more DAUs, et cetera? There is the monetization metrics, which is how much money we make, basically. And then there's the metrics about how well we teach. In each one of them, we have a ton of metrics. In terms of growth, some of the things that at least I look at, I look at time spent learning.
I look at DAU to MAU ratio. I look at resurrection rates, so kind of number of people that are being resurrected. I look at the retention of resurrected users. I look at the retention of current users. I look at the retention of new users. So that's the type of stuff.
In monetization, the types of stuff we look at are things like conversion from free to paid, LTV, retention of paying users. Daily bookings is something we look at a lot, number of users or a fraction of users that have an IAP or do a purchase on an IAP.
In learning, we look at a number of things, but one of the main things we look at is difficulty of the content that we're able to give out without scaring users all away. So there's a lot of metrics that we track, and I don't even know all of them off the top of my head..
Yes. That's helpful. And then kind of bookings growth, kind of sitting externally in some sense, it's a bit of a black box. But are you able to share like when you project for bookings growth, what are the inputs that go into kind of coming up to the type of projections for bookings growth? I mean we don't even know the specific numbers.
But just conceptually, what goes into predicting user growth -- booking growth, sorry?.
We just take a ruler and go up like that. It works pretty well. I'm kidding. Matt has a much better answer than that..
Well, maybe not. I mean the main thing to think about with bookings growth is that there's just the 2 dimensions. There's new bookings growth, new subscribers and there's renewals, and so -- on the subscription side. And then you can add in adds, obviously, and IAP.
On the new users, Luis basically talked about how we have a really complicated model, a markup model, if you want to read our blog post on our growth model, how we predict users. An input into that is new users, and that's a combination of organic growth and marketing spend. So we predict new users. That flows into some element of new bookings.
And then we're just basically doing cohort math for our cohorts of new users over time to see what we think they will convert into. And then we're adding into that for the subscription business, the renewal cohorts, which we have really good data on at this point. We feel pretty confident about.
So you add that together, you get your subscription bookings. Add in adds and IAP, which again are a bit less detailed in the cohorts, make a little less sense for that. And then you got bookings. It's really that simple, Arvind..
Great. Well, that's all we have for questions. So I'm going to turn it back over to Luis..
Thank you for all the excellent questions. And please, please, I beg you, do your Duolingo lesson..
Goodbye..