Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Zuckerberg's leaked email on VR strategy (2015) (scribd.com)
294 points by ppsreejith on Nov 9, 2022 | hide | past | favorite | 445 comments


You can really understand here that Zuckerberg really understands his business. He knew in 2015, that if Facebook didn't have a platform it controlled, it would suffer down the line. We are almost a decade out, but what he predicted has come to pass and Apple is now squeezing the juice out of Meta.

I don't think Zuckerberg is wrong about VR at a certain level. I think VR gaming makes regular gaming obsolete in many ways. But instead of making Oculus the "XBox" of the future, Mark decided that it was the "everything" of the future. A sort of wishful thinking that these headsets would replace the cellphone.

The cellphone fits in your pocket, watches fit on your wrist, and earbuds fit in your ears. A VR headset would have to be sunglasses size and even then they'd still be less ubiquitous than the Apple Watch.

The problem is not the vision, but the amount of money being spent. If Oculus had stayed independent, I can guarantee we'd have better (probably more gaming) oriented content.


> If Oculus had stayed independent, I can guarantee we'd have better (probably more gaming) oriented content.

I agree with this. We would also have more competition because other players in the space wouldn't be as intimidated to go up against a business like Meta/Facebook.

I think a crucial miscalculation was trying to EEE the space. Zuck clearly states that he wanted Meta to "own the space" on every platform. Basically, he wanted to carve out a niche like Adobe managed to do with PDF, but on a scale that rivals full blown platforms like the Android ecosystem. Such an ambitious plan sounds great on paper, until you realize that you're trying to EEE the exact people who wrote the textbooks on EEE. When you sound a horn that loud, on a megaphone as big as the one Meta was using, you're only painting a target on your own back.

Another drawback to the path that Meta selected is they basically internalized the entire hardware industry that was just starting up. If Oculus had stayed independent I believe they would have had to partner with other hardware vendors to establish some sort of regulatory body for writing industry standard specifications. With one serious player in the field developing and harboring all the tech for themselves, this space could be barren for a long time if Meta folds. All the work by third parties that went into this proprietary technology and platform will basically be for nothing.


As a VR dev, the field would be barren in that future, but for entirely different reasons.

The "common" API to access VR does exist: OpenXR, and is not great and has remained that way for years. Oculus's APIs Just Work (tm) and SteamVR's are fairly usable and more open to accessories, if a bit jank at times. On top of that - a great deal of Meta's XR research has been/is released to the public. We could do better...but we could do worse too.

Low-hanging fruit such as controller offsets have been incorrectly specified and remained incorrectly specified for years. Input latency and prediction are unacceptably high and/or incorrectly implemented by at least one game engine, in a way that screws up certain motion vectors unless you take some very much unspecified guesses about implementation and filter them appropriately.

I pray for the Khronos groups and members who are party to OpenXR to improve their support going forward, but it's going to require some risky bets on the part of game developers to adopt the APIs, and a lot of legwork from all stakeholders to tune and improve their platforms to something converging on acceptable. And where is Apple in this? Absolutely nowhere - so the platform convergence is guaranteed huge future divergence anyways.

So that explains that although there exists a standard platform that multiple hardware manufacturers can target - and have targeted - it has not yet achieved mainstream acceptance. It's just not good enough (yet), it's a pain in the ass to work with, it requires engine updates, and there's a high risk it will be majorly disrupted.

Additionally, it must be emphasized that there would be no VR market if not for the Quest 2; no other hardware platform has paved a way to a sustainable consumer ecosystem, from end to end: low priced hardware, high baseline quality of developer experience for something this early in its lifecycle (it bootstrapped developer experience based on very polished developer workflows), consistent install base to target and optimize for.


> no other hardware platform has paved a way to a sustainable consumer ecosystem, from end to end: low priced hardware

Without Facebook we might have gotten a consumer version of the DK2 for $350, instead of the $600 CV1, and we might have spend two or three years doing VR with Xbox gamepad instead of having to spend an additional $200 on Touch controller.

Hard to say if that would have succeeded, as early not-quite-6DOF VR certainly had issues, but low cost and accessible VR is what the whole VR hype from 2012 onward was build on. The two year delay and the $600 announcement destroyed that hype and reduced VR to a few hardcore fans. Going all exclusive with their store and not allowing other headsets in also fractured the already tiny market completely without need.

Quest2 momentarily got the price back down (since then increased by $100), but it still struggles quite a lot in getting the excitement back, as there isn't anything interesting happening on the content side. We don't have movies in VR, games are still all low budget indie stuff and there isn't much in terms of events in VR either, even Meta themselves still struggles broadcasting their own conferences as a proper VR event.


> Without Facebook we might have gotten a consumer version of the DK2 for $350, instead of the $600 CV1, and we might have spend two or three years doing VR with Xbox gamepad instead of having to spend an additional $200 on Touch controller.

I don't see how. The DK2 was a prototype wholly inadequate for and unscalable to the mass market. The CV1 was legitimately expensive for Oculus to manufacture; the only reason it became affordable to manufacture was because Facebook had the funds to hire people with experience in optimizing manufacturing processes and reducing Bill of Materials (BOM) cost for the parts. If memory serves, one of the people hired after acquisition was ex-Lenovo, with expertise in specifically that.

The exclusivity was also not solely Oculus's fault; the acquisition by Facebook stung Valve rather hard (much of their tech and many of their employees ended up going to Facebook) and I believe there was a bidirectional hesitation to engage. My recollection is that there was a willingness to offer compatibility, and some compatibility libraries implemented, but there didn't appear to be a serious commitment overall to invest further in cross-compatibility from either party than what was already available.

I think OpenXR was an evolution past that, but without much real-world usages of it, it kind of sucked for a long time.

> We don't have movies in VR

People watch movies in VR all the time. There's BigScreen, which is legit, and there's also movie worlds in VRChat, which fly under the radar but are really awesome for social co-watching experiences. Though I hear you and agree that the big companies are lagging a bit behind in exploring and implementing good VR experiences and producing VR content with mass appeal.


> The DK2 was a prototype wholly inadequate for and unscalable to the mass market.

DK1 shipped 56'334 units[1], DK2 shipped 118'930[2], CV1 shipped an estimated 547'000. That's really not far apart and CV1 was on the market for longer. DK2, or a slightly improved iteration of it, would have been very much serviceable as a mass market VR headset.

> The CV1 was legitimately expensive for Oculus to manufacture;

The BOM for CV1 was only around $200[3]. They did some unnecessary stuff to make it more expensive (wrap it in fabric), but fundamentally the CV1 was not a very expensive device. Not sure how they arrived at that $600 price, but that looked like they vastly overestimated how popular VR would be and tried to milk it for profit.

Meanwhile for a modern example, Pico4 has a BOM of around $348[4], while it's sold at 429€. That seems way more reasonably priced to break into the VR market.

> The exclusivity was also not solely Oculus's fault

They never provided anything to allow third parties into their ecosystem. Meanwhile Valve wrote the SteamVR driver so that Oculus headsets can be use in SteamVR. And the SteamVR/OpenVR runtime was open enough that anybody could write their own drivers or plugins for the ecosystem.

This issue isn't even limited to headset from other manufacturers, a lot of the video content on the Oculus platform wasn't accessible with Oculus's own headset, but limited specifically to their mobile headsets only. Compatibility to Oculus Go and Quest1 was also reduced or killed after the release of Quest2, despite the actual software being compatible (e.g. manually transferring .apks to Quest1 to play Resident Evil 4 works).

> People watch movies in VR all the time.

Bigscreen and VRChat exist despite Facebook, not because of it[5]. Anyway, I don't just mean watching old movies in VR, I mean actual made-for-VR movies. They had that with Oculus Story Studio, but they killed it and nothing really has replaced it. There are no new upcoming movies for VR. We don't even get Avatar2 in VR. With the amount of money Facebook has been spending I'd expect at least a VR-remastered version of Avatar2 premiering in VR. But we don't get that, if a want to see the latest movie, I still have to do that in a real cinema, not in a Metaverse cinema.

[1] https://www.roadtovr.com/wp-content/uploads/2015/06/dk1-sold...

[2] https://www.roadtovr.com/wp-content/uploads/2015/06/dk2-sold...

[3] https://hexus.net/tech/news/peripherals/95167-oculus-rift-co...

[4] https://www.reddit.com/r/AR_MR_XR/comments/xzkyop/pico_4_vs_...

[5] https://nitter.net/dshankar/status/1295825811748999173


What does “EEE” mean in this context? End to end?


Embrace, Extend, Extinguish - the Microsoft strategy (per their internal documents) towards anything it didn't control: https://en.wikipedia.org/wiki/Embrace%2C_extend%2C_and_extin...

Adopt an open standard, add proprietary bits so that content worked best (or exclusively) on their own version, and force other players and competitors out.


coughGITHUBcough

I'm terribly sorry, I could not resist.


eg Inter-repo forks existed prior to the acquisition though.


See: WSL


What's the EEE-strategy behind WSL?


yeah, i'm curious about this too. i've spoken to many high level folks in MSR (microsoft research) and they're all massive proponents of open-source software and unix and are as excited as i am about being able to open a 'native-ish' *nix terminal and do work.

in fact, i've got my win10 box set up for dev, and it's nearly identical to my mac! it wasn't 100% straightforward, and to get windowed emacs working from the cli took a little twiddling, but overall in less than a few hours i had everything running flawlessly. :)


The challenge Microsoft faces now is that "embrace" is actually a great thing, but now some people will always assume an ulterior motive.


[flagged]


IMHO, the saddest part is that people keep falling for it, and/or knowingly selling out others to it.


And then expecting the guillotine as “justice”, it’s a downward spiral. But this is just business. Leaders make miscalculations all the time. In this case, Zuck’s business problem is replacing the growth story of a maturing product that is the Facebook app and really making social media an entire industry.

Meta and VR is a potential new industry. The only thing that will replace the SM growth is creating/owning an industry again. He liked the VR world because he could own it for a while. It would be more difficult to disrupt than what keeps happening with SM. TikTok is the latest rival but there have been many. And there’s now as ad revenue pressures. It’s a recipe for a massive layoff. Since it’s a business, that is the most appropriate action. I don’t think anyone expected how difficult and expensive it would be. I assume the layoffs will slow this down further and it’s effectively a loss or a solution without a problem.


> I don’t think anyone expected how difficult and expensive it would be

I agree with the rest of your post, but this might be more of an "anyone inside of Meta" scenario. There's plenty of skeptics around short-term VR (myself included). Getting a non-technical audience into it is going to require a set of massive technological innovations, imho, both in software and hardware.

Even then, having your vision be completely blocked to the outside world is not something casual users are going to enjoy for any extended amount of time or frequency.

If I'm writing a post and my kid or dog or friend needs my attention, I can set the phone down for a second. If I'm in VR, the best I can hope for is a button that makes the screen transparent so that my eyes can see (and be seen!) again short of reaching up to my face, taking my head gear off, then putting it back on. Even then, the immersion is completely broken.


I meant the willful malicious destruction of FOSS commons that is EEE.


> We would also have more competition because other players in the space wouldn't be as intimidated to go up against a business like Meta/Facebook

I completely disagree with this. Competition is what drives innovation, not the absence of it. Other players did go against Meta/Oculus and their VR products were abysmal in comparison. They just didn't get what makes a desirable VR headset for the average gamers/consumers. And it's not all an issue of money. Sony, Google, Microsoft, LG, Apple, Samsung and other tech giants had equally deep pockets and hardware expertise to compete with Meta/Oculus in this field if they wanted to and if they knew the market. But they didn't.

If Meta wouldn't exist in the VR space, it doesn't mean their competitors would magically have better tech now. Their products would still be crap or not even exist today. Same how other smartphone makers with equally deep pockets to Apple like Nokia, Ericsson, Motorola went against the iPhone and failed. If the iPhone wouldn't have existed it doesn't mean all their competitors would now be making better phones. Quite the contrary, the competition the iPhone bought helped move the technology forward, same how Meta's Quest moved the VR tech forward.

Just look at Sony's recent VR headset for the PS5, needing physical cables tethered to a separate console you need to buy, is just a no-go in 2022 VR technology. Meta/Oculus moved the goalposts so much with their cordless, self contained Quest 2 headset, especially at the ~400$ price point, that going back to expensive headsets tethered with cables to separate PC/consoles is just not gonna be a VR sales success going forward.

Up until the recent Quest Pro failure, it seemed Meta/Oculus really nailed the base recipe for what makes a desirable VR gaming headset with the Quest 2. All they had to do was improve on that, instead of pivoting to "professionals".


> Other players did go against Meta/Oculus and their VR products were abysmal in comparison.

Not really. The original HTC Vive outsold the original Rift by a lot and was a vastly superior headset (full 6DOF headset/controller vs front-facing/Xbox controller), while also costing about the same. It took Facebook quite a while, the release of Touch and a lot of patches to catch up. And on top of that they had to cut the price in half to stay relevant.

Meanwhile PlaystationVR was outselling everything PCVR was doing combined by 5x.

> Their products would still be crap or not even exist today

The "not even exist today" might very well be true, the crap however not. Microsoft was the one pioneering 6DOF standalone and handtracking back in 2016. Google had one with the Lenovo Mirage a year before Facebook even entered that space. The issue is that they all left the market before the Quest was even out. They never tried to compete, they saw that VR wasn't selling and gave up prematurely. Which is a shame, as I really miss WMR, which was both substantially cheaper than a Quest2, as well as having really nice way to interact with 2D apps inside VR with WMR Portal.

Meanwhile Pico4 just entered the market in Europe and happens to be a substantially improvement over Quest2 while also costing less. Quest2 still has a bit of an edge on the software side, but the gap is quite small when taking into account how much money Facebook spend.

The strength of Facebook is simply endurance, they kept going despite miserable sales VR. And they did that long enough to reach the "good enough" point with Quest2. That said, they are really slacking on the software side now. There is no interesting first party content coming out, it's all just Horizon Worlds. High quality games (Lone Echo) or software (Quill, Medium) as we had in the early VR days is all gone, nothing interesting announced in years and Quill and Medium even got sold off.

> it seemed Meta/Oculus really nailed the base recipe for what makes a desirable VR gaming headset

But that's the thing, that was essentially an accident, not a grand strategy. Facebook doesn't care about gaming. They care about that "next computing platform" that VR is supposed to be, gaming is just a tiny part of that and they'll happily toss it aside in the hunt for bigger goals.

That's really the problem with Facebook, they are far more interesting in dominating a hypothetical future VR space, than they are interest in improving the VR we have today.


>needing physical cables tethered to a separate console you need to buy

That's an opinion, yet you present it as a fact.


It is a fact that Sony's VR headset needs a cable tether. Where's the opinion here?


Clipped quote wrong. I was ment to include that part too: " is just a no-go in 2022 VR technology."


It is a no-go for VR consumers in 2022. How many do you know in the market for a cabled VR headset? It's a huge step back for VR tech.

Watch the sales and returns numbers in the future, they will reflect that and prove me right. You'll find the headsets on sale on craigslist or ebay for half a price after they gathered dust in people's homes for a few months.

Want to bet on it?


The problem isn't the amount of money either. It's that their product is bad.

I havent tried the recent Quest Pro but based on reviews I assume it's pretty good. Not great, not sexy, but pretty good. Their flagship application however, Horizons, embarrasses meta every time a screenshot gets shared. It is so dorky and uninspired that nobody wants to admit they even tried it.

Who exactly are they targeting with that thing? Adults? Children? Their messaging and pricepoint around the Pro seems to suggest they're expecting office workers to use it for virtual conferencing. Who are they kidding with that?

The cost is part of the forward-looking vision. That part makes sense to me. It's the product that baffles me. It just stinks.


you're looking at the wrong thing - it's the platform that meta wants, not the "product" they demonstrated (that looks childish from your POV).

It's like saying, back in the early days of the internet, that showing an ugly, unstyled text with pictures on a webpage is worthless. The platform has grown to become a cornerstone of human civilization!

Facebook wants to own something akin to that. _If_ their bet works out, they will be so very powerful. I think as a netizen, it's my duty to make sure their bet doesn't go the way they want. Platforms should not be owned, but be federated and compatible, and open.


>it's the platform that meta wants, not the "product" they demonstrated (that looks childish from your POV).

you need the exceptional content to kickstart a platform. steam doesn't work without half life 2.


For what it's worth, I think you're both partly wrong and partly right. From the letter:

> I think you can divide the ecosystem into three major parts: apps / experiences, platform services and hardware / systems. In my vision of ubiquitous VR / AR, these are listed in order of importance...

> The key apps are what you'd expect: social communication and media consumption

While Mark believes that Apps > Systems > Hardware he also knows that the order has to be the other way around if you're building this industry from scratch. Meta has to stay ahead in hardware if they want to own the systems and apps that run on it. Horizons is their proving ground for the technologies they need to own social and identity. I think they're focusing more on building the systems for it while the graphical quality is getting left by the wayside. It makes it easy to laugh at if all you're judging it by are screenshots but if you have experience with social VR apps you'll know that being able to have a high server population is the killer feature that they're chasing. A one man team can throw together a multiplayer VR experience that looks great but as soon as you try to have more than 20 people in the same room it begins lagging so much that everyone will get pissed and quit immediately (you have to have experienced lag and jittery video in VR to know why this is). So making sure that the networking is solid and scalable is a wise decision, if that is what they're doing. If they can pull off large events with 100s of participants and no lag they will own the social VR space even if their graphics are still shit. That's a big if though.

As he mentioned in the letter, ubiquitous VR and AR will turn a lot of physical things into apps. He gave the examples of your TV and cellphone but as we've seen with the Quest Pro they also want to replace your monitors, whiteboard, and office. If they can solve the server population problem then here's a list of other things that will become apps:

- movie theatres - bars - dance clubs - house parties - non-contact sports - concerts - board game cafes - conferences - galleries - comedy clubs - stage performances of all kinds e.g bands, theatre troupes, karaoke

I could probably sit here for a while coming up with more examples but the point is this will be revolutionary for people who currently have limited access to these things. If you live in a major city you might be thinking "so what, I can do all of these things down the street" but you're forgetting about the rest of the world! Even if you have access to some of these things, you don't have access to all of them all the time or the specific ones you want right now.


Quest is just hardware though. I use mine almost exclusively to play SteamVR games. If they want to own the platform they need to be the VR marketplace.


“ federated and compatible, and open.”

So - who’s doing it?


why is the internet federated, compatible (with all sorts of clients) and open? Who did it?


Academics funded by DARPA (Defense Advanced Research Projects Agency) of the U.S. Department of Defense? UCLA, UC Santa Barbara, University of Utah, Doug Engelbart at SRI International, a non-profit scientific research institute..

I imagine there's research into VR/AR funded by the government for military purposes. But somehow I doubt it'd be an open protocol and system like the Internet.


The internet was created my the us government to ensure that communication packets could be sent to receivers even if entire cities were destroyed by atomic weapons. This is the original purpose of ARPANet


I didn’t ask rhetorically. I was hopeful. A open internet was the better option. With VR/AR, we might need a strong shove toward robust interconnectivity.


Battery life is terrible from what I've read, only a few hours of use?


That's not any different from the other Quest headsets or anything else for that matter. Show me a VR headset that can run 8 hours on a charge.

You can charge while using a Quest or you can buy an external battery pack if you need to use it for longer periods of time.


I sometimes wonder if Zuck has ever read a novel or watched a movie because one way he is tone deaf is not understanding the possibilities of fiction.

This VR enthusiast made a great video about the problems of VR games:

https://www.youtube.com/watch?v=5rZRvw7WTq8

My mother in law probably still thinks people play first person shooters but really the sense of characterization in modern games depends on the third person perspective. Bayonetta has legs and knows how to use them. The whole point of a Mario game is seeing Mario on the screen.

The third person view lets you experience a spectrum of identification with a character (I moe for Tamamo, I like Mario, I control Mario, I travel with Mario on his journey, I am Mario, ...) that you can't really experience from a first person view. Maybe you can put on the appearance of a character for other people's benefit in VR but you're going to have use your imagination (for better and worse) to put yourself into a character.

For now the VR game industry is driven by independents. Big game studios could make an AAA game but they won't because there aren't enough players with headsets to justify the investment.

I am betting on the first AAA VR game coming from a Chinese studio as they are taking big chances on new IP such as Genshin Impact from MiHoYo.


> I sometimes wonder if Zuck has ever read a novel or watched a movie because one way he is tone deaf is not understanding the possibilities of fiction.

He loves Ready Player One and has referenced it in interviews regarding the metaverse, but he's basically basing his business model after the main bad guy/group in the story.

Not really an answer to your second bit, but "Moss" is a lovely little game in VR that you play from third person (fixed camera). I wish more VR games did 3rd person, aside from Moss it seems exclusive to strategy games.


People still do play first person shooters (and other first person games) plenty. And in modern ones, you can generally look down and see your character's body etc.


I think his point still stands though. I enjoy FPS games because the gameplay is fun, but not with any sense of being immersed by the first person view. VR may very well replace the FPS, but that’s just one type of game.


Thing is, if first-person VR is more immersive than everything else, you'll start seeing more first-person games in other genres, not just shooters.

It's just like 2D - there was a time when that was the standard way to do games, then the time when it was merely prevalent (and 3D was that "cool thing" that you showed off to others)... and then 3D won, and most everybody went there. 2D is still around, of course, but it doesn't dominate the industry anymore.

Now, I don't know if VR has a chance to capture that much of the market; there are obviously some genres that are not very amenable to it. But it doesn't make sense to me to expect for it to continue being as niche as it is today.


The new Call of Duty game literally made 800M in one weekend


I personally hate first person view, but:

There are 3rd person games for VR.

Best selling videogame Minecraft is first person.

Currently top selling game on Steam is first person. Most played is first person


A game whose popularity & longevity has become a cliché, Skyrim, is usually played in 1st person. Myst & Doom were both known for their ability to engage players in a flow state in their heyday. I take your point about narrative, but I think first-person games are giving players a different experience -- agency & flow -- compared to the identification you experience in a 3rd-person game.


Wait you’re entire point is that people don’t like or play FPS? What?


No, I think 3rd person is much bigger.


You are clearly mistaking a personal preference for an objective statistic.


I'm still very unconvinced that gaming is going to be the thing that drives VR adoption. I think primarily social apps will dominate VR in the future and secondarily experiences that you can't have anywhere else like experiencing a nuclear explosion https://youtu.be/pfTCHHy_ukY?t=85


you can do 3rd person cams in VR too. they seem to work fine. they play much like regular non VR games but with some added depth.


> I think VR gaming makes regular gaming obsolete in many ways.

No, I don't think it does; if you look at history, VR has been around for a long time in different forms, think also Sony and Microsoft's console AR solutions. If you look at today, VR is available everywhere at console prices, but it's only a niche to the gaming market, an extra.

The BIG change in gaming in the past 10, 15 years, which Facebook has been partially responsible for, was actually scaling DOWN - think mobile games, simpler games like farmville on FB, etc. Nowadays, the hierarchy is mobile gaming > cynical live service games (lootboxes) > regular video games & consoles > indie games > VR (my opinion / take, I don't have sources because I'm too lazy to look them up).

But you're right about the other things, he definitely overestimated VR's impact on the world. 2015 was a year or two after Google Glass, which was the first major party to try AR as envisioned by Zucc - and it didn't work out for various reasons. A big one was social, but I can imagine the big tech companies figured that society needs a bit more time, like they did with mobile and later smartphones.

I can't see always-on HUD work just yet, society doesn't want that. Nobody wants to have a conversation with someone only for their eyes to go elsewhere because a notification is coming in. Although on the other hand, people will probably talk to someone and see them looking at their phone / watch while talking to them.


100% agree on Zuckerberg really understanding Facebook and where it needed to go.

The most interesting part of the email to me was seeing his support for aquiring Unity. Not being able to land that acquisition almost feels like the critical reason Meta doesn't have much to show today, after all this effort. And it doesn't look like the aquisition failed due to lack of trying! ironSource ended up doing a merger acqusition that finally closed just a few days ago.


For years I have wondered why all the big names pushed Unity in favor of Unreal Engine. Even before UE5 and before Fortnite, UE4 had better tech. than Unity.

Fortnite is the Metaverse currently.


I've used Unity and I'm still working on a solodev VR game with it. Unity has a lot of areas where it could improve. Meta seriously could have developed their own engine. With truly passionate people they could've used their capital to elevate an ECS engine like Bevy


That is so true, I really wish they had just given Carmack a hardcore team of graphics programmers and an infinite supply of diet coke and pizza and told him to go nuts.


They certainly could have, and would have been better off for it! The strategy they laid out was to acqui-purchase one, and I guess having nothing to show for it is the risk they undertook.


Buying Unity would have been a huge mistake. They should keep their focus on their core competency which is handling lots of concurrent users and providing an identity system. Let people use whatever engine they want to develop VR apps.


He outlined why it wouldn't have been a big mistake, and I can't see any disagreement with any of his points on that matter. Without owning an on-road to their platform, they run the risk of developers losing access to it.


why couldn't they buy Unity?


I haven't heard anything publicly. We can't even know how hard they tried.


What is stopping him to acquire Unity now? everything is on sale at the moment: https://finance.yahoo.com/quote/U


The government, most likely. They’ve blocked other Meta acquisitions.


This may be the silver lining of the market cap evaporation for Meta. It is harder to argue that it is an all powerful monopoly now vs in 2021.

What sweet irony it would be if the biased coverage by NYT, WaPo, etc allowed Meta to resume making large acquisitions and maintain their dominance for years to come.


It merged with ironsource this year (and closed a few days ago). Considering the Unity board rejected other offers (even one from an ironsource competitor that was offering a significant premium), I think this ship has sailed.


Could replace the laptop. If we can get unlimited virtual screens and accurate enough hand tracking to replace the keyboard, I could see people carrying the headset around instead.


I think thats what Mark is saying in this. VR/AR could eventually replace: Desktops, laptops, TV, AND cell phones. Thats a lot of stuff. Literally owning eyeballs.


Right but I'm saying that regardless of what he wants, the viable medium I see it replacing is the laptop. Not all of them, just one, the laptop.


Could totally see it replace tv. It’s just too compelling of a new format. Especially if it the hardware fits in your normal glasses.


Not replace but greatly boost. With AR, I used to love passing through the external environment and putting two tv screens up in the ceiling area with CNBC and a podcast, all while doing laundry and tidying up around the house; my net consumption bumped up quite significantly due to the ease and ubiquity of opportunities to consume content.


What device gave you watchable TV screens and still let you see your environment?


Just a quest. Watch the first 20 seconds of this [1] and you’ll see the concept. Note, pass through was low resolution and in black and white. Sufficient for doing laundry but annoying.

1. https://youtu.be/CqkhjL3WvWQ


If we can get proper 3d content for VR that would be incredible. One of the NBA Finals in like 2017 announced a VR viewing experience. Imagine my extreme disappointment when it was just the regular ESPN video on a virtual TV in a virtual room with a virtual couch. I would pay some pretty significant money for a sideline VR camera view at certain sports. Imagine being "at" the superbowl but also having access to your own bathroom and snacks.


This is what I want for watching NHL games. Imagine having a dozen camera views on demand. Of course, knowing how greedy all these companies are, I’m sure if they ever do it they’ll charge per camera view or something stupid that’ll make it cost prohibitive to the average person. I’ll end up sitting behind a pillar in VR. Lol.


eating snacks with a VR headset on sounds messy


ImmersedVR has/had keyboard pass through so you could peek which is helpful even if you touch type.


you basically hit the spot. He never realized the phone with it's size and fit factor in everyday life cannot be replaced by a headset that is so intrusive. It's good for games but anything else likely a hassle to the norm.


A lot of people said exactly this when cell phones were Zach Morris sized, but 3 decades later here we are.

We can probably expect VR/AR to take about that long if not longer. So Mark might not be wrong, he just might be way early.


you can't shrink your head. The smallest version is a pair of glasses. There was a privacy concern when people started wearing Google glasses in public if I remember correctly. The norm has to be respected until the norm changes.


The problem with Google Glasses was that they looked basically like glasses (being AR), in many ways other than size - starting with the fact that they were transparent. A VR headset, even if it's equally compact, won't look like glasses - certainly not if the designers don't want it to.


But Zuck is surely talking about AR glasses here, right? Full VR isn’t going to be a ubiquitous platform like phones/laptops etc.


Have you seen the size of the latest batch of flagship phones? They're a heck of a lot bigger than my glasses.


Why not a contact lens? Or a brain implant.


Facebook in my brain sounds like a nightmare.


worked great for Johnny mnemonic.


Cellphones used to be massive. VR headsets will eventually be tiny. Now is Motorola - the original cellphone pioneer the top producer of cellphones today? Fuck no.

Sometime by 2035 a company will build light field display glasses than can translate language, operate industrial drones, and operate remote chat. It probably won't be meta


The shrinkage of one technology platform in the past isn't enough to predict the shrinkage of another in the future. We're just so used to the idea of tech getting smaller and smaller, but I think we're reaching some limits that might make progress on VR or other immersive tech like that slower or even impossible.

Well, fingers crossed that isn't the case. I for one am never strapping something anywhere near as large as current devices to my face as a replacement for sitting in front of a couple of monitors.


There might be meta-dna and libraries though in that compAny.


I think he's limited by the technology of our times, but I'd still agree with him that this is _the future_ (not sure how soon), and they probably want to be at the forefront when that happens.


it's intrusive today; ultimately they'll look like a pair of regular glasses. Just like cell phones went from clunky beasts you couldn't even fit in your purse much less pocket, to a watch.


If I had to take a guess what will replace the iPhone it will likely be new sci-fi tech that makes the cell into a piece of see through slab of glass that is touch based. If this is possible to do in the future, I think people will start buying that. Until then iPhone will reign supreme!


What would that enable though? Aside from just a new “look” that’s more modern and makes your old phone look outdated?

I think if you had something like google glass, but made my Apple, and looked like normal glasses, that could be big, but still not as useful as a smartphone because of the input limitation. It would be as useful as an Apple Watch at first, but with a bigger screen.


most consumer techs get popular from the "wow" factor and use cases are discovered later. Maybe the glass slab could be used to detect disease from your saliva. Who knows...


This is largely what every sci-fi film has predicted. Though, I don't really see the value of my cell phone being see-through, beside it looking cool.


iPhone was all about the cool factor. Touch based screens didn't add value to the initial consumer except for the "wow" factor. Actual value of touch based came much later. The tech needed the "wow" factor to start the chain reaction into something meaningful.


They were almost immediately useful, maybe not for the touch aspect but for the large screen that could actually browse the full web without being nearly as clunky as everything else on the market.


Here's a depiction of just that in a concept video[1] from Microsoft in 2017.

[1] https://youtu.be/wraF2DjALls?t=152


It's really hard to make electrical conductors transparent, though. Indium tin oxide is the only significant exception and you probably couldn't make a microchip out of it.


It will still be called iPhone.


Eventually the complexity of the iPhone will force them to multiply by -i.


What does that solve for?


Makes me think of The Expanse (tv version)


In Zuckerberg's defence, if they somehow create a wearable headset with the proportions of a pair of glasses, they'll absolutely dominate. A sizeable chunk of their spending spree is R&D. If their work results in VR/AR glasses which are cheap, ubiquitous, stylish, and functional, I will be first in line to say "good job."


I actually think that no matter how good their hardware is, their effort to completely control the software platform will sink them.

My best hope is that Facebook develops a lot of neat tech and then fumbles and fails, and finally exits the space, and in the vacuum companies like Samsung and others drop more general purpose platforms that allow freedom on the software side.


>In Zuckerberg's defence, if they somehow create a wearable headset with the proportions of a pair of glasses, they'll absolutely dominate.

How would they do that though? The technology to pack the VR processing power of ~4k display per eye @ 90-120 Hz, cooling, power efficiency and big enough battery plus lens technology into a regular frame of glasses that doesn't look weird, is some Sci-Fi, Iron Man level technology, that just isn't here yet and it won't be for many years to come, if not decades, considering the slow down of Moore's law, and when it will be here, it will be prohibitively expensive.

Imagine the challenges of having to cram an RTX 4090 into a pair of Raybans and being able to run for hours on the battery of a smartwatch. We're very, very far away from that, probably decades of optics, semiconductor fabrication and battery chemistry advancements are needed before this reaches consumer tech and pricing.

Once Meta goes down and takes Oculus with it, we'll probably see another VR winter, until the tech improvements reach a level that makes it desirable again.


There is a big mountain to climb, but I don't think we need to wait until the technology delivers everything we want all at once. Google Glasses were released in 2013 and while they don't possess that long list of features, they are functional in similar dimensions to regular glasses: https://www.google.com/glass/start/. I would wear these. The road to better AR/VR products will be in iterating on these; making the display better and better, and the hardware lighter and lighter.


That's more of a 20 year timeline goal for anyone. They can still dominate VR in the meantime by staying at the leading edge in hardware. If they want to secure their future they'll have to continue to invest a lot in developing the systems and apps that people want to use.


The fundamental problem with VR is the "VR illusion" which makes the eyes focus on objects apparently in the distance that are actually on a screen very close to the eyes. This gives users headaches thus making mass appeal impossible. Solving this, if it is solvable at all, is challenge #1.


Focal distance is dependent on the lenses used. Most VR headsets have a fixed focal distance of 1.3m or 2m. Those interested in the literature can use the keyword "vergence-accomodation conflict" (VAC) for more information on this.

This is a well known problem, and there are quite a few potential solutions - Doug Lanman, the lead of Display Systems Research @ FRL made a bunch of nice presentations on a variety of different approaches a couple years ago (all on YouTube, well worth watching one [1] for anyone with a passing interest in the really cool developments going on).

While I think varifocal is going to be the near-term solution, I do have a soft spot for the various light field displays I've seen.

[1] EI 2020 Plenary: Quality Screen Time: Leveraging Computational Displays for Spatial Computing https://www.youtube.com/watch?v=LQwMAl9bGNY


As I understand it, due to lens setup this shouldn’t actually be the case. Iirc the view for say a Valve Index ends up at something like 60cm.

Here’s some actual problems that are harder:

* while your eyes remain accommodated to focus on that distance, it no longer corresponds with the way they track objects close or far away, by pointing closer together etc

* lack of correspondence between movement on screen and in the real world (usually translation, rather than rotation which tracks head position) for non-roomscale content (i.e. games where you move around larger scenes) causes motion sickness.


I believe vergence accomodation can still be a problem, even if the focus is fixed at 60cm (close to infinity). If an object is up close in the virtual world (say 20cm), it's still stuck at a focus of 60cm.

I believe Nvidia demoed a solution for this at SIGGRAPH ~4 years back. Liquid lenses were employed to change the lenses focal length based on the content and user gaze.


Nonetheless, the #1 problem is still not giving users headaches for whatever reason :)


I got a Quest to try out VR, connected it to the internet and took it off to let updates install, and instantly felt sick as soon as it was off. It lasted all day and I've never put it back on. It was super cool for the 3 minutes I spent connecting to wifi.


That first experience was the same for me, it heavily depends on the game you attempt too play wherever you're able to get used to it or just keep getting KO'd.

If you give it another try I'd suggest games such as SuperHot, beat saber and pistol whip, as youre only controlling your camera perspective, which makes it much more tolerable.

But yeah, one frame drop and it's gonna feel like someone bashed your face in without leaving a bruise. My worst experience had me feeling unwell for several days after, just thinking about putting the headset on gave me a bad feeling.

I feel like this current version of VR is just a proof of concept, but i don't think it's going mainstream for gaming, ever. Controls are clunky at best compared to what you can do on a regular display, as everything else makes you nauseous


Empirically I would say this affects only a small minority of people. Maybe 5-10% at most. It's a barrier to certain types of adoption but not nearly the showstopper you are making out I think.


It depends on what you mean by "affect" (I'd be curious also where you're getting your empirical data from since there's not a lot of publicly published data from what I can find). While I agree it's not necessarily a showstopper, the negative results in the studies I've seen all point to VAC as being something that is a negative factor that is high on the list of things to solve for.

Shibata, Takashi, Joohwan Kim, David M. Hoffman, and Martin S. Banks. “Visual Discomfort with Stereo Displays: Effects of Viewing Distance and Direction of Vergence-Accommodation Conflict.” Proceedings of SPIE 7863 (February 15, 2011): 78630P-1-78630P – 9. https://doi.org/10.1117/12.872347.

Daniel, François, and Zoï Kapoula. “Induced Vergence-Accommodation Conflict Reduces Cognitive Performance in the Stroop Test.” Scientific Reports 9, no. 1 (February 4, 2019): 1247. https://doi.org/10.1038/s41598-018-37778-y.

Batmaz, Anil Ufuk, Mayra Donaji Barrera Machuca, Junwei Sun, and Wolfgang Stuerzlinger. “The Effect of the Vergence-Accommodation Conflict on Virtual Hand Pointing in Immersive Displays.” In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 1–15. CHI ’22. New York, NY, USA: Association for Computing Machinery, 2022. https://doi.org/10.1145/3491102.3502067.


> He knew in 2015, that if Facebook didn't have a platform it controlled, it would suffer down the line.

People say this but Amazon is doing just fine in the retail space.

In fact for Facebook and Amazon, their biggest follies are trying to own the platform (Metaverse and Fire Phone).

We have seen that owning a platform doesn’t mean owning everything and yet, perfectly good businesses waste a ton of time and money assuming that is the case.


I'm going to disagree here on Amazon. They did succeed in building/acquiring two hardware and OS level platforms. They were so successful you didn't even notice

One is called Alexa and the other is called Ring. At the same time Amazon is a website that doesn't rely as heavily on your phones privacy setting (which Apple is currently using to mine your data btw!)

Within the next 5 years I expect folks to be able to order things from their doorbells and Ring home security drones


> One is called Alexa and the other is called Ring.

What share of Amazon GMV do you think is purchased on either? We’ve had Alexa for a decade now, and forcing a user to walk to their porch isn’t going to be the thing that makes voice ordering work.


The Kindle too.


The profitable part of Amazon is AWS, their platform. Retail is loosing money


People can’t buy books on the kindle app. Fun.


Because Amazon chooses that to make a point.

Notice how it's totally fine to buy goods in the Amazon app? You think that Amazon couldn't have used their leverage to make the same case for Kindle if they thought it was worth it?

I'm not saying there is no value to owning a platform, it's just not as extreme as people make it out to be.


My understanding is that they don’t want to pay a 30% cut to apple on every subscription or booked purchased


> "VR gaming makes regular gaming obsolete in many ways."

Far from it. VR is just a new type of game. Regular display technology is too good now. From ultrawide to laser projection, to high density mobile screens, to folding screens... ALL getting better and cheaper. Above all, the friction and ergonomic shift of VR is too great to expect obsolescence to come knocking on regular gaming's door.

His idea for the mobile phone to be replaced with VR/AR is crazy. Phones are little hubs in our hands, with amazing cameras and nice screens for flicking through information with your finger. Agreeable ergonomics for our brains to absorb "chunks" of content or information, about the size of a phone up to tablet/A4 paper size. Something in our brains likes the compartmental properties of a page. Like since humans started reading and writing. The "size" of a virtual bubble or layered world floating in front of our faces, isn't tangible or agreeable enough for daily driving brain activity IMHO. Great for after hours fun though!


I think you are looking around you not in front of you. The path now is to a thinner ski goggles looking form factor that supports AR through a passthrough video of where you are but with the ability to turn anything into an iphone or iwatch or 60" TV screen (try carrying that arround in your pocket). Wearing goggles will not be any more inconvenient or disconnecting than pulling out your phone at the table. One Apple leak hinted at an LED outward facing screen so people around you don't feel as strange including you in the conversation. The form factors will iterate towards human centered simplicity just like the possibility space of spatial computing enabled by these devices will iterate towards a more natural interface where information systems will conform to our world as it is in 3D rather than us being forced to deal with them through keyboards and mice and touch screens in our pocket.


But you have to also keep in mind that no one (except maybe Zuckerberg) wants to look stupid. Walking around with ski goggles would look so incredibly stupid to any normal human being, so you'd have to carry the goggles around in a case or a backpack. Even with a device the size of ski goggles (which none of the current tech can even come close to given battery sizes) AR/VR still won't displace cell phones or apple watches.

I don't think the form-factor is something they can iteratively approach for too long, given the absurd amount of investment Meta is already throwing in to building the next generation of still insufficient AR/VR. Investor appetite will not last long enough to realize the pipe-dream.


I think there’s a real issue here, but it’s not looking stupid per se. Facebook and similar addictive products get very very large per-user engagement, and this works because people use their phones while being just enough present in the real world to walk places, ride public transit, drive (!), go to restaurants, go on dates, etc.

For this to work with a device like the Quest, users need to simultaneously be present in the real world and consume content in VR/AR. That could work in pure AR applications (albeit potentially quite awkwardly), but VR might have fairly fundamental issues such as losing the feeling of presence in VR and motion sickness.

VR is neat. AR is neat. Getting people to use VR for 10 hours a day while pretending to do something else may be a challenge.


"Stupid" and "normal" is something that changes over time, sometimes very rapidly.

My bet is that it'll be the little apple logo on AR gadgets that'll normalize them.


AirPods look stupid, but here we are.


I still find them mostly a gimmick. They're a very good identifier for yuppie-like people, though, which one could say that it adds to the "stupid-looking" thing.


I don't know how you can possibly believe that. Not only are they (or inspired-by-them products) almost ubiquitous in many areas, people love them and rave about them.

The Airpods (or at least, that product category) are probably the single greatest new product I've used in the last 10 years. And I use a lot of products. They have given me always-available access to audio, easily, whenever I want.


Most probably because we live in different areas and are also part of distinct demographics. I live in Eastern Europe and I don't have that many IT people as close acquaintances and friends, in those circles of mine "always-available access to audio" sounds a little quaint.


"Always-available access to audio" is a fancy way of saying I can listen to Whatsapp messages or watch YouTube videos anytime I want without bother anyone. Not to mention listen to music or audiobooks.

Not sure what sounds quaint about that, it sound to me like how most people I know use their phones. And while I have a lot of people I know in tech, it's by no means everyone I know.


But you have to also keep in mind that no one (except maybe Zuckerberg) wants to look stupid.

We're already there. We have people walking around with iDweebs in their ears, talking to themselves, while looking down at a phone screen.


Until recently, I worked with high schoolers. Many of them felt absolutely no social discomfort at wearing earbuds while having a face to face conversations. It wasn’t uncommon for a kid to very quietly listen to music during a conversation. This is AR in a different sense, and I expect the social discomfort of AR glasses/goggles will similarly be generational/cultural and fleeting.


agree. There's a tipping point in utility and then things flip very rapidly. We don't have to reach frameless spectacle level, anything that gets in range will get us to the point where it will suddenly flip.


I remember a time where wearing earbuds or headphones was sorta stupid. Nowadays everybody does.


Were else are people having good conversation about this?


Its a good question and I don't have any handy answers other than a loose distribution of twitter accounts and subreddits although if you want a single source to plumb through there is an amazing store of knowledge in Voices of VR podcast by Kent Bye [1] run through his archives for a thoughtful discussion of almost any topic in this space.

[1] https://voicesofvr.com/


>A VR headset would have to be sunglasses size

From what I've gathered, this is the Meta AR target for the early 2030s. What we see now are intended to be the steps along that road.


VR is too early to be the meta of the future because of the fact we would need something that is completely standalone , have the performances of the valve index including the computer that goes with it and the price of the Oculus Quest 2. If they instead attempted to only focus on software similar to how Google made Android it could have gone better but his strategy was too early to execute . Also, I think that it’s just that they don’t have a platform it’s also that they have basically everyone that could see an advertisement that has signed up with Facebook / WhatsApp and Instagram so they don’t have the ability to grow their advertisements. This is something he had to do which was to give internet to places that didn’t have it but you would have the ability to access Facebook for tree.


So what did he do in 7 years? Ideas are cheap. Maybe the company didn't execute so well due to the bloat and inertia, or maybe the brand itself had other vulnerabilities which are missing from this vision.


It's due to to technology like Newton from apple. There is nothing u can do about it


Recognizing the technology wasn't going to be available in 10 years in a 10-year plan seems important. But you can't expect that from somebody who might legitimately think building hardware was as easy as hacking software.


I agree that he is way too optimistic. And from what I heard from Meta's employee, their hardware org is just not that good and the high level direction is very lacking.


Someone on HN once said (perhaps fact check this), it took Steve Jobs 7 years from the iPod touch to the iphone. Time perception can be skewed.


The iPod Touch and iPhone were both introduced early in 2007. Perhaps you are thinking about the iPod which was released late in 2001.


Ah yes sorry.


It's the iPad concept that came first, in the early 2000s, and they had a prototype for multitouch display.

Then they decided to work on the first iPhone for several years after that.


It's pretty obvious to everyone so I wonder what really happened. Once people received this mail did they tell him to his face that he was partly wrong? Or decided to just support his vision? Because among tech people I talk to, there is no single person who believes VR is the future, unless a major breakthrough happens that would eliminate all heavy inconveniences that make it almost unusable for the majority of population for more than half an hour.

AR is a vastly different beast as you need to move in the real world and receive sensory input from your device. People have been using Google Glass for over a decade and already have a feeling of what this entangles if you take just vision into account. To eliminate all awkwardness you'd basically need an advanced implant that wouldn't stand out - but I'm not sure anyone would want such a thing.


> I think VR gaming makes regular gaming obsolete in many ways.

If this was ever going to happen it would have already happened in the last (or is it still 'current'?) VR hype cycle. Maybe in the next cycle 15..20 years down the road or after some massive gaming crash it's worth another shot.


It will never make gaming in current form obsolete. Not in 50 years. Just for the fact that you need to put something on your face..

Maybe some people will use a VR set instead of a Wii U for activity / family games but thats it.

What VR is doing is it makes some genre of games a lot more attractive: Sim-racing and flight-sims. The cockpit games in VR are really immersive. Combine it with some good hardware (rig, stick, wheel, etc) and you feel like you're really in the car or plane.


Wholly agree on the immersion: a decent VR game, even if janky, has a great advantage in immersion by actually feeling _present_ in whatever virtual world you're in.

Two examples I'd add: VTOL VR, somewhere closer to the Sim genre but simplified for VR controllers. I've played a few flight (combat) games before, but the combat is heart-pumping unlike anything else. Another more popular one is VRChat and similar, where there are desktop versions but you definitely feel like you're missing something without the VR aspect. Emoting, gesturing, and actually "touching" others in VR is easy. If you're in desktop mode, you're mostly limited to standing nearby and talking.


doesn't obsolete them, but they won't be made worse by putting them in VR and adding some depth and ability to look around.


Unless the problems with nausea are fixed, VR definitely makes most 1st person games worse.


I guess it varies from person to person, but normally what causes nausea is the motion. If you fix the camera and let the character roam around there should be minimal nausea. But then you're a little more limited in your gameplay.


Once smart glasses are the same weight and experience as wearing regular glasses I believe like many they are the next iPhone. The amount of innovation that can happen with smart glasses will be so cool and useful. I was just at a zoo looking for the small animal blending into it's environment in their glass cage ... I wished I had smart glasses that pointed out where in the cage the animal was.

While I was playing ping pong I wished I had smart glasses that kept score of the game.

Tons of ideas that many to millions will find very cool and useful! I can see why Zuckerberg is betting the farm on smart glasses! I don't think Meta will create the next iPhone/smart glasses, but good for him on trying.


> But instead of making Oculus the "XBox" of the future

I don't get dizzy or have to stand up and move around to "sit down and veg out" on Xbox/PS/etc.


God for you. I can't play majority of first person games on PC without getting dizzy.


Facebook Research has indeed made a prototype for a sunglasses-sized VR headset! https://research.fb.com/wp-content/uploads/2020/06/Holograph...


The first time I saw VR in was in Lisbon at FIL 1994, people were trying to play Doom with the current technology of the day.

Every couple of the years we get lighter headesets, the marketing cycle that now the adopting is finally going to take off, and then crickets.

Until we get something like Star Treck's Holodeck, the cycle will continue.


The sheer cost of VR platforms would make it non-ubiquitous. People in developing countries use mobile because it is that versatile, and that is why mobile is the king currently. I don't see how AR/VR platforms will ever replace that in next 10-15 years.


I don't believe for a second that smartphones in their current black-mirror form is going to stay, maybe for the forseeable future, but I'll be surprised if we're still rubbing our greasy meat-sausages on glowing plates of glass 10 years from now.


For how much FB subsidized VR headsets, they should have double down on Android phones with their own appstore. At least they seem better positioned than Microsoft who had to get OS to comport with Windows and Amazon.


No one wants to wear a clunky device on their face for hours for entertainment.


Except for about 15 million people who bought Quest 2, and at least 5 million who got PSVR


I wear a headset for hours of gaming if the game is compelling enough. The experience for well done VR games is worth it.


Literally millions of people do that.


A lot of the big CEOs repeat a mantra that they are really on the edge of destruction. I've heard that from 2010s Google. It is just a motivating chant.


Given the high turnover of companies in the Fortune 500 - these big CEOs aren't wrong.

The changing of order is inevitable.


> A VR headset would have to be sunglasses size

We're getting very close with products like Nreal Air.


if Oculus stayed independent we'd all be dead because palmer luckey is crazy apparently


You are absolutely dead wrong about VR gaming and sales show this.


In my experience "dead wrong" is also wrong. I don't believe VR will ever obsolete some swaths of gaming, but there are certain VR experiences that leave the conventional-gaming alternative feeling utterly worthless by comparison. The feeling of "actually" jumping into the cockpit of my spaceship in Elite Dangerous during the COVID lockdowns was intense, joyful, and freeing in a way no picture on a monitor could ever replicate.

However VR is still an emerging and expensive medium; I'm very lucky to be able to afford the gaming rig, headset, controllers etc required to have that experience. As those barriers to entry lessen, VR will absolutely obsolete certain traditional gaming experiences as much as television murdered the ubiquitous living room radio.


That statement is way too definitive. VR gaming and sales are low because content is low. It's plagued with the cold start problem of all new platforms where publishers won't target VR because it's a small market, and VR won't grow because the game selection is very limited. When a major publisher pushes something to VR, it's usually an half-assed port that fail to leverage the completely different user interface.

If we had 5 games with the polish of Half-life Alyx in VR the sales would probably be higher, but as it is we don't so everyone I know with a headset enjoyed that one game then promptly put their headset back in storage and only take it out for the occasional beat saber game.


VR gaming also suffers from having a stationary gamer. Sitting still and looking around only really works for certain game types. If I’m always looking forward, how is VR adding to the experience?


Beatsaber and other rhythm games are very dynamic. I think the problem is more that the things I would want to work well in VR don't always work well. (But there are probably lots of amazing dynamic things like Beatsaber I never would have thought of.)


In beat saber you don’t need to walk around the, the targets come to you. It’s very static in that sense.


Immersion. I know it doesn't sound like much, but the hindbrain doesn't care.

There's an unofficial third-party mod for GTA 5 that adapts it into a VR game. Even though you still use keyboard and mouse to actually move around, and so gameplay-wise it's the same game, it feels much more intense. Oh, and the ability to actually aim down sights in a way that no screen can simulate is awesome (and I'm looking forward to games like Arma pushing this even further by accounting for focus distance etc).


90% of my VR gaming is standing up. Resist, Beat Saber, Pistol Whip, Walking Dead, Zombieland, Shadow point, Until You Fall, Racket NX, and Kingspray are all 'stand and move around' games for me.

I feel like your statement is reversed: flat-screen gaming suffers from having a stationary gamer. VR is freeing, assuming you have an area to move around in. Until You Fall is pretty wild when you have a 15x15 space to play in.


Sales don't say everything. I'd buy a steam headset if I could afford it at the moment. The main blocker is my lack of space and lack of GPU power. I would buy the quest, but doing any kind of business with Facebook feels dirty to me, I'd rather wait and get something from a company I respect.


How many VR games are as good as Half-life Alyx? Adoption needs to reach a certain threshold before publishers sink money into AAA content


VR gaming is so bad. My bet is it instead takes off in business, social media/doomscrolling, and AR assisted technologies and productivity.


I dont think VR ever takes off. AR will once you can wear a headset that looks like sunglasses.


Some VR gaming experiences are very compelling like Saints and Sinners or Cosmodread.


i tried cosmodread on a friends quest 2 and it made me shit my pants oh my gosh


What position did you infer about gaming from the post? That the poster says VR games are successful or unsuccessful?


> What position did you infer about gaming from the post?

> I think VR gaming makes regular gaming obsolete in many ways.


Ah, thank you!


If I had a grand to blow I would absolutely get an Index.


Not really the worst strategy. You can totally see where he was coming from. He just vastly overestimated how far VR could go in even 10 years of heavy investment, if ever. No amount of heavy investment, even for 10+ years, is going to make AR or VR as ubiquitous as mobile.

You would need a headset so small and light it's not too far off from a pair of sunglasses. It needs a battery that runs all day. It needs to not get hot and burn someone's face. It needs to be fast and responsive in terms of both local processing and network data transmission. It needs to be inexpensive enough that everyone on Earth who currently has a smartphone can afford one. And, he is correct, it needs to have apps so compelling that people find hard to participate in society without one.

It's not even a guaranteed thing that such a device is even possible. Even if it is, no way would it be ready for 2025, maybe not even 2035.


Another requirement that seems to get ignored is that you need to have the overwhelming majority of the public not feel sick when you use it. I recently had a friend bring a VR headset to a party for people to try out. About 15% of the people who tried it felt dizzy or nauseous after using it. (I did not try it because I know from experience I'll have a headache and be dizzy for hours afterward.)

Interestingly, similar to seasickness, the women who tried it seemed waaaaay more likely to be negatively impacted. Which opens up an entire other can of worms, such as: could an office get away with mandating the use of VR tech for meetings, when it has disproportionately negative impacts on women? (As a woman, I certainly hope they would not even try this!)

And as far as voluntary public adoption, having ~15% of your friend group unable to use a product is a fantastic way to kill network efforts. I doubt TikTok would be popular if 15% of the population got horrible headaches and nausea after watching a video on the platform.

Shockingly, no one seems to be talking about this aspect of VR. Which seems to be a really big red flag.


Most of the VR software I've tried have anti-nausea features like teleportation and unmoving frames of reference, so I'm not sure it's fair to say that no one's talking about it.

I think the hope was that some combination of hardware and software would solve the problem.


My understanding of what causes the nausea is the render latency. The brain thinks its been poisoned due to our vision and the vestibular system misaligned, and so it triggers nausea to expel the poison.

I am skeptical we can get hardware fast enough such that these systems don't trigger a false positive for all people.


I haven't suffered from this but anecdotally proper calibration as well as better tracking and frame rate do have a significant effect on whether people suffer such side effects. The Quest series (which if it was bought to a party is my guess on what was used) are great value for money and are competent VR devices (and leading in some ways) but they make compromises to achieve this and I wouldn't rule out the ability to comfortably use VR based on a bad experience with such a device.

Having said that I'd agree network effects for personal uptake are killed by "Just spend 3x as much on the headset and peripherals and have a computer that cost 4x as much and you can use it in a dedicated room you've set up your tracking lighthouses in".


I agree. I get motion sickness from playing FPS games. The symptoms improve, but it takes a while to adjust. Some people have no problem with it, whereas for some it is completely impossible to overcome. It's hard for me to see broad adoption of VR with the current technology.


Nausea is definitely in the spotlight for John Carmack who’s the progenitor of a shockingly large percentage of all 3D game engines, starting with Doom. He’s a performance tuning genius and nausea has been one of the biggest engineering issues he and his team have tackled. A brilliant CTO cannot make a hard problem go away, but he and his team have been able to move it to a far better place than where it was back when I tried the DK1.

You raise excellent points and it’s plain to see that John’s work has put him at the fore of violent masculine tropes as entertainment. The whole idea of endless slaughter of “evil” humanoids feels a bit more wrong than it used to, and certainly wouldn’t be the mark I want to leave in the world. I’m not calling him an infamous misogynist, but he’s no infamous feminist either. I hope that people keep holding people to account, and I hope for their sakes they don’t intend on leaving behind 15%+ of their market simply due to malicious or incidental ignorance. I hope a lot of things for them though lol.

I did some brief fact checking for this and came across an ancient 4chan screenshot. I debated sharing it but I think it’s good evidence that these discussion has been in the public conscience for a long time:

https://imgur.io/yDqMRxw

Research confirms your concern:

https://venturebeat.com/games/a-survey-about-vr-sickness-and...

If some make decision maker forced an organization to adopt VR and it’s women found it unusable, I would think that ADA would be a route through which there should be grounds for protections and accomplishments.

Frankly, it’s not fully fixed, and it might not be fixable. Our bodies are far more clever than the gods of gaming have presumed. We do proprioception with our toes and ears and sense our surroundings with the tiny hairs on our arms. As long as VR creates dissonance for processing info from the nervous system the more the cerebellum starts to get cranky, and tipsy.


> for John Carmack who’s the progenitor of a shockingly large percentage of all 3D game engines, starting with Doom.

First of all, Wolfenstein 3D, which used Carmack's engine, predated Doom by a year, but even Wolf3D wasn't the first 3D game or 3D engine. Activision's 1991 Hunter and Mindscapes's 1988 Colony both had very similar graphics and play as Wolf3D. 3D gaming and FPS goes back at least to Atari's 1980 BattleZone, but most place FPS origin with Maze in 1973.[1]

Second of all, by my count, Carmack developed (or also worked on) six distinct 3D game engines. There are an awful lot of 3D game engines now, well over 100 listed here.[3] I think by "shockingly large percentage," you must have instead meant, "small percentage." Maybe Carmack holds the world record for most 3D engines developed by one individual, but it could never be a "shockingly large percentage of all 3D game engines," even with id's OSS releases and subsequent variants.

[1] https://en.wikipedia.org/wiki/Maze_(1973_video_game)

[2] https://en.wikipedia.org/wiki/List_of_game_engines


I should have been far more specific: FPS, and not quite _3D_ at the outset...

You're quite right, especially relative to what I had stated. Its just that the impact of John's decision to GPL Doom and Quake engines gave rise to a tremendous ecosystem that many people don't realize. For instance, GoldSrc which forked Quake is the foundation for the Source and Source 2 engines which power at least 60% of all hours played on Valve in the last 30 days. https://steamcharts.com/top

His patterns have been wildly studied and reused. The word I did use carefully is progenitor. Id engine's direct impact is relatively small, but its legacy is vast.


What kind of VR headset was this? In my experience Quest has the most comfortable experience ever and I’m prone to nausea.

Disclaimer: I used to work at Oculus.


I've tried an Occulus at a salon a few years ago, got very sick after five minutes. The game I tried was SuperHot. I genuinely hated it.

I will only reluctantly try again a VR headset; this is unfortunately not the kind of sickness you forget.


Quest/Quest 2 specifically? Rift S? Rift CV1? Or the original Rift? I ask because the software and hardware has improved drastically. I'd be pretty surprised if you get sick from a Quest.


I played that game and didn’t get sick at all. It was actually really fun and i was crawling on the floor sometimes


Additionally, as someone with very small pupillary distance, none of the existing headsets on the market are applicable to me. At this point I've written off VR entirely as I don't think any company will ever design for someone like me.


We had a VR excitement 'bubble' in the 90s. Loads of headsets came out, games supporting them, etc. It all died out within a few years. I guess people like Mark thought the reason for the die out was that the tech wasn't there yet. But the reality is that VR is not the future, people just don't want it. Nobody wants to live their entire waking / working life in a VR headset. But that seems to be what Mark is working towards. He's thinking people will choose to work together via VR rather than just plain old video conferencing.


> But the reality is that VR is not the future, people just don't want it. Nobody wants to live their entire waking / working life in a VR headset.

I think you're wrong.

From this[1] great essay about mainframes:

> Ultimately, there are only two natural kinds of computers: embedded systems and mainframes.

And this is so true. People have moved from personal computers to laptops and are in the process of moving to phones[2]. Smart watches seem to be a promising device; we'll see if people can put enough functionality into them to obviate the need for a phone.

Of course, not all tasks are suitable to be done on a phone or a watch. But one way to think of VR is a desk setup with huge monitors that happens to be extremely portable. Of course the promise of VR is much greater than that, but that is a pretty important use case - a use case that would obviate the need for laptops and desktops for many if not most tasks.

---

1. http://www.winestockwebdesign.com/Essays/Eternal_Mainframe.h...

2. This isn't to say that the shift has been complete at all. Many people, including me, continue to use a desktop setup. And laptop use is still quite strong. But the derivative is ultimately what matters.


It's been 20 years and NOBODY is doing business in VR even though the tech is amazing right now. What's missing? At what point do you think normal people will prefer VR over just using video conferencing for work meetings? I don't see it and I'm willing to bet money that we won't have amazing Meta VR with 100 million users in the next 5 years.


> even though the tech is amazing right now

Have you ever tried to work in VR? It's not amazing at all, my Quest 2 (which has reasonably high resolution per modern headset standard) just can't render clearly enough for me to use VSCode. I tried it and it was just not there yet. Double the pixel density and you would have something I would consider using.

I'm not necessarily convinced that we'll do all of our meetings in VR ever, but it's reasonable to say that tech still has a way to go before I'd call it as "VR is the issue".


I think Meta would disagree would disagree with the assertion "the tech is amazing right now." The two easiest problems to point to are a) resolution on most consumer headsets is far too low to read text effectively, and b) the ergonomics just aren't there in terms of weight and size.

Pretty big problems - I don't really have any argument either way on how solvable they are in 5-10 years, but I really think the implication that people dislike the concept of working in VR itself is misguided.


Size and weight has been going up over time: https://i.imgur.com/2fOAFqI.png There's no evidence we will reach the mythical lightweight glasses any time soon. I believe that is needed for VR to be accepted on a scale similar to cellphones.


The tech is amazing for us VR enthusiasts, but I don't think it's really at the point where it can impress the average person beyond a short whale demo or beatsaber game. You're either tethered to a wire, or a 3 hour battery life (Which degrades pretty quickly). Resolution still isn't good enough for reading text at a reasonable scale. Narrow field of view. Hot to wear. The fact that they are fixed-focus creates some weird depth perception issues in many people for up to 48 hours after use until you get your "vr legs".


The tech is super early stage, having worked in VR for 6 hours a day for a month I can tell you it's very barebones. This tech is nascent, hell the oculus quest only came out in 2019.


With reference to the 90s VR boom, the grandparent was calling out this very comment as demonstrably false, well before you had even posted it. What magic is that?!

For sale to consumer VR headsets have been available commercially for about 35 years. Is it really reasonable to call a consumer tech product category that's been around for 35 years "early" or "nascent"? Look at something like the EyePhone (yes, that was its name). How is that not the very same product category as a modern VR HMD? Of course a modern HMD is better, but not fundamentally a new category of device. This shit is ancient by tech standards. It's had almost 4 decades to evolve since its consumer debut.


I mean we had smartphones in the late 90's and early 2000's and they didn't take off until 2010 so yes. That's where I'd put this, now we're waiting for VR's iPhone moment.


What is your definition of “a user”? Is it a daily/weekly/monthly active account, or based on activated device?


>And this is so true. People have moved from personal computers to laptops and are in the process of moving to phones[2]. Smart watches seem to be a promising device; we'll see if people can put enough functionality into them to obviate the need for a phone.

One of these shifts is not like the other. The laptop can, in principle, do everything the desktop can. The speakers and mousepad are kind of limited, but peripherals erase this barrier too. A phone simply doesn't have the text input rate of a keyboard, which I'm feeling intimately right now as I tap out this comment with my right thumb. Strap a keyboard to the phone, now the screen is too far away. It might as well be a laptop.

You can run a business on laptops. Currently, businesses still use desktops mostly because they're still significantly cheaper at equivalent performance (and maybe harder to steal). But on phones? That's nowhere near practical. The keyboard has yet to be disrupted; voice input is antisocial unless you have your own office.


> But the reality is that VR is not the future, people just don't want it. Nobody wants to live their entire waking / working life in a VR headset.

This keeps getting repeated but aside from "it's not the status quo", I see little evidence for it. I'm sure nobody wanted to spend their entire waking and working life sitting in front of a computer screen back when PCs came out and yet here we are...

In the off chance that VR does work out, Meta's going to be a huge benefactor.


>I see little evidence for it.

Besides the fact that only 50 people are in the Metaverse right now? Literally nobody is using VR for meetings and work and stuff. Nobody likes being cut off from all real human interactions. At least with a video call I can see your face and you can see mine. VR? it's just voice chat with a stupid headset.


Absolutely. After covid, people are craving physical contact and outdoor activities. Travel and tourism is trending up. This idea that people want to put on a headset and stay indoors, netflix and chill or whatever is not happening. Maybe the niche hackernews/reddit crowd might prefer to avoid social contact and put on a VR headset, but I'm not seeing that in the local restaurants, bars, shopping malls, concerts, and theatres. They are crowded.


VR isn't just meta. There's 20k people in the Steam version of VRChat at the time of this comment.


These are all problems that people are working on. There is no reason they cannot be solved.


A few 10s of billions of dollars along with a bunch of super smart people haven't made much of a dent, so I don't think vague assurances are going to cut it. Nobody can predict what technology will be like in a few decades, but I don't see any reason to be particularly bullish on VR. At this rate, even if it does happen at some point, Meta likely won't be around to see it.


They've literally made massive progress inside of 5 years. I don't know that we're watching the same space.


The goal is for VR to become a dominant platform and their progress has been far from massive. Some technical advancements along the way are nice, but won't matter without large numbers of users.

How many people visit the metaverse multiple times per day?

What percent of the population spends hours per day in a VR headset?

The answer to those questions needs to be much better than "miniscule" for this project to be any sort of success.


>> Nobody likes being cut off from all real human interactions.

> There is no reason they cannot be solved.

Explain?


The goal is not to replace human interaction, it is to replace phone calls and video chat. To make the experience better than those things is not an insurmountable task.


That would be great if Meta was a VC fund placing hundreds of bets in the hopes of a moonshot paying off. But a (formerly) trillion dollar company placing such a big bet on such a small market is very surprising.


This is what I have an issue with.

This is a side project. Something to make sure FB has a foot in the game for when the technologies make "it all" (whatever that is) possible.

Part of me wonders if this is a decoy - look over here! While I do something useful elsewhere.


Using a Quest we're clearly not there yet but we're also clearly far closer than a VirtualBoy.

Saying we'll "never" get there, or that we couldn't get this into sunglasses-weight, does seem unrealistic. If joining a meeting was as easy as dropping on a pair of glasses, and I could "focus" on (virtually) further-away objects instead of just a computer screen in front of me, it would be pretty powerfully appealing.


Joining a meeting right now is as easy as clicking on 'join' on your phone or laptop. I can then see everyone in the meeting and they can see my facial expressions etc. VR doesn't add anything useful and removes a lot of social cues visible on video (or in person). I don't see why I'd accept employees joining a meeting using an avatar instead of showing up 'in person' (on video).


You're arguing about the experience today, not what it could be. I definitely don't want avatars.

I want this meeting to have higher immersion representations of the rest of the people in the meeting than boxes on a screen. I want to be able to shift my view to focus more on individuals. I want to be able to have a meeting with 40 people where I could still focus on a single person and see them with high-fidelity, instead of just having 20 of the boxes at low-res in front of me, with the rest off-screen. I want less eyestrain because I'm not just staring at a flat wall but my eyes are moving and shifting and re-focusing more. I want to have depth to things. I want the ability to have a quiet side convo off to the side. I want the ability to write on a whiteboard off to the side that people can look at when they want instead of taking-over the entire viewport for everybody. All things I could do in the real world, but would be very hard to make seamless without a real-world interaction model.

Again, we clearly aren't there yet. But it's easy to imagine something better than what we have today.


How are you going to wear a headset without compromising face to face video? I can't even imagine a theoretical solution and not a single company is working on this problem. Am I wrong? Obviously on a very long timeline you can solve this problem but the next 5 years? No way.

>I want the ability to have a quiet side convo off to the side. I want the ability to write on a whiteboard off to the side that people can look at when they want instead of taking-over the entire viewport for everybody.

None of this requires VR and is available in, for example, Jitsi video chats.


My standard for the future (10+ years out) is "if i have to hit the keyboard or click the mouse it's failed." In that case I'll definitely still want to go back to in-person collaboration.

> How are you going to wear a headset without compromising face to face video? I can't even imagine a theoretical solution and not a single company is working on this problem. Am I wrong? Obviously on a very long timeline you can solve this problem but the next 5 years? No way.

My best guess of what this would look like would be much closer to glasses than a full headset (no "sticking" to the face) with very good ultra-wide cameras + image processing to capture your face and upper body language at the same time. Maybe toss in a desktop-mounted webcam too. Not 100% immersed/blackout, but quite possibly good enough to be better than a flat monitor with also isn't 100% of your FOV.


Video chats drop body language, natural speaking cues, reduces the quality of group conversations and more. VR even with some of the tech today restores a bit of that and gives the feeling of presence. I'm excited to see where we're at with it in 10 years, I agree that today we're not there.


Video conferencing sucks. It's so much worse than a conversation with physical or simulated physical presence. I'd much rather have that sense of presence and having experienced that in VR I can say if the tech improves people will likely go for it.

You lose so many cues, tells and deep interactions that you get with a physical presence via video call. I have seen VR start to solve some of these and I think it will be pretty big if we get to the point where the cartoony graphics are ditched.


What visual cues or tells would you LOSE with a video call, but maintain with an abstract avatar?


Body language is the most obvious. You don't even need very expressive avatars before certain things we naturally do in person become useful tells. I've had multiple conversations in VR, they flow much more naturally than video chats based on the sense of presence.

The quest pro just added expression tracking as well so now you have body language and normal emotional expressions. Wayyyyyyy more natural feeling than video chats, even if I'm seeing an avatar of someone and not their actual face.


Okay Mark. I'm sure body language and facial expression from an avatar is better than video of the actual person...


Clearly you've never tried it. You do recognize you get no body language at all with current video chats right? One of the many reasons I think current teleconferencing is terrible. Like you just get a head 95% of the time.


VR in the 90s sucked pretty hard


It's interesting that you have identified exactly the same shortcomings that mobile had when the first commercial mobile phones came to market in the 80s:

- size

- weight

- battery life

- heat

- network reliability

- cost

These were all eventually overcome, incrementally. However, it did take about 30 years for that to happen, so 10 may have been a bit optimistic.


At least phones don't transform to paperweight once an algorithm running inside a server of a mega American corporation deems you unworthy.


Another required quality that might be surprisingly tricky to get right is durability. Sunglasses are notoriously brittle, and I can't for the life of me keep sunglasses in good shape for more than a few months. I don't know if there is any great solution besides fundamentally altering the form.


The majority of durability issues of glasses are the hinges. So as long as you can make that part of the frame repairable, I feel like it could be manageable.

Not that there aren’t a bunch of other issues for every day wear. (I wear contacts for vision correction because I find glasses very annoying).


> So as long as you can make that part of the frame repairable, I feel like it could be manageable.

It also has to be impossible for failure of the hinges to lead to damage of the electronic components. I've lost multiple laptops to hinges twisting in ways that they shouldn't have and fracturing the motherboard or keyboard, and that's in a form factor that gets much less abuse than glasses.


> The majority of durability issues of glasses are the hinges

citation needed. For me, it's the scratches and the surface issues. Even though I have no problem taking care of my regular glasses for years, most of my sunglasses become unusable and hard to see through from deteriorating surface and scratches after 6-10 months. No matter if I get $30 or $300 ones.


Isn't that just sunglasses manufacturers simply cheaping out on lens materials and coatings? I don't see what would be stopping VR/AR manufacturers from making quality lenses.


If you wanted to you could make a pair of sturdy sunglasses, I think they are designed to break right now.

With regard to AR glasses, I would put the expensive part in my pocket like a phone, and the glasses would be just like the wireless earbuds, easily disposable / replaceable.


I'm really surprised I haven't heard this more often, because it seems like a given. AR glasses should be trying to offload as much work as they can to the supercomputers we carry around in our pockets. They have a much larger form factor that can support more compute, more battery, a better antenna, etc.

edit To be clear, I don't think we're anywhere near having cheap AR glasses that can just delegate all the work - rather I think there's so much compute that's necessary, we need the combination of what we can fit onboard the glasses and in our phones to make a compelling product.


They're not designed to break, they're simply picking the trade-off point that tends towards the "lightweight enough to wear all day" end of the continuum.


I don't believe it. I have this pair of safety glasses I bought from the hardware store for $5 and they are super light weight and rock solid. I could wear them all day and not even notice. Sometimes I even forget I am wearing them and wear them around inside for a while when I'm finished my work.

If they had some tint and UV protection and I would consider using them as shades.

update: I talked myself in looking at the hardware store website and my next sunglasses will be be some 3M safety glasses with a dark tint and uv. And less than $20.


Those aren't prescription glasses are they?


The counter argument is that they have sank billions into this with top tier optoelectronic engineers working on realizing the vision. It is about as good an effort as you can reasonably get. If they want to go further, they will have to start building out their own exotic semiconductor basic research labs. Perhaps their only mistake is not scaling up the hardware R and D earlier.

One potential play is a joint venture with Apple, unpalatable yes, but they are the only other large scale consumer electronics company with the EEs and hardware talent needed to execute this. I doubt even the military and government research labs can do a better job.


If there was something like a join venture between Apple & FB, it would be incredibly compelling as a software engineer interested in AR/VR to go work for them on it.


They will probably pay you less than what you can get in other divisions. Nobody I know chose to work for Apple for the total compensation.


> It's not even a guaranteed thing that such a device is even possible. Even if it is, no way would it be ready for 2025, maybe not even 2035.

20 years of mobile phone development gave us things that we could barely have imagined back in 2000 or so.


I don't think that's true. We were imagining them, and even trying to build them -- the hardware just wasn't capable of it. Newton, Palm and Handspring showed us the way, and those platforms died on the journey there. Apple arguably only added capacitive multitouch to the mix, apparently the last big piece of the puzzle to make mobile devices natural and fluid (OK, wireless networks weren't quite there when the original iPhone came out).

I'd argue that there are many, many puzzle pieces still needed to begin imagining an AR future. While the Newton showed an incomplete vision of its future, it begged all the right questions. My kids Occulus Quest, on the other hand, just makes me feel motion sick...


> My kids Occulus Quest, on the other hand, just makes me feel motion sick...

This feels like the similar kind of problems of understanding how to accommodate the human into the platform. Early mobile platforms were just "desktop, but smaller". You were expected to interact with the device using a stylus. Small checkboxes and UI elements were common. The device needed to regularly tether to a desktop.

Lots of VR games still allow you to move/rotate using thumbsticks. Part of it is that these games are ports of desktop experiences that wouldn't work any other way. Over time developers will better understand what works and what doesn't, and will design games/apps that don't make you nauseous.

There's also likely a bunch of vision problems that still need to be worked through. I have no expertise in VR but with my limited usage it feels quite close, and I think these problems are not insurmountable.


That's because the form factor of an iPhone is not fundamentally different from a 1998 Jornada.

All we had to do is keep putting different stuff in the box.

What if we changed the rules altogether? Suppose we demanded a phone that was a slab of glass. Literally. A rectangle of glass that you could see through. No visible antennae, no visible battery, no visible circuitry. when you activated it, you saw the same hi res and bright screen you see today on your ios or android device. Now the battery has to be clear. The antennae have to be clear. All the circuitry have to be clear.

Could we get that in the 20 years from 2002 to 2022? Probably not.

And AR glasses would represent a leap that goes even further than that. I'm not saying it can't be done by 2035. I'm saying they would have to get extraordinarily lucky with battery chemistry and display tech to have any chance of making an AR glasses product that did not have serious drawbacks by that date. They'd have to get so lucky that I would feel comfortable betting against it.


That’s a little bit of an overstatement don’t you think?

From the top of my head I can think of GURPS, Shadowrun and Cyberpunk all imagining very thoroughly things that both Mobile and VR gave or can give us, just to mention games that have been highly influential to the generation of people working on these technologies.

There are also loads of books, Asimov’s works have probably been the most influential, almost prophetically, in the creation of today’s Information era.


I'd argue 20 years of mobile development has given us a more powerful Palm with a SIM card and apps including ICQ with encryption, Skype but viable on a handheld device, email with office apps on a small screen, networked games instead of single player, maps, destruction of privacy from use of spyware on apps reporting every swipe, view of contact one has.

I'd argue most enabling changes exclusive to mobile have come from video, which was already a concept, location, which was already a concept, real-time status (which is mainly Twitter and Twitter-likes) and bandwidth. The 'killer feature' at the outset being syncing music and a web browser with sufficient adoption to make saying no to IE 6's vision of the web, and Flash, viable.

But I'm keen to know what was barely imagined back in 2000. Is it shift to mobile devices for a consumption?


Everyone have a look at the NReal Air demo videos and tell me this isn't possible in 20 years of development. It's a bit rough, but it's a product you can buy today, and not at all vaporware.

Cramming a Raspberry Pi worth of computing power and battery into the glasses frame doesn't seem nuts for 20 years of development.


That's an unrealistic expectation based on a faulty view of recent history.

I had my first 'smartphone' in 2003. By 2009 I had a device in my pocket that could almost replace my PC at both work and home and didn't spy on everything I did. In 2020 I had a device that was utterly useless for work and had become little more than an entertainment device that constantly sends data back to the mothership.

While unlikely it is certainly possible that hardware will advance to meet the need but the problem lies in how we do consumer software now. Because the hardware isn't the real product anymore predicting how it will develop gets much sketchier.

Either way, imagining that one change means another is possible or likely is silly.


I tend to disagree more with your view of history than the view of history taken from the comment you’re replying to.

> I had my first 'smartphone' in 2003

For all intents and purposes, the first ‘smartphone’ didn’t exist until the iPhone existed. How do I know? Because essentially every smartphone on the market today looks like an iPhone.

> In 2020 I had a device that was utterly useless for work and had become little more than an entertainment device

This is what millions (billions?) of people want even if it’s not what you want.


In 2000, Moore's law was still going strong and had been for the past 40 years (Dennard scaling not ending until around 2005). At that time it was actually more difficult for people to imagine a future that did not include practically unlimited computing capability. I'm not just talking about the unwashed masses, even many experts and leaders in the silicon industry did not see what was coming - Intel released the Pentium 4 in 2000 and was saying it would scale to 10GHz+ in a few years (https://www.anandtech.com/show/680/6).


Yeah but we're dealing with the vestibular system here and other biological systems. It's apples to oranges.


I think that's Zuckerbg's point: he wants to be oranges. He certainly doesn't want it to be apple's.


I don't think the vestibular system is a solvable problem with VR but it is much less / a non-issue with AR. Thats why he always talks about VR/AR.


This reminds me of how the public viewed computers before Windows 95, or when the iPhone just came out. The flaws are many and severe, but you’d be shortsighted if you couldn’t see the potential


There's a quip somewhere about how the essence of futurist misprediction has been confusing unlike-in-quality and unlike-in-capability.

Unlike-in-quality is the same thing, only better. It rarely changes the world, because it's not an infinite value proposition.

Unlike-in-capability, on the other hand, is offering something that literally didn't exist before. It approaches infinite value, because it has the capability to reshape the world into one that requires its existence.

Mobile internet was unlike-in-capability.

I have a very uphill battle convincing myself AR/VR is more than unlike-in-quality.

Maybe the only thing that gets me there is persistence, but the rub of that is that its requirements all require bulky physical configuration and/or isolation.

At its worst, earliest form, a brick cell phone was still portable, and didn't isolate the user from the world around them.


VR/AR is more unlike-in-capability than phones. If the hardware becomes a pair of glasses that have no friction in putting on, then it can engulf capabilities of TV, phone, PC, anything that has a screen. And unlike-in-quality part would be to project stuff on real world, be completely in a virtual world, etc. There is nothing like it.

I just think that making the hardware is the toughest challenge. Zuck might be underestimating hardware progress.

If he is right, godspeed, future would be amazing. If not, we'll have net positive experiment out of this and it will accelerate AR/VR hardware dev.


> I have a very uphill battle convincing myself AR/VR is more than unlike-in-quality.

Have you actually tried it? VR in particular demos poorly for people where most of their experience with VR is Google Cardboard. Even VR systems from 5 years ago are dated. You have to try it, especially some notable non-gaming apps


Yes. I own several systems and am not susceptible to motion sickness.


Which ones because honestly I have a very hard time believing that based on your comment


They laughed at Columbus, they laughed at Fulton, they laughed at the Wright brothers. But they also laughed at Bozo the Clown.

--Carl Sagan


The current VR headsets seem more akin to the car phones or those huge brick mobile phones of the 70s/80s rather than smartphones. Lots of people saw its potential. But it was not ready for the masses.


and how long did iphones come after those? 20+ years


quests are/was outselling xbox


Indeed. I don’t consider it a flaw to push for something innovative and have it flop. That’s just the cost of being innovative and taking risks.

I could see criticizing Mark for betting the entire farm on it.


Even with 'perfect' glasses, batteries, networking and tracking, you're still faced with the problem that the virtual world is populated by intangible apparitions while real-world obstacles remain very tangible. And conceptually, none of the solutions to those problems are ever going to become cheap or convenient, because they're problems with basic physics.


> It needs a battery that runs all day. It needs to not get hot and burn someone's face. It needs to be fast and responsive in terms of both local processing and network data transmission.

The first AR glasses will be close to dummy terminals. For them to become feasible, wireless networking infrastructure has to become low-latency, high-reliability, and high-throughput – but not necessarily ubiquitous. There's no need to have powerful compute in a small form-factor if that can be outsourced to nearby servers, and this is something that could be possible in the confines of a major city, and the hardware would be rolled out much like another mobile carrier.


>You would need a headset so small and light it's not too far off from a pair of sunglasses

Why? You don't have to transport VR. VR is the complement to mobile phones: mobile phones are used when you leave home, VR is used when you don't leave home.

The big question is: Are people going to leave home or are they going to stay home?

My guess is that it depends on how much energy is available. If there is no infrastructure worth visiting for billions of people, then VR will become a success.

>It needs to be inexpensive enough that everyone on Earth who currently has a smartphone can afford one.

If work happens in VR, then employer will finance the hardware for their employees.


I tend to agree. His points feel pretty good to me. His assumptions are very bad.


I can see how his assumptions seemed reasonable at the time given that google glass already existed


Maybe. I thought we'd have more accessible shitty AR sooner. But VR has a lot of hard problems that don't seem solveable with a good hour of reflection in order to get it to the VR people see in movies.


With Apple allegedly joining the space in less than 2 months, and multiple sunglasses-sized devices out there already (nreal, rokid, etc), I think we'll know very soon whether XR has a chance of going mainstream this decade


I read this one of the previous times it was posted. I don't have a strong opinion about the metaverse either way.

However, this email on strategy is an example of something I haven't seen in any startup I have ever worked at. Usually the information is available in pieces in various places, PRD's, value statements, mission statements, whatever.

The pessimist in me also believes that most of the people I have worked with wouldn't even take the time to read such an email.

Anyway, all of this to say, I appreciate that it leaked and learned that there are people communicating in a way I wish companies I had worked for communicated.


Can you imagine this email from Steve Jobs?

Where is the end user? Where’s is the joy? Where is the reason why people are going to love this technology? Where is the practical example?

Instead it’s all business, but that business is worthless if you don’t start with the reason people want to use, embrace and even love your product or service.


On point. He's trying to make a product for his business instead of the user.

Edit: In addtiton it's amazing how early he identified his business weaknesses (platforms dependency and lack of innovation) yet decided to solve them in such a strange if not wrong, at least very risky way. How all those investments in AR/VR would improve innovation problems in the core business? Apple is able to innovate in his core business so it's not a company size or age problem. Instagram, whatsapp, snap and tiktok are all proofs that there's room for innovation in facebook family of apps. Moreover if you already struggle with innovation and your growth comes from the network effect of your platforms is it really a good idea to bet on such ambitious projects?


Yep, all business talk and generic tech hype. It's no surprise that it is failing if they approached this problem from a business and tech orientation, rather than looking at it from the customers point of view.

What problems does VR/AR solve that would want to make one wear an AR headset all of the time? Why do I want to wear one while changing my daughters diaper, or walking my dog after work? I see no problems that it solves.


I hadn’t seen this emails before. I’m surprised by how outward looking and myopic at the same time Zuck’s emails are, this one particularly so (the one about chat bots also comes to mind).

Ask yourself where you were in 2015 and see if you can get their take on VR or AR. For me it felt like magic. Like using an iPhone for the first time. Yes, VR and AR is absolutely the future. But social communication and media communication is just a myopic view on what the possibilities are! Interactive consumption is / was where it is at. A hybrid of games + educational experience was for me the quintessential experience a la Assassin’s Creed meets walking simulator.

I would love to just learn about places where I go passively with AR. I’d love to meet people and have fun stories shared via AR (as I proof read this, I’m not so sure about this but there’s potential).

Facebook absolutely should have built the platform first and if they did that developers would have come to build the apps. I’m surprised with 40k to 80k on staff they weren’t able make much headway into this until the past year.

Somewhat relatedly, did Zuck really write these emails in 2015? The color of the text for the date is highlighted weird. I’m surprised that the chat bot effort happened after this email. Perhaps, he figured chat bots would be a gateway to AR?

I think Zuck was focused too much on the control Apple and Google have on the average person’s eyeballs / pocket and on Facebook itself. The Facebook phone was an obvious attempt at trying to pry loose but they should have just kept at it. They could have built a Google Daydream like experience around their own Facebook phone.

All for the best I guess. I’m glad Facebook is failing. They have harmed more relationships with their algorithms imo than helped keep them together. The world might have been a better place if Facebook’s feed wasn’t trying to be so “engaging”.


I would love to just learn about places where I go passively with AR.

It won't go down this way. Wikipedia for AR will never happen. More likely it'll be thousands of ads and other crap.


If there's a good AR headset you'd have to be able to stop me (and a million other people) from forcing wikipedia onto the device. That might be a harder technical challenge than actually making the AR headset.


Sure but the vision/nlp models required to enable context-sensitive vision apps (i.e. an app to "give me facts from Wikipedia about what I'm seeing"), those models are closed and owned by big companies like Google and OpenAI.

The previous two computing revolutions "personal computers" and "apps/websites" were enabled by the openness of the OS and the openness of TCP/IP and browser vendors, respectively. If the next "AR/VR" revolution depends on complex vision models, there's no guarantee they'll be open for independent devs. And judging by the last few years, it's highly likely they won't be.

BTW I think there's good reason they don't release GPT-3 or DALL-E or PaLM or whatever. That shit is dangerous.

Edit: ok you can hack the hardware to let you run the models or make the necessary network calls to run them. That's still way different than Wikipedia which is a first class webapp where you don't have to hack anything to use it.


Amazon had a phone once too. Not sure doubling down on a phone is the right choice either.


The Fire Phone was expensive due to its 3D feature and had dated specs. Amazon also gave up on it very quickly.


Amazon gave up for very good reason. From what I heard from people working on it, sales were, well, not impressive. Like in hundreds of units.


Home devices were a nearer-term alternative, not sure why AR/VR had to be the thing.


I really like Ben Thompson's position in VR adoption - he compares it to the PC adoption. It was enterprise first, then consumers. Users learned how to use a PC at work, and once the price drops enough, they bring one home.

Thompson was high up on the Microsoft / Meta VR deal.

IMO Zuck has a great grasp of the trajectory of VR/AR in 2015. Meta is singlehandedly trying to will it into a common place. To some extent, they had succeeded way more than a lot of other commenters give them credits for. VR is way far prevalent than it was 2-3 years ago.

Oculus Quest 2 certainly wasn't driving the instant paradigm shift like the introduction of an iPhone in 2007 (15 or so years ago). Though you'd argue that precursors to iPhones were WAP phones, Blackberry's. They laid the ground work (Blackberry was also an enterprise-first adoption). As an interface, handheld devices are much closer to our familiarity with PC so the jump wasn't huge. Plus it has a killer use case -- everyone needs a phone.

I am very impressed by the clear vision in 2015 that we're still seeing it play out in front of our eyes in the VR/AR/Mixed Reality space. What hasn't happened or wasn't mentioned the killer use case -- the utility why people would need to be in VR/AR/XR mode.


On the other hand, I’m reminded of this talk: https://idlewords.com/talks/web_design_first_100_years.htm

The web and smartphone landscape in 50 years might very well look quite similar to what we have today. VR will remain a niche and most people will carry around a smartphone with even more capabilities.


This email makes such a bold assumption - that VR will play out like a repeat of smartphones. Or that some "next big platform" will. Is that guaranteed? Cars, houses, aircraft, boats, bicycles - all have mostly kept their basic form factors for decades, once developed and optimized.

I'm dubious that VR will ever be much more than a game platform. Certainly not a substitute for physical life.

Things you can't do in VR:

- have a normal tactile response to objects

- feel the acceleration of a vehicle

- feel the warmth of a fire

- eat a good meal

- eat a good meal with friends

- buy a coffee and get a buzz

- enjoy the smell of caramelizing onions

- get a lifesaving surgery

- have sex

- feel a comforting arm on your shoulder

- do something intricate with your hands and fingers, like carving something into a piece of wood with a nail; even picking up the nail in VR will be hard, let alone the subtle movements, grips and holds, and tactile feedback we take for granted

- experience nature, animals, ecosystems, and interact with them (as they really are, not cutesy programmed versions)


> - have sex

Let's be honest, they're totally gonna make AR glasses that deep-fakes your wife into your favorite waifu while you have sex.


It’ll be full VR. With the headset on you’ll be Hugh Hefner, but with the headset off it’s just you, this (https://youtu.be/qobhDJ_vEOc), and the advertisers selling anti-depressants.


- Feel acceleration of a vehicle

This is wrong, I know of a project where you sit in the backseat of a car, put a VR headset on that's connected to the car. There is a driver and you are on a special track in real life. Acceleration is real, but on the VR thingy you are elsewhere. Not sure if it was ever released.


Sure, and flight sim hydraulic rigs, etc. Not sure they're the next ubiquitous consumer platform.


you can do none of these things on other platforms that we interact with daily. doesn't seem to deter us.


Smartphones fit in less invasively to physical life though. And actually have an intuitive tactile element.


I think the fundamental problem they'll face is that VR won't be accepted beyond temporary engagement. You just can't expect people to exist in a virtual environment and ignore their actual physical reality for any length of time.

I would think our brains trying to maintain a virtual and physical reality at once for any length of time must get quite stressful. The virtual environment will be first to go (yes even augmented reality).

People want to still be connected to 'reality' and Mark's virtual goals create too much friction with reality for the sake of his geeky wet dream, at least to meet his scale for success.


This is why AR is the holy grail for all of the companies in this space. It just augments reality instead of replacing it


You see it this way because you are thinking in terms of an AR headset playing audio or visuals.

In a really well executed dystopian future, the AR glasses and headphones should not even exist and the thoughts should directly be injected in your brain.

You implant yourself a chip like Neuralink and Neuralink sends you electric impulses that gives you answers.

And then, Facebook and Google can directly read your mind and inject you ads.

Of course, they are going to respect your privacy "your thoughts never leave your local device" (except in the case of terrorism, and other related thoughts).

You are hungry, Google knows it, and suggests you a place to eat.

What a lovely future.


Dystopias are easy to envision and to craft as dismissals. Augmented reality is already here in the auditory realm. I can easily imagine dozens of ways to enhance my experience of the world without all the coercion and abuse you fear.


I think the problem is with incentives for the company who creates it, unfortunately. The benefits might be very good, but the need for monetization would just get in the way of many positives. Unless maybe we figure out a way to do ad-blocking etc (or maybe pay for an ad-free subscription). Sorry if that sounds too short-sighted, it's just hard to imagine otherwise. Though maybe not that many people actually care about these downsides, outside of tech folk.


I don’t disagree. I just hope we get to a place where the product does what’s on the tin and no more.


Likewise!


The problem really is, how do you prevent the coercion and abuse?


Open source software and hardware?


and the AR dystopian future of brain implants is exactly what most people, even if it became popular, would refuse because of basic ethical, civil, religious, biological, political, etc reasons.... i think that kind of "game changer" is where most people would draw the line, even if it would improve their lives somehow.


>You just can't expect people to exist in a virtual environment and ignore their actual physical reality for any length of time.

People spend hours and hours playing world of warcraft. A better version of that would be even more popular.


Given that Blizzard's biggest innovation in the MMO space in recent years is apparently a 'worse' version of World of Warcraft, I'm not even sure that's true. Seems like Old School Runescape is actually doing better than (or at least similar to) WoW in terms of active players, and that has even lower graphical fidelity.


Yeah. Arguably as a proto-VR medium, Second Life existed for a long time, but is still far from being the most popular gaming platform (though maybe that has to do with it being not an actual topical game).

I don't want to dismiss this possibility based on these still very early days, but look at how the current early-adopter implementation of the Metaverse has been perceived so far - "influencers" have no mercy on it, due to the sheer amount of bugs and weirdness of e.g. having to pay to applaud someone virtually..


I think that's a different scenario. Games are escapism, what Mark Z is proposing is another 'real' world through your goggles where others demand and control your attention. I don't think people want that tax.

I think perhaps WoW would fail in the same way with VR, where people start to realise the time spent in it really is more like work after a point.


The question is how many people though. We aren't talking about 2-3 B people in this case..


Do they? Or do they constantly take breaks in the form of looking at their phones, going to the bathroom, snacking, etc?


Have you been outside in the last couple of years? People are glued to their phones and ignore what happens around them.


But they're still aware of what happens around them (mostly...). Putting on the VR headset removes that.


People spend many hours a day staring at screens already. VR is a higher-quality, more “real”-feeling version of that experience.


Non-immersiveness is huge feature for casual phone use though. When browsing my phone I usually want to be aware of friends/family in the same room, to notice if my pet is getting into trouble, and be approachable if someone wants to speak to me. Putting a VR headset on blocks all of that out, which is something I absolutely don't want most of the time I'm on my phone.


I read that as naive, something I would expect from a business school student.

Here is the biggest flaw in my opinion: VR/AR is presented as the future of computing without questions.

This is so obvious that this assumption should be questioned from many angles.

Aside from this, in my opinion, such a large company should NEVER show a product that is not convincing. Keep it in the labs until it's good or at least cool enough for a demo like Boston Dynamics is doing.


Yeah, you wound think he’d at least ponder why porn hadn’t adopted it at the very least. Not to be crude but that’s the killer app if there was on. Or at least the trailblazer line it has been for so much of the internet and before.


> Yeah, you wound think he’d at least ponder why porn hadn’t adopted it at the very least

It has...


If even porn failed to make it really mainstream...


Seems like this has been public for several years.

Nonetheless, it's quite eye opening to read the strategy so openly laid out. And in some ways quite a testimony to Zuckerberg that other than obviously failing to acquire Unity (why?) they have essentially executed on all the other elements of that plan consistently now for 7 years straight.


Yeah, seems almost like the downfall was its openness. It's almost a kind of hubris -- he didn't need to articulate his plan in detail via a traceable comm like email, should've been more secretive. Maybe Zuck should've taken a more "first you must deceive your allies" approach.


I don't understand, why is openness an issue? Is it because it makes aquisitions more expensive?


"Victorious warriors win first and then go to war, while defeated warriors go to war first and then seek to win.”


Could not agree more. Laid out plainly, marching orders clear.


VR and AR are not the future, tech be there or not.

Most people have reached their mental connection quota today, and doesn't want more. It could be fancy, seamless, and at the same time nobody cares.

It's not 20 years ago where I'd read a shampoo bottle out of boredom.


> It's not 20 years ago where I'd read a shampoo bottle out of boredom.

I totally forgot about this, but damn I did that regularly as well.


https://techcrunch.com/2019/02/13/facebook-mulled-multi-bill...

I wonder why Unity didn't agree to be acquired. Say what you want about Meta they were pretty good at acquiring companies.


Why does Zuckerberg focus on VR when WeChat has shown how much more of a platform Facebook could be?


I am not familiar with WeChat, could you provide any cool feature as an example?


> It is more natural than mobile

this thinking is colossally misguided. People bought more laptops than desktops because they are less intrusive with real life. They bought even more phones because they are even less intrusive. A VR set is 100% obstructive , so it doesnt fit this category. it is something you use when you can "depart from real life". If something like that is the goal, the nearest thing was something like google glasses. it would have to be very useful for people to tolerate wearing glasses practically all the time (You wouldnt want to be carrying the glasses on hand).

The form factor of a phone is that of a book or notebook, and that has been favored by people for thousands of years because our hands are expressive. glasses are generally a nuissance that is tolerated because of vision issues. If the goal is really immersion with real life, it seems that neural interfaces a more likely candidate and that s the direction they should be going (or at least make something more mobile than mobile)


I agree with VR being obstructive and awkward, but what percentage of the population would be okay with hooking a computer directly into their brains, let alone a facebook-controlled computer?


I like their wrist controller, would love to use that for typing instead of the awkward touchscreen i m using now. If it has a lot of utility, people would use it.

Frankly, it is the only wristwatch i need


Zuck’s thesis is going to be vindicated in a few months and he will end up being basically spot on in terms of ubiquity in 10 years. The pivot to catch up conceptually with Apple is going to be tough but doable.


What? How?


When Apple releases their headset.


This has been rumored for 10 years along with the Apple Car, I doubt it will release.


They’ve demoed it to the board twice, it’s shipping. It’s not what you’re imagining - will (imo) be all day wear flip down passthrough AR with 4ish hour battery life.


How do you know this? This seems like extremely confidential knowledge.


It leaked


link?


Who wants to wear this and why?


It will have similar usage patterns as your watch (all day wear not all day use) but will be AirPods for the eyes via a flip down visor. (Imo)


Again who wants to wear that? Normal people don’t.


Who wants to wear any type of eye glasses ... nobody. But they do! Because they have utility.

I can't understand why you wouldn't want to be able to wear a perfectly normal pair of glasses that have the additional feature that you can pull up your phone screen at any moment without actually getting it out of your pocket.


Apple won’t ship anything until they’ve found a way to make people want to.

The key insight is that the device will be off most of the time.


Luddite


Just to chime in here on a real usecase for VR that I would absolutely 100% pay a load of money for:

I love traveling, and I'm fully WFH, so I can technically travel 365 days of the year, but the lack of a monitor basically makes it impossible to get anything done. My 15" macbook simply isn't enough.

It's kinda gotten to the point where I only do roadtrips around California so I can throw a monitor in the back of my car. If instead of dragging around a monitor with me, I can throw a headset that is as good (resolution, battery life, latency, etc), this would be something I'd be willing to easily pay thousands for.

I have a quest 2, so i know how far we are from this in terms of resolution, latency, comfort, battery life, but, figured I'd throw this comment in.


It's not VR, but there's a whole bunch of high-dpi 15 inch portable "gaming" monitors out there for $300 or so. I bought one a couple years ago for an Intel NUC, and the whole thing is about as thick as a laptop. I've carried both my MBP and the montitor (and the NUC plus a mouse and a tiny keyboard) around in a regular Jansport bag.


You should look at the NReal Air AR glasses


What about a portable monitor? There are plenty decent ones on the market that go up to 17"


If a 15" macbook is not enough, I doubt an extra 2" is going to cut it. OP probably has a 24"-32" main monitor they are accustomed to using.


I've always felt like it's about having a second screen, as opposed to a larger screen. Using your laptop + monitor effective doubles your screen real estate regardless of the size of the monitor.


Y'know, this letter makes a lot of sense to me. It's an awfully large bet to make, though. If the bet fails, they might as well just become a dividend paying company, because they admit that they don't really have many growth opportunities otherwise.


I recently made a relatively large (to me) purchase of meta stock with the crash. I also bought the quest pro. I’ve been using it everyday mostly to play games. Sometimes I go in horizon, but there’s not enough interesting worlds to visit.


For anyone still complaining about this pivot, ad revenue is already drying up due to new privacy laws and initiatives by platform owners like Apple. XR (AR/VR) offers a potential future for meta even though the hurdles are hard


it's interesting in that it reinforces both sides of the argument ....

it supports both that he's a crazy zealot driving Facebook off a cliff, but also that he's a visionary because exactly the things he was worried about and foretold are coming true. Ironically, the worse Facebook does financially the more vindicated he is. Which version you choose to believe is probably highly dependent on your own prior subjective opinions, as both are plausible.


If Facebook didn’t pivot, it would die a slow yahoo death. What’s the point of that if you’re a founder still in control? I think the chance to be a major player in a paradigm change is a worthy risk


TikTok is also eating their lunch.


I think if anything, this shows that unfortunately teens would probably be the first truly mass market to want this.


I think you’re right. The younger you are, the more open minded you are to new things and concepts; instead of hanging onto the safety of the familiar and comfortable. The older generations tend to play it safer and boring in nearly every aspect of their lives


Easily the best comment at my time of posting.

He’s going on and on about immersive AR/VR experiences. But TikTok wrecked that vision by proving people wanted freedom FROM choice. They wanted and want LESS social - just send content to me that you know I want.

Zuck missed it and now he’s playing catch-up because he smartly bought Instagram but couldn’t buy his destroyer.


I think you’re confusing freedom from choice with freedom from the busy work of finding what you want

You’re also missing that TikTok’s parent company also has a VR headset that is very similar to meta’s headset


"once you have a good VR / AR system, you no longer need to buy phones or TV's or many other physical objects"

I'd really love to know what "other physical objects" Zuckerberg has in mind here.


To be honest, that seems to me like a totally reasonable way of looking at things. Like him or not, Mark is a bright guy and he has a good sense of both his own position and potential.


It seems the 2015 Zuck is limited by what's familiar to him and utterly failing to see the potential of new technology. To him, VR/AR is just a realm in which to deploy the same apps, a market to capture, annex Unity to protect themselves (at the probable expense of everyone else - glad that didn't work out).

The idea of a large, shared environment as a platform for heterogeneous development seems to have never occurred to him. No vision.


Never read this before, interesting view. I am pretty happy that Unity doesn’t have Meta prefix and can be used to create unified multi-platform XR experiences.


Unity stock is suffering particularly badly though, perhaps Meta still has time to swoop in and take it over (I also hope they don't)


He keeps saying AR/VR but Facebook has made no efforts in the AR space, which seems to be a more realistic model for his metaverse than VR.


The Quest Pro is a step towards AR. It’s what is known as pass through AR.

There’s also work that was publically discussed about getting real “AR in your glasses” by Meta. The technology is just more far out.


Picture a next-great-leap technology with footings in this very real effort underway right now ... you can privately view and listen to anything in your eyes and ears, and let's include silent input with a last big of future technology.

Private conversations with people only you know. And everyone else in the room is having theirs at the same time.

I can be making a table in my woodshop. I can have three friends watching from a half world away, giving me feedback or even safety tips. They're my closest circle. They're my family. We're always there. Wake up, first thought is "who's awake? keep me company while I get coffee".

What happens to what we call families right now, when they are further away than the ones living in our thoughts?

Could this be a kintsugi moment for social networking? That the lonely amongst us can find a tribe of real humans, to quash the qualm, to salve the screaming silence? Or does it dig deeper the divide?


The most interesting approach to VR from my point of view is to turn it inside out and use projectors and similar tricks to merge characters and settings with the real world.

The army has a 40 foot dome that they project images onto to train soldiers to use Stinger missiles. Some friends of mine did an art project where you go into a "time blender" which directs you into six different rooms with different experiences, the "time blender" they built wasn't up to the standard of the rooms so I am thinking of how to make a mini version of that dome.

I have been talking for a year about projecting a video game character as a Pepper's Ghost and doing a sketch comedy routine with it, I really have to get off my ass and do it (maybe make a little pepper's ghost fairy) even if it's almost impossible for a schizoid like me to be consistently funny.


Everything he says except the second paragraph seems spot on to me. But I'm worried (for him I guess) that he's ignoring lots of evidence that VR just can't work - like, it's natural seeming in theory but every time it has been done it makes our brains and stomachs confused.


One of my friend works in a division related to VR at Meta. He is constantly battling to close the tickets, build new features (defined by someone). My gut feeling says, innovation doesn't come from closing already defined tasks, it should come from calm, relaxed, curious explorations


There's wisdom in your gut. To go further, I suspect corporate hierarchies become battlefields and torturemills because of trust issues at scale.

Edicts and objectives come down from on high, but how does the top of mount meta, brain that it aspires to be, detect what the tips of the fingers are touching? A lattice of KPI's, gantt charts, and managers sewn together into a ghoulish nervous system, each link holding a knife to the throat of the next. None of this apparatus has many tools evaluating the quality and intensity that someone is curiously relaxed.

If you force the tools to try and perform this task, you end up sending daily emails asking people to report their current level of relation and curiosity, but in a way that obfuscates what you're asking. This is so you can stack rank them based on how relaxed and curious they are. So when you fire those who are the least relaxed and curious the aggregate measure bubbles up and you can be an industry leader at these things.

The fuel for the fire extinguishes it.


Marry VR with Bollywood & Tollywood dance numbers using VR cameras and they will sell like hot cakes in India.

https://youtu.be/_0uZAQyxT_U


Maybe it's just my view, but I see the usefulness of FB as a platform that allows people to keep in touch or find others and then meet IRL. There's no replacement for a real interaction. The big downside of that though is those who don't want to use the same medium, can't anymore plan to be real-life social within the same circles.

I don't think VR would improve on this use case, especially for the mass market of "casual" FB users. AR could be useful however, for more of a "contextual" help while actually doing RL.


He really did have the Hyperreality vision.[1] "Our vision is that VR / AR will be the next major computing platform after mobile in about 10 years. It can be even more ubquitous than mobile - especially once we reach AR - since you can always have it on."

[1] https://www.youtube.com/watch?v=YJg02ivYzSs


It looks like the AR glasses will depend on an external compute device, like the phone. If Facebook had invested more into their phone product, they would have a much easier time to compete against Apple/Google. Funny to think that they for a small amount of their VR investment (31b) they could have bought Xiaomi which would have given them a platform to expand on.


The odd piece of this is characterizing VR as a bridge to AR from the user's perspective. An AR that is out of the way when you don't want it is somewhat plausible, but for most people the idea of strapping a VR headset to your face and completely blocking off the outside world is a nightmare. How do you get from one to the other?


the Quest Pro is a literal manifestation of how they are trying to do that - so called, mixed reality.


I have a saying: Software is eating the world but hardware creates the new world. Without a hardware play, no company can become the next Apple. Whether VR/AR is the right paradigm though, is yet to be seen. I also think Facebook will not be the one to crack this. Existing companies usually don't bring the next wave of the world.


Um, iPhone?


Just think: if he had bet his company on blockchain instead, he'd be laying off 80% of his company instead of 12% of it.


The problem is he could t think outside of his social networking box. He thought a clone of second space would be the killer feature. That is the reason for his troubles. I cannot understand how he expects people to live in that device and much less get the stickiness of a phone/apps


Did you mean Second Life?

In any event, I may be too old but the failing of VR in my mind is that it further isolates us from nature, from reality. The successfully future tech should be tech that disappears, allowing us to once again reconvene with nature. I don't want the Matrix or the Holodeck all day long.


I fully agree with you. Also I did mean second life


“key apps” receive a lot of focus in this email, but clearly that part of this plan is struggling.



Facebook could have bought Owlchemy Labs or the Rec Room team really early and turn that into "the metaverse." Instead it looks like it was designed by people who have never played a video game. His vision makes sense and the headsets are great.


I believe he's mostly right except that he need a hardware breakthrough, the same way mobile phones had a hardware breakthrough in 2007 with the invention of good enough LCD touch screens and batteries. VR and AR is much harder but not impossible.


Here’s a hypothetical: what if Facebook had taken all that money and blind effort invested in VR over the last decade and instead fully committed to creating a competitor to Android/iPhone?

I think that strategy would have had a better chance of success.


Well we know how that goes because Microsoft essentially did that.


I came here to post something analogous. Imagine if Google had to actually compete with Meta on the same platform. There would naturally be an incentive to lower telemetry (so that Apple can't just score an easy win again).


I wonder if Mark thought we would have cheaper or more-accessible headsets by now. The real danger in all of this is Apple coming out with their rumored glasses. If they do that, they will capture the platform that FB will be subservient to.


As long as SteamVR does not work on a 1030 and Quest 3 is less powerful; VR will not meet it's energy requirement balance.

The real metaverse is action MMO and that can run on a 5W Raspberry 4 at low resolutions.


Imagine you have a business cutting up ice in the mountains, and shipping it to hot places. The refrigerator is invented, threatening your bottom line. Is the right thing to do to go into refrigeration?

Nope. You don't know anything about it, and have no experience with manufacturing. The truth is, you should get the money you can out of your firm and wind it down.

You could try to buy a refrigerator business of course, but would you be a competent owner? What you know is shipping ice.

None of the executives at Facebook knew anything about making a good VR social experience. They seem to have created an expensive failure, and that isn't a surprising result. They do know a lot about content moderation, and from what I can tell, that part was extremely well thought out.


VR doesn't seem as useful as AR, and AR isn't going to be a thing till we get something "wearable" in the sense you are happy wearing it like glasses / a watch.


Come back in 2-3 months when we see what Apple has announced. Supposedly very much in this vein.


you can do both. i dont want to play AR games


It is not a wrong idea that VR / AR will be important, but estimate of 10 years was way off. It's not anywhere close yet.


I'm not so sure - do you not think Nreal Air [0] is close? And you can buy it now for a few hundred $. Two more years evolution and this could be very close to a mainstream viable thing.

[0] https://www.nreal.ai/air/


reading this it seems like he lives in a vacuum surrounded by people who either lack vision or understanding of what the future really will look like in ten years... it's a sad read actually. As if brain implants will be the next facebook, it is an unrealistic goal, but also not an accurate vision of the future world from an engineers perspective.


The idea clearly has potential but it's the execution that's lacking. In 20-30 years someone will have developed a headband or implant that allows direct sensory manipulation and VR/AR will be the next frontier. Until then, throwing money at increasingly elaborate glasses is just a waste. They should just focus on the platform and abandon the glasses for now.


Loading this page with JavaScript disabled is a very bizarre experience!


Meta should be divided like AT&T 40 years ago


if you find this interesting, you might be interested in the book it came from, "the history of the future" by blake harris


Mark is smarter than I thought.


Smart fella


>Beyond the sheer value we can deliver to humanity by accelerating and shaping the development of this technology

This email had me somewhat upset until I remembered that Meta is floundering and failing badly. It seems self-evident to Zuckerberg that broadly-adopted AR/VR would be an automatic positive for humanity. I can't imagine a world in which AR/VR is a positive. I don't see any reason for VR/AR to be seen a positive development.


I can't comment on Facebook's vision for VR, but speaking more broadly...

During the pandemic, VRChat let me reconnect with friends that I hadn't seen in person for 1-2 years. Combined with body tracking modules (so you can walk around fluidly), the experience can be extremely immersive, like you're in the same room with someone.

When I upgraded to a Valve Index and gave my older headset to my roommate, he later mentioned that VRChat and the social experiences he had on there saved him from a deep depression brought on by isolation during the pandemic.

I'd consider that an extremely positive experience.


No offense to you but I think part of the human experience is to miss out on connections then feel the joy and excitement when you do actually meet again and catch up.

i talk with friends in other states daily on discord and it doesnt hold a candle to how much more fun we have when we get together.

i see value in brief moments for VR experience but beyond those it just seems half asses and tacky


That's actually a very good point (though still a niche market). For those of us having relatives/friends in distant places (or colleagues in the global workforce), this could be immensely useful. I do think this is far from a ubiquitous need though, outside of troubled times/environments like the global pandemic.


There are about 280 million first-generation international migrants. That’s a group that is highly likely to benefit from close social interaction online.

And more broadly, the majority of the world population uses some kind of internet communication and many of them would probably use a higher-fidelity version if it became available. To give an example from a more mature technology, the share of internet communication happening over video increases each year (this trend predates the pandemic).

Personally, I’ve found that VR takes away a lot of the awkward downsides of Zoom socializing. I’m pretty optimistic it’ll be popular when it matures.


Believe me, I would love to chat with my parents living across the ocean over VR! I guess what I'm trying to say is this need would not be replaced with VR though - it would be more of a necessity because of distance. I also think we vastly overestimate the number of people maintaining long-distance relationships (of any kind) beyond close relatives or friends on a daily (!) basis. I cannot back it up with numbers, but my gut is most friends and families (and workers) are still and will always be "local" enough. So, for occasional use when traveling etc. sure - this would be a killer app. I just don't think this would be as ubiquitous as phones for daily use - unless the technology is so seamless it doesn't occupy or need any more space or weight etc. and be as portable as a phone. So, if we're talking about mass adoption by the majority of the population for daily (as opposed to occasional) use, I just don't see VR in particular replacing phones anytime soon.

AR on the other hand, could become more ubiquitous in that sense, if it can be worn casually and be looking "cool" enough to not warrant weird/dorky looks. But time will tell, I guess.


the problem is when you provide a substitute for a real human need and it's cheap and addictive, the net effect is going to be negative. people will jump to the cheap thing and everything else deteriorates. i'm sure people have positive anecdotes about something they did with instagram but clearly the net effect, on teenagers in particular, is horrible.

even without the issues around biometric data and privacy, sitting inside with lights strapped to your eyeballs is not healthier than doing something with people in real life.

there will be specific applications where VR makes new things possible and better, but as a household entertainment device i think it'll be terrible.


Exactly this, you can't hug or kiss someone virtually, no matter the technology (outside of some truly out-there sci-fi like virtual surrogates). It's just crazy to think this would replace face-to-face (outside of real necessity) - even FB couldn't do that, though maybe they're aiming for the same role as FB does now, logically.

Unfortunately, teens would be the most vulnerable to adopting this though. But I can't imagine this being anything but another "temporarily popular" thing that will get boring quickly.


I thought of a few interesting (speculative) use cases:

- Treat photosensitive epilepsy by filtering incoming visual stimuli

- Improve vision for cases not treatable with typical lenses

- Use eye-tracking to assist with communication for people with various disabilities

- Teleoperate robots in dangerous conditions

- Perform live translation with AR subtitles

- Learn everything there is to know about anything you look at - plants, animals, places, things

- Block ads/brands in real life

- Enhance learning of instrument/sport/activity

- Record and re-experience major life events in 3d space

- Communicate with true telepresence


I guess it could be useful in a world where climate change and/or a far worse pandemic have made being outside extremely dangerous. But I think we'd have far bigger problems than VR in that case (like food scarcity).

With that said, even the iPad was sort of a goofy device that everyone dismissed initially (iirc). It's hard to imagine the same thing with AR/VR communication though, given the currently known tech limitations and just the sheer dorkiness and/or cumbersomeness of wearing an external device that doesn't look like regular glasses (which are also already perceived as dorky).

In addition, for VR there's always this question of "where do we use it?" I stopped using mine because (despite having a sufficiently large space) I kept hitting my furniture or barely missing the TV. I don't think this problem is solvable with technology, and not many people can afford large enough spaces to address this. AR is a different story though.

I think they should follow the approach of beachhead markets if they want to prove it could be useful. If it can't be widely adopted even by a niche audience atm, then there's little hope for mass adoption/usefulness. Microsoft is a good example of that - they are/were trying to position the AR headset as a workplace device first and foremost, and even that seems yet to be widely adopted within its market. But figuring out the right initial market takes time.


> But I think we'd have far bigger problems than VR in that case (like food scarcity).

If we’re looking at the big picture, mature VR/AR will help suppress social unrest. It will help with other issues like the scarcity of physical space.


Hah, that's a good way to put it :-)


This is actually one of the reasons that attracted Carmack to VR. I’m paraphrasing him poorly, but in one of his talks he mentions that “In real life, we don’t have the resources to give everyone their own private bowling alley, but this is possible in VR”


Do you mean it would be negative, or just can’t see why it could be good?

For a positive example, I’d like to meet or chat with coworkers and management full-VR/AR when they are in the other office or city. Because text is still a pretty low-bandwidth medium for many people and/or topics.


Why do you need VR or 3d for that? Why can’t a webcam do it?


Depends on a webcam app/hw. If it allows for an equivalent of in-person “protocols”^, sure. Looking at someone, negotiating attention, proximal subchats, etc. But still, imagine a meeting in a restaurant and everyone is peering into their laptops to just see me echoing around.

Anticiating the next question, yes, I find in-person bandwidth (usually, as in popular software) superior to webcam.

^ This could be done in non-VR apps too, but convincing IMs to make UI for that is even less real than creating VR glasses.


On top of this, many people prefer to "zoom out" rather than "zoom in" during meetings :-) Though that's not everyone.


I think the benefit of AR should be pretty apparent. Unlike VR, it's a strict upgrade for your vision. For example,

- It could provide first responders with live HUDs analyzing the environment

- The hard-of-hearing could use it to literally provide subtitles for real life. Live translations in general can break down language barriers.

- It can provide useful context about objects around you, or even magnify them in real life.


Is it just me, or is this email wildly unpersuasive?

Is this a side effect of the control structure he wields over the organization, therefore he doesn't actually need to build consensus towards a common goal? It seems to fall into a weird in-between communication style - not quite elevator pitch, not quite status update.

I'm honestly confused why/how a major CEO communicates in this way.


For me it was effective writing. Simple sentences in active voice identifying clear actors and relationships. Going to apply it to my own technical writing style.

Is it a work of art? No. But he got his point across to me rather clearly.

For context, I have a degree in mathematics. It certainly mirrors the informal-but-precise language you see in the field. Maybe that's why it was effective for me.


+1. Also, for a leaked internal email it's awfully quiet on numbers. If you didn't tell me this was Zuck, I would probably have assumed this is a vantage point essay from a bright MBA student, certainly not Zuck himself!


I have to assume this was hardly edited or revised, right? Just fired straight past Zuck's assistants and into everyone's inboxes.


I think it's well written but ultimately it just reads as: "VR is the next big thing and we should try to own every part of it. To do that we should be the best at it. And we can be the best by building or buying as needed."

Like... okay? There's nothing particularly strategically interesting there.


Everything he says on the email makes sense, except 7 years later I don’t believe anyone other than Apple will be able to build realistic AR hardware any time soon, and no one will care that Meta was first with their platform. Apple can easily build the platform/ecosystem on top of what they already have overnight, once their hardware has cornered the market.


There is some first mover advantage, but in the long run, it's true--no one will care who was first. Apple has a good shot at a general consumer platform, not so much for gaming. Microsoft or Valve/Steam has a shot at gaming, and maybe Sony. For business, MS again has a shot as does Meta. HP can access some parts of it but I can't say they have good experience in delivering the software part of a platform.


If I were in Zuckerberg's position, I would leave the Oculus to gaming and let it mature there and maybe sell it similar to industrial use cases. I would then focus on Rust and typescript and create an OS on the phone that allows you to run Rust and Typescript apps. Likely a typescript bridge to rust. Now you have a whole ecosystem and developer community waiting to disrupt the mobile device with the two most popular languages. They will naturally build for the web and then for the Rust phone that runs typescript Natively like the React Native JSI for rust. Zuck if you're reading this, this is how you survive and beat Android and Apple. Use the power of developers who will innovate the shit out of the system that will likely not exist fast enough on the other two phones




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: