Placeholder Image

Subtitles section Play video

  • Hello again.

  • As you know, I am Eli the computer guy, and today we're going to be talking about merged or mixed reality.

  • So there's a lot of different types of reality nowadays.

  • When I was a kid, we only had one type of reality.

  • We had reality reality.

  • But now, apparently we've got four, 44 different types of reality.

  • We have reality, reality.

  • We have virtual reality.

  • We have augmented reality, and now we have murdered or mixed reality.

  • So as with many topics, we're talking about things in technology.

  • It's important to understand the differences between these types of reality.

  • So we talk about virtual reality.

  • We don't about augmented reality.

  • We talked about merged and mixed reality.

  • These are very different things.

  • We go over.

  • We take a look at Intel's Web page, talking about merged and mixed reality.

  • I think they have a graphic that tries to explain this very well.

  • So over on the left hand side, they'll talk about virtual reality.

  • So when we're talking about virtually virtual reality, we're talking about a completely digital environment.

  • So you put the goggles on, you put the glasses on and you're entirely in a virtual world fully enclosed synthetic experience with no sense of the real world.

  • So this is a virtual reality that's being been put out by Oculus and a key Seve I've and what's being pushed on us lately.

  • Then you have augmented reality.

  • So I just did a video talking about augmented reality.

  • An augmented reality is honestly, I kind of think of it.

  • I think of it as the next wearable.

  • That's not really going to go very far, Basically, with the idea of augmented.

  • Reality is you're getting additional visual information about the world around you, giving you additional context.

  • So really ll world with digital information overlay.

  • Basically, the real world remains central to the experience, enhanced by virtual details.

  • So you're looking out at people, and then information about those people is shown on the screen in front of you, so that's augmented reality.

  • But now we have merged reality or mixed reality s o the merged or mixed.

  • This is one of those things.

  • Whenever a new technology comes out, different vendors, different companies use different words essentially more or less for the same thing.

  • So Intel calls this merged reality.

  • Microsoft calls this mixed reality basically just think of it as M R.

  • Maur or less.

  • They're interchangeable.

  • And this is where real and virtual world are intertwined interactions with and manipulation of both the physical and the virtual environment.

  • So this is where you can look out at a scene at what is around you, and the computer can then understand the physical environment that you are in and essentially re skin that environment.

  • So if you are looking at a wall, let's say you are in your room and you have a mixed reality headset on and you look at the wall instead of seeing your plain ugly ass wall.

  • Maybe you'll see a cave wall.

  • Or maybe you'll see the wall of the Starship Enterprise or something like that.

  • So the computer the computer is taking the fact that there is a wall there and adding information to it, adding, basically, as I would say, re skinning the environment that you're in.

  • So this is what we're going to be talking about today, either mixed or merged reality.

  • Now, before we can start talking about mixed and merged reality, we do got to talk about the sponsors because they're the ones that pay the bills.

  • They're the ones that allow me to do these types of videos, so we have cumulus networks.

  • Brand new sponsor Cumulus Networks wants to know your thoughts on Web scale networking.

  • Fill out their survey and you could win an apple watch ago to cumulus networks dot com forward slash eli Down in the doodly doo below, we have Geist, Geist Bills and Delivers Rack PDS Alter Quick An issue is five days for standard units made in America.

  • Hashtag sexy Petey use geist global dot com Theme free backup for PC Zvi EMS and Lennox all at v m dot com.

  • Dev Mountain Dev.

  • Mountains.

  • The Web 12 Week Web Development IOS Us Aye Boot Camp intends to be a full time job.

  • The industry learned a code at dev mounted dot com i n E i n.

  • He specialized in network training with hands on labs on site boot camps and focus on delivering the best it online courses at i n e dot com plex, or what screwed?

  • Isar and Florida users could determine what traffic is on Network, who was originally traffic, who's receiving it at dot com and finally get where data recovery your partners with I T professionals to offer their end user's data recovery service is and digital forensics Find out Maura gil ra dot com.

  • As I say.

  • Don't worry, Kayla.

  • Care of you.

  • Thumb up, thumb down.

  • Leave a comment.

  • But if you click on the sponsored links down below, that's what helps Cape keeps the bill's getting paid and making sure I can create content like this and keep silicon discourse dot com going so to really grass merge or mixed reality.

  • I think a video that Microsoft did is very good for kind of understanding the idea of re skinning the environment around you.

  • So we go over and take a look at the video that Microsoft did.

  • You can go and take a look at it, too.

  • It's It's only about a minute long, but if we turn the video on, this is where they start talking about what is mixed or emerge reality.

  • And so basically we start with a scene, so this is the type of environment that you would be in.

  • This is, well, maybe not your environment, but I don't know the environment you'll have in a couple of years.

  • Once you start making money in the tech world, right?

  • You know, you've got a desk, you've got a chair, you got a lamp.

  • This is what your physical environment looks like.

  • But your physical environment is boring, drab.

  • It's not very interesting.

  • And so that's where mixed and merge reality.

  • We'll start to change that.

  • So basically, we have this woman who then comes into view, and if we scroll ahead, we can now start to see where merged or mixed reality your head start is set in Star adding components into your physical reality so you can see that you see the little dog down in the corner.

  • So they got this little dog right here.

  • So it now appears that there is actually a dog in a room.

  • Yeah, Obviously it's a cartoon.

  • Not too realistic, dog, but you don't work with us.

  • This is what the current technology is like.

  • Ah, so it seems, or it appears that there is now a potted plant on your desk and now shows that there is now a screen sitting over your desk.

  • So this is adding full fledged components into the world that you're dealing with.

  • So this is where you have both the physical world and the virtual world merged into this one reality.

  • So in this type of environment, theoretically, you could go down and you could sort of pet the dog.

  • I mean, you'd be like petting the dog in the air, but the dog could then react to you as if it's kind of like a ghost dog.

  • That's that that's actually there.

  • So the important difference between miss and augmented reality is augmented.

  • Reality would simply be superimposing information over your your normal vision so it might show you direction someplace.

  • It might show you what the temperature is.

  • It might show you e mails or messages coming in, but it wouldn't look like a full fledged computer screen.

  • It wouldn't like look like a full fledged artificial dog sitting down in the corner.

  • So augmented reality is just giving you information, overlaying that over what you're visually seeing with the mixed or merged reality.

  • This is actually adding to the reality that's around, you know, if you go ahead and you keep looking at it.

  • Basically, the idea here is that you could even than have people in the environment that essentially our avatar.

  • So this woman is now an avatar.

  • And so the idea here is you could be in an environment.

  • So let's say that you wanted to do an interview or you want to have a conversation or you want to do, like, a therapy session.

  • So the idea that you could sit down in a fair and then the computer with superimposed the image of whoever you're talking to in a care that's across from you.

  • So think about that.

  • So you set sitting there and you're having a beer, and it really is kind of like this weird concept, like you could have a drinking buddy that you never met in real life.

  • The idea.

  • If you have the goggles on, you could be sitting there drinking a beer, talking the person quote unquote beside you, who is also drinking a beer, except for the fact that they're actually, you know, 5000 miles away.

  • So this is kind of that idea with it, with emerge and mixed reality, bringing everything together, and then what school is beyond this, then it's the whole idea of re skinny and the entire environment.

  • So one of the problems that we're having right now with with full room of virtual reality is what happens when you actually have objects in the room.

  • So let's let's say you take a 15 by 15 room and you turn it into a place for virtual reality.

  • Well, what about the coffee table?

  • What about the bookshelves?

  • What about your dog?

  • Right?

  • If you're in the virtual reality world and Ah, and you're walking around, we'll have one When your dog gets under your feet.

  • I think I think about it.

  • We used to talk about Nintendo Thumb.

  • So Nintendo Thumb was where we used to play the the old any s the Nintendo sold so long that it literally hurt your thumb?

  • Um, I kind of wonder if we're gonna end up with Oculus back basically where people break their backs after tripping over things and they don't laugh about it, huh?

  • I had Oculus back back in 2018 when I tripped over my dog when I was doing for a reality.

  • And so that's the real problem.

  • Because even if you created an environment where you think they're gonna be no objects, if your headset can't look at the world around you your dog.

  • Your cat gets something stupid, might be there, and it might actually get you hurt or injured.

  • So what's cool about this when you start looking at this, this merger or mixed reality environment is what it's done is it's taken the objects that exist in the real world.

  • So there's, you know, you have a chair sitting there and you have a desk sitting there, and so its able to keep the position of those objects and then essentially, visually, re skin them.

  • So if I was walking around in this environment, I wanted trip over the chair.

  • I wouldn't trip over the desk because visually it has been Kane.

  • But there is still a physical object that's sitting there.

  • And so this is what we're starting to talk about when we talk about this merge and mixed reality, and then what they're showing here for the for the Microsofts view of this is, you can then have, like the small dots, basically these or these air like a light, wavy kind of boundary.

  • So they kind of understand physically where your physical room ends so you can look out and it looks like this massive expanse and it looks like you're on a prairie or something.

  • But then you're given a bit of a visual cue of you.

  • Don't walk too far or you're gonna run into a wall.

  • And so this kind of gives you that that visual idea of what this looks like And this is this is the stuff that's a postive theoretically be built into Windows 10 s.

  • So if we look at it that way, basically, that's one of Microsoft's you points.

  • Ah, so Microsoft and Intel are the big players in this right now.

  • Both Microsoft and Intel are throwing a crap ton of money into merged and mixed reality.

  • And being that they're huge technology players, they're really they're the 808 £100 gorillas in the room.

  • So it is good to understand how they're both thinking of this whole idea of merging mixed reality.

  • So basically, Intel has the standards for for merging mixed reality.

  • Um, they're slightly different than what Microsoft may have.

  • And so one of things with Intel is basically Intel wants to quote unquote explore without wires.

  • Right?

  • Merged reality cuts the VCR cord, allowing user operate fully free of consoles wires and controllers.

  • So this going be important thing which we start talking about more of these virtual reality headsets that will not be connected to computers.

  • And so this is something that you're gonna have to be thinking about from a user interface user experience.

  • Ah, for using this type of equipment is are there going to be cables?

  • Attack?

  • I have used HD sees, you know, with those big, nasty cables dragging along behind you as you walk around in a room and you can trip and damn near kill yourself over those two.

  • So being in being in a fully merger virtual environment, being completely wireless with that could be a very valuable thing.

  • Eso with them sense what's around you, basically what they're talking about it stay safe, advanced sensing technology and emerged.

  • Reality helps you prevent collisions while providing a safer physical environment in the virtual world Again, this is going to be a very important thing is people want to start wandering around in these virtual worlds.

  • It may be 99% virtual again when we start talking about things like Virtual Versed, merge 90 99% of what the person is interacting with maybe, maybe completely virtual.

  • But it's that 1% to keep you from running your shin into the coffee table.

  • That might be might be valuable.

  • They're saying Plug in play.

  • Ah, one of the ideas with this merge Reality is so with virtual reality right now is there.

  • There are a lot of external sensors.

  • They're trying to get the external sensors out of virtual reality.

  • But if you look at the PlayStation V R, if you look at the Oculus, they use external sensors to figure out where you are.

  • Intel's idea is that there should be no external sensors, So basically all the sensors for your merged reality unit should be built into the unit itself.

  • So no external sensors required with Intel with Intel says, thanks to Intel, real sense technology just put on your head mounted display and go depending on what company are doing dealing with.

  • Obviously, they may or may not be using real sense, but Intel is really pushing the whole real sense.

  • Ah, and then the final thing is the two worlds combine.

  • Basically, being would emerge that virtual reality world of the physical reality world.

  • So this is how Intel looks at it now.

  • If we go over and we take a look at Microsoft's and Microsoft has a full page talking about this and with Microsoft, they get a lot simpler.

  • They get, they get a lot more technical in some ways, a lot more technology in some ways, but a lot but a lot simpler in basically their explanation how all this works.

  • So their idea is that there will be two types of devices.

  • Um, so with them, they have what's called the holographic devices.

  • So something like the Microsoft Hollow lens or they have the immersive device s o the Acer Windows Mixed Reality Development edition.

  • So this this this immersive device, this is what we've been hearing a lot about for about the past month.

  • He's like $300 goggles that people will be putting on.

  • Um And so in this world, the two types of devices the holographic device these air characterized by the devices ability to place digital content in the real world as if it were really there.

  • So I've used hollow lens before and basically with hollow lens, what it tries to do is you're you're looking for It's almost like augmented reality is really close.

  • Augmented reality again, All this stuff gets within.

  • You know it's splitting hair, sometimes with definitions, but you're looking through a normal pair of glasses.

  • Basically, you're looking through a clear, clear glass.

  • You're looking out at the world around you, and then what the computer then tries to do is it tries to superimpose graphics over the world that you're normally seen.

  • So basically, it's a lot like augmented reality as you're looking out at the world and that it's superimposing images over that world.

  • So the way that they talk about here is that it's holographic what that means in the real world.

  • It's really kind of cool when you use the Hollands is basically you can look around, and I don't know if an item is in front of you when you turn your head or when you move around the item, you really do get an entirely different perspective of the item.

  • It's just as if the item was physically there s O.

  • That's the idea with the holographic devices then.

  • Then they talk about the immersive devices so the merciful devices is kind of like what Intel was talking about before thes air, characterized by the devices ability to create a sense of quote unquote presence, hiding the physical world and replacing it with a digital experience.

  • So with the holographic, basically, you have glasses on and then add stuff to what your seem.

  • With the immersive.

  • This looks much more like what we're used to of the Oculus or the HTC vibe.

  • This completely covers your eyes.

  • This completely covers your eyes, and then what happens is it has cameras built in.

  • Those cameras can then bring in information from the real world.

  • Add that to the information that the computer wants to give you in order to give you that merged reality.

  • So with the holographic, you're actually looking at the real world.

  • And then it's basically overlaying a lot like augmented reality information over that with the immersive.

  • You're totally within that environment.

  • And then the computer is taking what's around you, adding on skinny and doing whatever else and then basically projecting all that onto a single screen that you're looking at.

  • So this is what we start talking about.

  • We're talking about merge or mixed reality, so that's the basic concept with emerge and mixed reality.

  • Now, of course, being the technology world, we do have to talk about the actual products a little bit more because none of this matters is all theoretical until you're really dealing with products.

  • Microsoft and Intel are obviously pushing the very hard, and they're coming out with their own products, and there are going to be third party vendors.

  • This is being filmed in 2017.

  • So even later in the year, there may be many more products out in the real world.

  • Right now, there's not very much that you can actually go out and buy.

  • You could buy the Hollow Lens Developer edition for about $3000.

  • I think the Acer has a developer edition, but most of the stuff is not anything that you go out and buy a best buy right now.

  • And so to realize that is when we start talking about these products, just just realize that when the real product start rolling out to the consumers and out to the businesses, they may look a lot different than what we're looking at right now.

  • So when we go over, we take a look at what Intel is offering.

  • So intel basically has this project alloy.

  • So the project alloy is what day of you merge or mixed reality toe look like.

  • And so basically, you've got a headset that looks something like this.

  • So relatively lightweight headset, um, that you're able to strap on your head now if ago, again the whole idea of go untether the whole idea is going to be a wireless thing.

  • That is gonna be a totally immersive experience, that there's gonna be no external sensors, um, and available to make your own.

  • One of the big things with this is that Intel will open the alloy hardware and provide open AP eyes for the eco system of allowing developers and partners create their own branded products from alloy design in 2017.

  • So this is an important thing to understand about the intel alloy is the concept that you could build build basically your own platform or your own business around whatever you want to do with with Alloy and not necessarily have to deal with Microsoft.

  • So if you want to come up with it on a special specialized industrial type, merge reality equipment or something like that, you may better be about code that and something like Lennox or some other kind of platform and not have to deal with the Microsoft world.

  • Of course, if you go over and you take a look at that the Microsoft's world Well, the devices that they currently have is the Microsoft Hollow Lens eso.

  • Right now this costs about $3000 for the developer edition.

  • Ah, what it is, which is expensive, right?

  • See, through display allows user to see physical environment while wearing the headset is a thought about before full six degrees of freedom movement, both rotation and translation, eh?

  • So basically, this is something that you can put on your head on and that will be of the superimposed.

  • Put these holographic images in front of you.

  • Ah, pretty nifty need device.

  • What I have found with this with the Hollands is that the resolution is surprisingly good.

  • And this is something you're gonna be thinking about when you look at these products Is the problems with the products aren't necessarily what you think the products are gonna be.

  • The problems are gonna be So the resolution on the hollow lens is shockingly good When you look at that.

  • When you look at those those holograph CE or whatever they want to call it in the hollow lens, the resolution is good.

  • The problem that you run into is that the field of view is ah frickin postage stamp when you're when you're looking out through the hollow lens, you have an amazing resolution over this weird kind of postage stamp shaped thing, in your view.

  • So it's definitely it's definitely not quite the holographic experience that you'd be thinking about.

  • Um, and then what they've got is they've also got the A search.

  • So they got the Acer Windows Mixed Reality development edition.

  • Um, so opaque display blocks out the physical environment while wearing the headset full six degrees of freedom movement, both rotation and translation.

  • Um, so, basically, with thes, um, this is where you strap everything on it looks much more like an Oculus rift or such, and then it has cameras that will be able to see out at the real world.

  • Ah, the benefits of these, apparently, that they're gonna be relatively an experience of So the Oculus or the HTC vibe right now are still about $800 with these and the other versions that are gonna be coming out for Windows.

  • They're talking about these things being down to the 800.

  • I'm sorry.

  • Down to the $300 price point.

  • So the idea is you could I just have a simple basic Windows 10 computer and be able to use that to run a $300 headset?

  • And that's supposed to be one of the good things about these.

  • My concern is the resolution, apparently on the Acer and the brother and sister products, apparently is not nearly as good as the Oculus or the TC Eve, I've So this is one of those things have to be thinking about with the whole merged reality is if the resolution isn't really that good than what kind of experience are you actually going tohave, Which is basically the big question mark that I have having used the HTC vibe and the Oculus Don't get me wrong.

  • They're fine resolutions.

  • I suppose they're fine resolution, but I don't really feel like they're the finish.

  • I don't feel like when you put the HTC vibe for the Oculus on you feel like Yes, we are finished.

  • I feel like.

  • Yes, we have finally gotten to the point that we need to get to in order to prove that we should be able to go farther with this technology.

  • And so my concern with something like the A surfer $300 device.

  • If the resolution is even worse than the Oculus or the HTC vibe, what is the end experience going to be?

  • And so this is something they're gonna be have to be thinking about with the whole merged reality environment and how people are going to be using your product in the real world.

  • So that's about all there is to merge and mixed reality.

  • It's It's a pretty simple idea.

  • Essentially, have the goggles on your head that's able to see the world around you.

  • Then it's able t to take in that information, you know, combine it with whatever the computer is telling it, and then give you something that you find useful or entertaining or enjoyable.

  • Um, I think it sounds like a good idea.

  • I would when I look at it.

  • To be honest, I don't believe the products or anywhere near where they need to be, but I can see the idea of mixed or met merged reality being very useful.

  • I am not a particularly a person that wants to get lost in the virtual reality world.

  • Um, I don't know.

  • Maybe I'm too old.

  • Maybe I'm just screwed up in the head.

  • But the whole idea of being lost in virtual reality for hours and hours and hours at a time just doesn't sound very exciting to me.

  • Doesn't sound very enjoyable to me.

  • If I would be lost somewhere else, I'll go off and do a hike.

  • It's just not that exciting, at least from my standpoint.

  • But the whole idea of merged or mixed reality I do think is interesting.

  • Where you are in your normal world, you are interacting with your normal environment.

  • But then you're simply adding these virtual objects and these virtual things to the environment that you're looking at.

  • So you can sit there and you can have ah, conversation so you can have the image of somebody sitting down at a chair across from you, as if as if you're having a real conversation.

  • The other thing that gets exciting about this is if you look at the hollow lens right now are these other devices?

  • Right now they're big, bulky bricks, Um, which doesn't seem enjoyable again.

  • The hollow lens.

  • It's not too bad.

  • I mean, from a comfort standpoint, it's not too bad for what it is, but it's not something again that I'd be would wear all day.

  • But if you think about it, if at some point they can basically get these things down to the size of sunglasses or get get them down to the size and weight of nothing more than safety glasses, that could be like in a really amazing things.

  • You just can't look down and you look down and let's say you're in a construction side.

  • You can see the entire blueprint for the construction side.

  • You can actually interact with things.

  • So I they merged and mixed Reality is a really good idea.

  • The other thing that I like with merged or mix Cherie at mixed reality versus augmented reality is augmented.

  • Reality in general puts the information at a focus point that, as I say, is somewhere a few inches in front of your eyeballs, right?

  • So when I'm when I'm looking at an augmented reality display, the information is essentially right here.

  • And obviously the rest of the world is out here.

  • What I like about merged reality is murder reality than actually adds the information into the context of the environment that I'm dealing with.

  • So instead of putting the screen here, basically, I could just have the screen float to wherever I want to be able to focus on the object so you can have things.

  • Basically, you can have multiple layers of images that you're looking at.

  • I think that could be a very good thing as far as as merged reality versus virtual reality, I would probably argue.

  • I would probably argue at the end of the day that pure, pure virtual reality ends up dying and simply becomes merged into the merge mixed reality world simply for the simple.

  • The fact of safety, right, if you have a virtual reality goggle on, those were the that on Oculus rift does not give you any context about the real world.

  • So as I say, you can trip over your dog.

  • You can trip over a table.

  • Any kind of physical objects come into your environment and you can hurt yourself because you simply don't know that they're there.

  • So I would say I would bet you dollars to doughnuts.

  • That virtual reality ends up as a pure concept ends up dying.

  • And then we just start simply having these headsets that have that merged reality component, if nothing else, just like the safety factor.

  • Don't Don't go there.

  • We're just going to make it that look like a big old pit.

  • So you don't go and try to walk down the stairs or something like that while you have these goggles on your little virtual reality world.

  • So there you go.

  • Those are my thoughts.

  • The price points for these things are coming down.

  • Um, the hollow lens is still ridiculous, like $3000 but the Acer Ah, that's a $300 price point.

  • The nice part is, if these air being driven by computers, computers, air, always becoming more and more powerful.

  • And so with the new with the new G pews that are coming out for desktop systems, the new C P use it's starting to seem that you can have computers that can run these devices.

  • Um uh, that are there that are very powerful and very affordable.

  • S o I think this is an interesting thing.

  • When I look at it, when I look at it personally, when I look out of the world and look a virtual reality, look at augmented reality Look at merged reality, mixed reality I am most excited for Merge.

  • Mixed reality.

  • I think I think this is actually the really exciting stuff on the virtual augmented.

  • Yeah, not so much, but that's just my bit.

  • That's just by Ben and you.

  • Folks can figure it out, so I'll be I'll be very excited to see where this goes.

  • So as always, I enjoy doing this video.

  • I look forward to seeing that the next one.

  • And if you want to join the conversation questions, comments.

  • Have me take a look at whatever projects you're doing.

  • Think about joining the silicon discourse dot com.

Hello again.

Subtitles and vocabulary

Click the word to look it up Click the word to find further inforamtion about it