Embed code
uh_huh
um okay then uh thank you for introduction it's a pleasure to be here representing
a titanium uh in the name of sedition when you wouldn't come and then
and as it was uh uh i would just outline first let this presentation is about first winter disheartening
then i had planted that should talk a bit about augmented reality but
uh i think at this point everyone understand quite well the concept
and then i will say how i would tell howard anyone wants to work with augmented reality and has been working with augmented reality
and also uh some problems as some things that they had tractors
regarding tracking navigation for uh uh look for another reality
finally i would just a overview of some of the current limitations that uh are sometimes are not so obvious but that uh
that uh we expect to be a in a in the near future to be addressed on on the augmented reality a hardware
then to start with a are turning has been founded in two thousand eleven it's
a nonprofit foundation now uh how it's activities uh turns around the motion capture
and then most of it is directed to research and design of my decision and also your karate
then currently we want to bring those things together and try to integrate the research
we haven't both enjoy a single let's say over certain design a topic
then we also provide some services like a recording of motion capture recording for movies and
uh and games we also promote some workshops as it was also mentioned that
then here is just a small piece i would just show up part of the demo reel of of of the opinion
uh and then this uh we were great is a system that actually has recently became
a start to uh a bit here a engineer and also in los angeles
then we had a actually a very diverse topics like on vitamin three and the
and you can find a complete video at a u. two channel for her name
and now you talk more about the medical were certain design or uh what has been done on the menu go uh um
viewed by opening then we focus mostly are actually on court appendix a and then we have a they have little but
uh an approach church riddles uh to uh for simulation of
um motion and and some of potential issues of trends
many consist of a capture of a c. t. scans the number
i the capture of motion uh take the buyer performer
and then the reconstruction uh to the reconstruction of models and the some tissues of one's uh mostly actually
and moreover also uh they were construct kinetic reconstruction because joints are
not the perfect also get a don't have a perfect
was like movement uh they also have translation and then we
have to replicate that through the tracking of extra markers
uh you know the correct way and then simulations of a potential for instance uh contact of puns and
and things that can also a a pain and uh uh or uh or mental conditioning in appendix
uh and then turn that into some clinic obligation that can help
a medical doctor or one for a medical what partners true
uh to diagnose and to treat a some problem
or to a plan a circuit surgical intervention
then here are uh make use of some of uh the replacement has been developed that there
like uh on the left it's a simulation of of for the by mechanical
movement of reflection of any plus some uh tension owned a a ligaments
on the centre it's a of also having a it's a tennis
player recording in which a thing with or we try to
determine that that's the stress that maybe cause it on on
the shoulder joint ditches repetitive uh above the head movement
and on the right it's a tool for the uh actually for for a better understanding how that uh i
trying to behave after uh i hate the trying to behave after complete uh at also a publicity
and on this case we want to help to better plan how to use
a joint during that does a protest the process should replace it
and also what is the correct size for for to of being planned for that specification
then about a maturity you have for a i quite a bit and i believe
uh and uh from the computer science point of view it is defined it
as a as supplementing the real informant your computer generated sensory input
then very commonly uh i guess be stretch if that are true uh a
cellphone or or or some other a portable device uh with a camera
and the image analysis and then i also through projection a projection is actually uh i i guess
well uh one major have a scalable augmented reality when you see of of for instance does matter
my projection in public buildings it that that those are very common in love than for instance
and moreover what uh we are focusing now is on the holographic a. r. which is
bringing the uh trying to make that let's say that the word or image
into something that is seen or felt as if it was a tangible object
and for that you have to have a careful uh you you have to get
have a good celebration of five three screen and also have a very uh
efficient tracking of of of position of point of the position and of of empowerment location
and like on this application which is meant for indications so that you
can see different uh ill layers of a of a border structure
and then uh it i guess uh it's not the first element you also hear about today uh uh this is the
grim project we have been working non yeah it has been funded by a lot too was telling me huh
and uh we got the per position is to develop some a a a are close to help on this uh
on the on surgical planning and also on better compression of anatomy uh and also we're time motion uh
then we went for instance you put the the motion tracking system the patient
uh having this cannot fees on a joint of ones and joint
now you think a performing in front of the doctor to see whether this can bring also better
perception of uh his problem and and but they show their vision but that that is required
then then uh that general terms we are interested in in bringing actually everything that i presented about tightening into
and amplify that if augmented reality to make it more usable and and propose kinda complications if that
but or long term and more specific is of using that on the operating room
then for that we we we expected that basically to to
modify what is to be used as a navigation system
uh it instead of relying on on on a fix it screen we we
would only use of the tracking so that we have a very reliable
tracking of the headset and of the ones that uh on this case on
on the show there are two plus the potential purple or publicity
and uh we have uh actually partner uh i met medical partners in the hostels and also
a possibility now of upper corner to to go on what what one of this project
and of course of materiality considering is not something you this is
a project from the university of most the time in geneva
but as you can see this is based on on uh a projection
any sewing interesting because it it it can be churchyard however information
that is contained i don't on the projection is only a two d. and it's basically a map you don't have the that
then they use additional equipment chew chew things information with with
holographic holographic augmented reality you can actually put everything
in place and have a good compression of the deaf and their actual location of of the
of of the problem play something duration these other one from proper is
also very interesting as a way to visualise the doing the the
the interface duration how the the vessels in the league or distribute it
and now you go to some uh uh problems that you have a better set so far and also some limitations that
she should be kind of application we propose the the getting
tracking of uh all this is not suitable for
um well this tracking is made for recreational use it's made
to to play things in a room size it's uh
informant uh usually things that are somewhat for and the disability of uh often hologram can shift
by a few millimetres or one centimetre which is a lot when you are trying to
to make an intervention you if you wanted for surgical use for instance
and then the map on the top right actually shows that we had the variation in space when comparing an optical tracking system
which is the one that you can see a tree markers aunt is a wellness letter use it as sort of
reflective markers for infrared information and then capture by summer came or we can it is uh the the um
the quality of the position of the subject in with a quality that is below the uh i mean it or
from their below millimetre and then when compared to feel less we had a variation
of up to forty centimetres in a range of uh eight meters uh work
which is a quite a lot
and for that we had a two came up uh uh when we do that there is a different problems that we
the centre of projection of the image in their wallace is sticks it in
the device and we for those two markers we actually great uh or
we create an arbitrary cornet system that we have to match to the one i mean the all
the lines so that as seen on the lower right teenage we can have a perfect
or near perfect overlap a off real information we've written information
in this case we have uh forty millimetre marker which is been overlap but by a forty millimetre weirdo is here
then does objecting me move it around in the scene from different places and this
is a also limitation of the getting system it's not make shipwreck dynamic objects
it's not makes you say you are objects are uh i know that recently the integrated just some with some nice
ago libraries but it's to require a lot of processing for that
and now another issue that actually we we face now because we are going to another path is that we have like in c.
and then for that we have been combining actually some a sensor uh
initial sensory input so that we have a lower uh we just
the again as you can see that the movement of the object represented the quite great amount
of latency but by using the the initial sensor for instance and all as we can
actually cancel out is that because we have a much uh it smaller uh like consume
from the inertial sensor
then this is just a and to a simple project at this age is is not the most current one
but then there is to some like into that indignities that but this isn't the visualisation of uh
of uh of keep and uh they more uh that was actually scan it from this person
and then we had the person performing the the the movement and and
been able to visualise his own bones and he's an anatomy
then we expect you to expand that in order to show
a simulations intro for instance potential conflicts and and
and visions of the one that may be affected by by some signals or by some uh repetitive uh
repetitive motion like in sports medicine so that we can have a more um
customise it treatment for that person
and now i just want to highlight a few limitations that uh uh are not always uh
that we not always realise that they are they are if we want a let's say a
a short term solution in intimate reality then maybe the the main one is that uh
normal screen some uh and projections like on the wall as they are made for a a constant i accommodation
and usually a few meters away on the case of they will last for instance they
do not recommend any all in a hologram that is closer to making centimetres
because at this point if you focus on the hologram you see your handler it for
instance if we're close if you focus on your hand you see the hologram blur
and for for the orange bowl which is a surgical intervention disease a
critical actually because either of them that medical doctor we'll see
they're handing focus or the beach overlaying focus but there are actually a lot of research on a like you displays there
are a couple of companies that are ready and also that they are working augment reality with like two displays
and uh i would bet that microsoft if they will go on what we've always they we work with like to displace true
and another current limitation is uh on the case of the all these is that a few the view is actually very narrowed and
you cannot proceed that much if objects are quite far but if they are we think they're reachable volume
this actually becomes a a problem because you cannot see the entire hologram u. i.
if you cannot see it uh as an entire object this may lose the
the the sensation of sort of guinness on it that is based in space
it's more of a of an open object and that we can object
and finally there are parallels to a lot of features like a rate also true for the view and read issue
uh i and uh it's screening displacement and the interpreter distance calibration precise calibration
a centre of projection of a also possess calibration uh but uh i'm confident that in the next few years uh
those will be that the the solutions that are being proposed to integrate putting in some uh headsets for automatic calibration
and then that's it thank you very much
integration what's that
ooh thanks for your talk edges additional question to what extent development
the u. d. which are interesting for redevelopment i'll share though
because to what extent it is 'cause the noise addition europe for yourself to what extent as can be
kind of plugging had all that all others you need
your lens lookup system could also use reporting
i would say the extent is usually where the funding comes from whether it's
a uh oh private uh investor already whether or that that one's true
you start making a product or if it's a of public interest then i i those
things can i think it can not i it's not hard to head into
you need years of looking or something like that and be distributed but it's really about uh whether we will be allowed or not
and okay generally i i'll send him i think he's a year
i challenge all the people want to develop their own application
uh_huh is the same problem we had was on the lens is to what extent there's a community of developers in switzerland
and to what extent we can make it easier to share new content so
that we can do at lowe's faster these results things are um
it really depends on uh i have a i think on and
and who explained on this case because whether the the the
just if the fine it's really depends on where the funding is coming from
because if they require we we cannot uh sure it we cannot
do anything but if it's for us usually we would like to be
able to share and should discuss uh exactly how we did things
uh like for the calibration we spend actually quite a long time to get it quite twelve
so that we can find that transformation in a somewhat easy and reliable reliable way
but we can not a share it yet for instance
but you
local book is still

Share this talk: 


Conference program

Mot d'introduction
Sébastien Mabillard, Coordinateur projets e-health, Fondation The Ark
8 June 2017 · 6:05 p.m.
Les Technologies Cognitives ou l'Homme Augmenté
Jérôme De Nomazy, IBM Suisse
8 June 2017 · 6:09 p.m.
Les Technologies Cognitives ou l'Homme Augmenté - Questions du public
Jérôme De Nomazy, IBM Suisse
8 June 2017 · 6:41 p.m.
Mot de bienvenue
Sébastien Mabillard, Coordinateur projets e-health, Fondation The Ark
9 June 2017 · 9:04 a.m.
Présentation de Swiss Digital Health
Frédéric Bagnoud, CimArk
9 June 2017 · 9:07 a.m.
Présentation des instituts de recherche HES-SO Valais-Wallis
Laurent Sciboz, Directeur des Instituts informatiques
9 June 2017 · 9:11 a.m.
Virtually Better: How Virtual Reality is Easing Pain, Calming Nerves and Improving Health the Drug-Free Way
Brennan Spiegel, Director of Health Services Research, Cedars-Sinai Health System
9 June 2017 · 9:21 a.m.
Augmented Reality-assisted surgery
Luc Soler, Directeur de la R&D et Professeur PAST, IRCAD, IHU
9 June 2017 · 11:22 a.m.
Réalité virtuelle dans le traitement des troubles mentaux
Eric Malbos, Psychiatre et spécialiste du traitement en réalité virtuelle, CHU Conception
9 June 2017 · 11:56 a.m.
La Simulation Numérique pour les Professionnels de Santé
Xavier Abadie, Directeur du Développement International, SimforHealth
9 June 2017 · 12:28 p.m.
AR for different medical use cases
Antoine Widmer, Professeur HES & co-fondateur d'Adventures Lab
9 June 2017 · 2:04 p.m.
Augmented reality for medical applications
Henrique Galvan Debarba, Chercheur senior, Fondation Artanim
9 June 2017 · 2:15 p.m.
Virtual reality solutions for stroke rehabilitation
Andrea Serino, Responsable de la recherche en neurosciences, Mindmaze
9 June 2017 · 2:34 p.m.
Virtual Reality combined with haptic robotics for rehabilitation
Aurélien Fauquex, Directeur Exécutif et co-fondateur, Lambda Health System
9 June 2017 · 2:48 p.m.
Creating a valuable user experience for nursing home inhabitants
Roel Smolders, Directeur Exécutif, Active84Health
9 June 2017 · 3:05 p.m.
TABLE RONDE : Quelle innovation pour la santé du futur en Suisse?
Eric Beer, Henning Müller, Pascal Detemmerman, Victor Fournier, Resp: Head of Customer Engagement e-Health (Swiss Post), Professeur en informatique médicale HES-SO Valais-Wallis, Directeur Exécutif SwissEnov, Chef du service de la santé publique du Canton du Valais
9 June 2017 · 3:20 p.m.