Thibaud Michel

Research activities (2014-2018)

Study of the feasibility for Augmented Reality applications based on Geolocation.
Analysis and enhancement of attitude estimation on smartphones.
- http://tyrex.inria.fr/mobile/benchmarks-attitude
[Kalman Filters, Observers, Calibration, MEMS, Magnetic Perturbations, External Accelerations]
Analysis and enhancement of an indoor and outdoor navigation system with a focus on attitude estimation for pedestrian navigation with smartphones.
[GPS, SHS, WiFi-Trilateration, WiFi-Fingerprinting, UWB, SLAM, Map-Matching]
Creation of an Android Geo Augmented Reality browser for indoor and outdoor navigation (from data, to rendering). (poster [fr])
[OSM, SRTM1, Android, Rajawali, ArCore, Sceneform]
- Proto #1: TyrAr - Comparison of a custom filter with a device embedded filter (video)
- Proto #2: AmiAr - Smart Home Augmented Reality on a Smartphone (video)
- Proto #3: ResAR - Slam + Image Tracking + Wall Occlusions from OSM (video)
- Proto #4: Login'AR - Prototype of Inria Showroom AR app (video)

Ph.D.

[Abstract] - [Manuscript] - [Slides] - [Slides + Videos] - [PhD Defense Video - FR]

Applications for augmented reality can be designed in various ways, but few take advantage of geolocation. However, nowadays, with the many cheap sensors embedded in smartphones and tablets, using geolocation for augmented reality (Geo AR) seems to be very promising. In this work, we have contributed on several aspects of Geo AR: estimation of device positioning and attitude, and the impact of these estimations on the rendering of virtual information.

In a first step, we focused on smartphone attitude estimation. We proposed the first benchmark using a motion lab with a high precision for the purpose of comparing and evaluating filters from the literature on a common basis. This allowed us to provide the first in-depth comparative analysis in this context. In particular, we focused on typical motions of smartphones when carried by pedestrians. Furthermore, we proposed a new technique for limiting the impact of magnetic perturbations with any attitude estimation algorithm used in this context. We showed how our technique compares and improves over previous works.

In a second step, we studied the estimation of the smartphone's position when the device is held by a pedestrian. Although many earlier works focused on the evaluation of localisation systems, it remains very difficult to find a benchmark to compare technologies in the setting of a commodity smartphone. Once again, we proposed a novel benchmark to analyse localisation technologies including WiFi fingerprinting, WiFi trilateration, SHS (Step and Heading System) and map-matching.

In a third step, we proposed a method for characterizing the impact of attitude and position estimations on the rendering of virtual features. This made it possible to identify criteria to better understand the limits of Geo AR for different use cases.

We finally proposed a framework to facilitate the design of Geo AR applications. We show how geodata can be used for AR applications. We proposed a new semantics that extends the data structures of OpenStreetMap. We built a viewer to display virtual elements over the camera livestream. The framework integrates modules for geolocation, attitude estimation, POIs management, geofencing, spatialized audio, 2.5D rendering and AR. Three Geo AR applications have been implemented using this framework. TyrAr is an application to display information on mountain summits and cities around the user. AmiAr allows one to monitor lights, shutters, tv in a smart apartment. Venturi Y3 is an AR-Tour of Grenoble with audio description and experiences.

The PhD defense took place at Inria Grenoble on November 10, 2017.
The subject was: "On Mobile Augmented Reality Applications based on Geolocation".

The PhD thesis has been directed by:

Nabil Layaïda, Tyrex team, (thesis director, Inria)
Pierre Genevès, Tyrex team, (co-supervisor, CNRS)
Hassen Fourati, Necs team, (co-supervisor, Gipsa-Lab)

In addition to the supervisors, the jury was composed of:

Valérie Renaudin, Directeur de Recherche, IFSTTAR (Rapporteur)
Takeshi Kurata, Professor, AIST, Japan (Rapporteur)
Oliver Ruepp, Dr. rer. nat., Apple Inc., U.S. (Examinateur)
Laurence Nigay, Professeur, LIG (Examinateur)

Engineer activities (2012-2014)

Management of subprojects and creation of libraries for Venturi european project (immersiVe ENhancemenT of User-woRld Interactions).
http://venturi.fbk.eu (video)
Working with OpenStreetMap client side. Parsing OSM Documents, projections, routing, UI (MapBox, MapsForge, OpenLayers...) [OSM, Android, OWP]
Working with OpenStreetMap server side. Mount OSM Server: Postgis, Nominatim, Tilemill... Create WebApi access [Node.js]
Creation of an Augmented Reality and an Augmented Panorama Frameworks for Android. [Android, OpenGL ES, Sensors]

Publications

A Method to Quantitatively Evaluate Geo Augmented Reality Applications [HAL, PDF, Abstract]
Thibaud Michel, Pierre Genevès, Nabil Layaïda
ISMAR 2018 - International Symposium on Mixed and Augmented Reality, Oct 2018, Munich, Germany. pp.1-6
Attitude Estimation for Indoor Navigation and Augmented Reality with Smartphones [HAL, PDF, Abstract]
Thibaud Michel, Pierre Genevès, Hassen Fourati, Nabil Layaïda
Pervasive and Mobile Computing, 2018, 46, pp.96-121. ⟨10.1016/j.pmcj.2018.03.004⟩
On Mobile Augmented Reality Applications based on Geolocation [HAL, PDF, Abstract]
Thibaud Michel
Mobile Computing. Université Grenoble Alpes, 2017. English. ⟨NNT : ⟩
On Attitude Estimation with Smartphones [HAL, PDF, Abstract]
Thibaud Michel, Pierre Genevès, Hassen Fourati, Nabil Layaïda
IEEE International Conference on Pervasive Computing and Communications, Mar 2017, Kona, United States

Applications

Benchmarks Attitude on Smartphones
We investigate the precision of attitude estimation algorithms in the particular context of pedestrian navigation with commodity smartphones.

Senslogs
This android application records and store values from internal sensors.

Timelapse - Sony Camera (on my free time)
Take pictures with interval time in Wifi Mode for your Sony camera.

Teaching

pdf Android - Projet PDR (2016-2017).pdf

pdf Android - Projet PDR (2015-2016).pdf
project.zip

pdf Android - Projet PDR (2014-2015).pdf
assets.zip

Tyrex | Project

Thibaud Michel

Research activities (2014-2018)

Ph.D.

Engineer activities (2012-2014)

Publications

A Method to Quantitatively Evaluate Geo Augmented Reality Applications [HAL, PDF, Abstract]

Attitude Estimation for Indoor Navigation and Augmented Reality with Smartphones [HAL, PDF, Abstract]

On Mobile Augmented Reality Applications based on Geolocation [HAL, PDF, Abstract]

On Attitude Estimation with Smartphones [HAL, PDF, Abstract]

Applications

Teaching

Contact