mago3D = {Indoor, Outdoor} + {Overground, Underground} + {Objects, Phenomena} + {Static, Dynamic} It would be awesome if you can have a virtual replica of real world that you can play with and do the simulation to see what would happen. That is 'Digital Twin', the ultimate goal of mago3D! At the FOSS4G NA 2019, I talked about the recent achievements and improvements of mago3D project, an open source based 'Digital Twin' platform. mago3D(http://mago3d.com) is relatively new project that was first released in July 2017. The ultimate goal of mago3D project is developing an open source based digital twin platform that can replicate and simulate the real world objects, processes, and phenomena on web environment. mago3D is on its way to achieve this goal now. Currently mago3D more focuses on managing and visualization of various types of 3D data ranging from simple box style extrusion model, point clouds, realistic mesh, to complex BIM(Building Information Modeling), AEC(Architecture, Engineering, Construction) data. mago3D supports industry standards 3D formats such as IFC, CityGML, IndoorGML, 3DS, Collada DAE, OBJ, LAS, JT, and so on. mago3D has been used in various industry sectors including ship building, urban management, indoor data management, and national defense. In this talk I showcased several real projects that had employed the mago3D and talked about what I'd learned during this projects. I also talked more about the future plan of mago3D towards visualizing/simulating of {static and dynamic data}, {underground and overground features}, {indoor and outdoor spaces}, {objects and phenomena} at the same time on web browser. As a tech-savvy country, there're lots of discussions and activities around digital twin in Korea. I also shared my real experiences on this in this talk.

1. What we’ve done so far with mago3D,
an open source based ‘Digital Twin’ platform
Sanghee Shin(shshin@gaia3d.com)
16th April 2019

2. GeoBIM

3. From Standard,
GIS
CityGML
GeospatialInformation
GISStandards
IFC
BIM
OutdoorModel
IndoorModel
BIMStandards
Construction
DrawingsInfo.
In/Outdoor
GIModel
(GeospatialInformation
Model)

4. From Industry,

5. From Open Source… mago3D

6. Introduction – mago3D
mago3D is a platform for …
Visualizing massive and complex 3D objects including BIM
on a web browser
1
Seamless integration of BIM/AEC and 3D GIS in a single space2
Web based collaborative issue/process management4
‘Digital Twin’ that can create parallel worlds in a virtual reality
with numerous IoT, sensor data
3
= GIS + BIM + Open Source

7. Introduction – Architecture of mago3D
mago3D.JS
Cesium/WWW
Client
internet
Web Server WAS
F4DStorage
mago
Content
Management
DataBase
F4D Converter
3 main cores of mago3D

8. Introduction – Overall System Components
DB Postgresql 9.6 + PostGIS
Web Server Nginx 1.12.1 / Apache 2.4
Language Java8
Framework Spring(Springboot) + Mybatis
Build
Gradle
Log
Logback/Log4j
2
Security
ESAPI
Report
Jasper/POI
View
JSP/JSTL
UI/UX
Jquery
Chart
Jqplot/Axisj
Template
Thymeleaf
Handlebars
Web Map Server GeoServer
OS Centos 7.2
WebGL Globe Cesium, WorldWind, …
Cache EhCache, Redis
Container Docker
WAS Tomcat 8.5

9. Introduction – Core parts of mago3D
F4D Converter mago3D.js
mago3D.js
3D GIS Engines
Cesium
Web World Wind
API
API
service html
F4D Converter converts 3D formats(IFC, 3DS, OBJ, DAE, JT)
to 3D internet service format F4D. It carries out data size
reducing and pre-processing for fast rendering
A plug-in composed of pure javascript which enables 3D GIS
engines to handle large-sized and highly detailed AEC data
F4D Converter
F4D
.ifc
.3ds
.obj
.dae
.gml

10. Key Algorithms
GeoBIM is too heavy due to so many vertices and triangles in so many objects.
This causes two major issues in handling GeoBIM in web browsers.
!
Network Traffic Rendering Speed

11. Key Algorithms
So we introduced 3 concepts to solve these issues.
1. Reducing file size 3. Preprocessing
for speed
2. Building rougher
LOD
making indices
used in culling
removing duplication

12. Key Algorithms
Step What is this? Used for
1. Model/Reference
A concept of writing 3D data that only one
geometry among multiple geometries
congruent with each other is written.
reducing data size of semantic
data(ex. BIM/CAD, 3D data by
modeling)
2. NSM(Net Surface Mesh)
This is composed of 2 steps.
1. building meshes with regularly gridded
vertices on surfaces of raw 3D model.
2. triangle reduction.
making rougher LOD
※ 2nd step is separately applied
in simplifying targets in case of
triangular meshes such like TIN
or random-shaped 3D data
3. Visibility/Spatial index
Visibility index is for occlusion culling and
spatial index is for frustum culling in indoor
camera working.
carrying out a serial combination
of 2 cullings for fast
determination of targets to be
shown
Let’s look into more concretely.

13. with 4 geometric meshes - 4 models 23 objects are created. - 23 references
Image source : www.vecteezy.com
Key Algorithms : F4D, lightweight service format
Example of Model-Reference

14. 1. Build a triangular mesh based on the grid structure from the original three-dimensional data.
Key Algorithms : F4D, lightweight service format

15. Key Algorithms : F4D, lightweight service format

16. Visibility Index
An index describing which inner objects
can be seen from selected positions in AEC.
This index is used in occlusion culling in
run-time visualization of mago3D.
Key Algorithms : F4D, lightweight service format

17. Spatial Index
An index describing which inner objects are
in cubes, spatial sub-divisions of AEC.
This index is used in frustum culling in
run-time visualization of mago3D.
Key Algorithms : F4D, lightweight service format

18. 1. When a camera position and
2. the viewing direction of it are setup,
3. mago3D does frustum culling on spatial indices
4. and do occlusion culling on the result of the
frustum culling.
5. Finally mago3d finds targets to be rendered.
(intersection between two indices)
→ It possible to select targets to be rendered
without any complicated geometric operation in
run-time.
How to use both indices
Key Algorithms : F4D, lightweight service format

19. mago3D runs on any device
Results: Accessible from any device, anytime, anywhere

20. Results: BIM(Indoor/Outdoor) Integration
Seamless integration of indoor and outdoor space
on the same platform
Scene from indoor to outdoor through windows Scene from outdoor to indoor through windows

21. Results: MEP Integration
Integration of large size MEP and 3D GIS on a web browser

22. Results: AEC Integration
Integration of large size AEC and 3D GIS on a web browser

23. Results: Various API supported (OpenAPIs)
APIs are supported for developing application
systems(currently 29 APIs) moving/rotating
a full building
moving objects &
viewing attributes registration/monitoring/search of issues
24

24. Real Cases – KOPRI(Korea Polar Research Institute)
• Project Name: King Sejong Research Base Facility Management System
https://www.youtube.com/watch?v=ufGz-uGG6vM

25. Real Cases – OpenIndoorMap Project

26. Real Cases – National Institute of Advanced Industrial Science and Technology, Japan

27. Real Cases – Others

28. What I’ve learnt from real projects
• Visualizing many BIM data on 3D GIS is still challenging
• Many clients want to see *PRETTY* picture!
• After seeing the pretty picture, many clients want a functionality that can be done
through 2D or 2.5D.
• 3D analysis, 3D simulation are among wish list that clients want to see on top of full of
GeoBIM platform.
• It’s still doubtful how 3D gives any material benefits over 2D.
• 3D is expensive and BIM is more expensive!
• Standards are not widely accepted across industries.
28

29. In Future
Towards Digital Twin Platform!

30. In Future: Digital Twin
Digital Twins
A digital twin is a virtual representation of a physical
object or system across its lifecycle, using real-time
data to enable understanding, learning and
reasoning.

31. Digital Twins
Concept: Digital Informational Construct
Vision: Create, Test, Build

32. Level of Digital Twins
Level 1
3D Visualization
Level 2
Real-time Monitoring
Level 3
Analysis, Prediction
Optimization
<Source: Use the IoT Platform Reference Model to Plan Your IoT Business Solutions, Gartner>

33. <Source: Steve Liang(2016)>
Location is the first class
citizen for IoT!
In Future: Location Technology Evolution
33

34. In Future: Location Technology Evolution
Size of Space
Update Cycle
Small
1980
1990
2000
2010 ~
2020
Large
Static
Dynamic
<Source: Sakong, Hosang(2016), Policy Directions of Spatial Information for Hyper-connected Society> 34

35. In Future: GeoSpatial Paradigm Shift
Past Future
Concept Object Information Context Awareness
Data Consumer Prosumer/DIY
User Person Things
Visualization Real World Cyber Physical Systems
Application Base Map Key Factor for Fusion
Driving Entity Public Sector Private Sector
Space Outdoor Indoor + Outdoor +
Update Cycle Static Dynamic
<Source: Hosang Sagong(2016), ‘Policy Directions of Spatial Information for Hyper-connected Society’ modified>

36. Sensors, sensors, and sensors…
Sensory Organ
Memories
Brain
IoT(Internet of Things)
Big Data
A. I.
Smartizen(10Bn) Smart Devices(100Bn) Smart Sensor(100Tn)

37. In Future
37
{Indoor, Outdoor}
{Static, Dynamic}
{Objects, Phenomena}
{Overground, Underground}
{Multi-Sensor, Multi-Source}
mago3D

38. In Future: Point Cloud Integration

39. In Future: Weather/Climate/Air Pollution/CFD

40. Summary
Summary of mago3D!
• BIM/AEC and 3D GIS integration in a single space
• Web based – no need to install additional program
• Massive and complex 3D objects rendering
• Open source – Apache and AGPL license
• Supports industry standard formats(CityGML, IndoorGML, IFC, 3DS, DAE, GLTF…)
• In-Browser 3D objects moving/rotation/heading adjustment
• Highly extensible architecture
• Will be ‘Digital Twin’ plaform!
40

41. For more information, please visit http://mago3d.net
All the source codes are here: https://github.com/Gaia3D/mago3d
Thank you!
33
This research was supported by a grant(number:19NSIP-B080778-06) from National
Spatial Information Research Program (NSIP) funded by Ministry of Land, Infrastructure
and Transport of Korean government.
Sanghee Shin shshin@gaia3d.com