When “satellite remote sensing” meets “digital man” — smart earth forum focuses on multi-source space-time satellite remote sensing

What sparks can satellite remote sensing data technology collide with digital people? What is the relationship and intersection between the two? On March 10, sponsored by Piesat Information Technology Co.Ltd(688066) Co., Ltd., the second Salon of “smart earth lecture hall” with the theme of “multi-source space-time satellite remote sensing meets digital people” was held in Beijing.

Dr. Liu Yibin, associate professor of Tsinghua University, Dr. Wang Miao, associate researcher of Beijing University of Aeronautics and Astronautics, and Dr. Wang Tao, senior vice president of Piesat Information Technology Co.Ltd(688066) company, participated in the salon. The three experts focused on hot topics such as Earth 3D, artificial intelligence, combination of virtual and real, augmented reality, real 3D, digital man and so on, It gives authoritative answers from the aspects of technological development and industry status Piesat Information Technology Co.Ltd(688066) company’s senior vice president presided over the salon. In recent years, cloud computing technology, mobile Internet technology, big data technology, Internet of things technology, 5g, artificial intelligence technology and meta universe technology have developed rapidly, and the field of remote sensing has also been greatly improved.

Wang Tao introduced satellite, UAV, intelligent driving and other terminals, and described the wide application of measurement technology in military and daily life. In terms of real scene three-dimensional measurement, UAV and satellite play a complementary role. The terminal mobile phone provides us with a holographic remote sensing observation network integrating space, heaven and earth.

“The meta universe is the evolution of our Internet from two-dimensional to three-dimensional,” Wang Tao said. Spatial mapping is one of the important means to establish a virtual world. When talking about digital twins, Wang Tao explained its application in emergency management and disaster treatment. Taking Piesat Information Technology Co.Ltd(688066) ‘s subway digital modeling as an example, he simulated subway passenger flow, emergency management, intersection evacuation, etc. the digital modeling provided a more accurate parallel space-time simulation.

“Digital man is an entrance to the meta universe to provide intelligent services”. In Wang Tao’s view, digital man has a very broad application scenario. Digital man has natural advantages, such as virtual actors, virtual anchors, virtual assistants, etc. Character modeling, vision driven, voice driven, text driven and emotional computing are important underlying technologies of virtual human.

Liu Yibin said that at present, the resolution of satellite remote sensing imaging equipment is not high enough in time and space, and multi-dimensional and multi-scale high-resolution observation can be used as a supplement to remote sensing observation. It is understood that Liu yebin’s team has developed a multi-dimensional and multi-scale imaging system, which can achieve observation of 250 million pixels and 30 frames per second through two-level imaging. This system can clearly see the vehicle license sector a few kilometers away and recognize the face a kilometer away, which is of great help in the field of security.

Liu Yibin said that the difficulty of dynamic high-resolution imaging in real scene 3D is how to combine dynamic and static. “Two-dimensional observation is a fixed perspective, but three-dimensional can have any viewpoint, so how to integrate this information is a difficult problem”. Artificial intelligence technology will be very helpful to the later editing and modeling of three-dimensional real scene.

“Communication and communication in the future will be a major direction for the application of digital human”, said Liu Yibin. “The character image will be transmitted through holographic display equipment and two people in the distance can communicate with each other by holographic projection”. The three technologies of dynamic capture, reconstruction and generation are the research core of digital human technology. He said that motion capture is to realize the real-time dynamic three-dimensional reconstruction and motion capture of the human body through the depth camera. Reconstruction refers to the reconstruction of appearance. The core is to collect people’s real-time dynamics to realize the holographic communication system of digital people. Generation refers to the creation of digital human expression, action, image, voice and so on. Cost control is the key, and artificial intelligence will reduce the cost of this technology in the future.

Wang Miao believes that digital twins connect our physical world and our virtual world. This technology can also be used in the field of satellites. He said that the virtual twin of digital satellites can help us monitor the stealth state of satellites and provide guidance for maintenance. In terms of virtual physiological human body and medical simulation, digital twin can provide some major information infrastructure to support personalized surgery, precision treatment and the research and development of new drugs and new medical devices.

At present, Wang Miao’s laboratory focuses on the micro scale modeling of human constituent units, personalized surgical simulation and the interaction of drugs on the human body. At present, it has achieved the modeling of organs and tissues. In the future, it will also model in the micro fields of physiology and biochemistry, from molecules to cells. The combination of digital twins and biochemical physiological human body will bring subversive impact on the innovation in the field of life science and medicine. City level digital twins can realize crowd behavior simulation, including emergency handling of emergencies and rehearsal of urban activities, which plays a great role in our urban safety.

“Another technical route of metauniverse is a little cartoon, not completely reproducing the real world”, Wang Miao said. At present, the modeling tool for user-side virtual content generation, which makes it very convenient for users to create the virtual world, is a very popular research direction.

For digital virtual human, Wang Miao said that the underlying technology of virtual human mainly includes three parts. One kind of technology mainly carries out high fidelity modeling of virtual human with high realism, the other is expression tracking and gesture recognition technology, which mainly drives virtual human, and the other is technology based on continuous learning, which aims to endow knowledge to virtual human, Let it interact with people.

With the development of cloud computing, big data, artificial intelligence, augmented reality, real scene 3D, Earth 3D and other technologies, satellite remote sensing has a broader depth in the application end. Three dimensional vision, virtual reality, computer photography, graphic computing and other technologies provide the basis for the generation and reconstruction of digital human.

I believe that one day in the future, people can be in the real virtual world, and every user can freely choose to incarnate as a digital person to produce and communicate in the meta universe world. All technologies explored in the process of realizing this will become the unremitting driving force to promote mankind to a better future. (Zhan Zhao)

smart earth lecture hall

“Smart earth lecture hall” is a column on pie engine remote sensing cloud service platform, which has been carried out for more than 100 times. The column regularly invites academicians, experts, professors, academic officials and other industry celebrities to make forward-looking reports, use the lecture hall to discuss new theories and technologies in remote sensing, navigation, meteorology, ocean, water conservancy and other geoscience fields with Chinese and foreign counterparts, and share new progress and achievements in geoscience research.

The offline Salon of “smart earth lecture hall” is an innovation and extension on the basis of the original column, continues the rigorous, interesting and informative style of the column, closely follows the cutting-edge technology, discusses the industry trend, and also provides a valuable experience reference for the industry.

- Advertisment -