ZAC

Barcelona | Capacity Building Resources Gateway

ZAC Space Resources Gateway

High-Level Project Summary

ZAC is an immersive digital ocean, becoming the International meeting point where Governments, Municipalities, Policymakers and Ocean cleaning up Entities can connect to share intelligent sustainable strategies, to learn Earth Observation Space technology and a place to discover, AI predict and evaluate natural disasters.

Link to Final Project

https://github.com/JonatanDo/ZAC

Link to Project "Demo"

https://www.youtube.com/watch?v=egc0meLWsKQ

Detailed Project Description

Zac is a metaverse space to connect with 3d glasses, mobile, website or TV. This digital 3D space is and Ocean surface mapped with EO satellites data over multi-channels: the RBG, Ultraviolet and Near Infrared spectrum bandwidths.

ZAC Digital Ocean is 100x100 square km with the next features:

Meeting zone to share sustainable strategies and discuss.
Link to NASA ARSET Earth Observation tutorials
Settings button to change the tile and date of the MODIS and Sentinel Space data
Algorithm selection to modify the pollution indicator

The result is a trusted data for policymakers to design strategies with a GLOBAL SUSTAINABILITY IMPACT.

ZAC is an event driven architecture system computed in the cloud that is divided in the next parts:

OCEAN Digital Metaverse: is a digital scenario designed over UE4 where the user walks or flies over a water body. This digital ocean twin is mapped with the pollution indicators selected by the user.

SPACE downlink backend: is the API to get MODIS and Sentinel Data. It is triggered when a the user want to discover a new place or date over the digital ocean. This AWS Lambda microservice checks the availability of multispectral images and if yes, it is downloaded to a S3 tile server to feed the ZAC technology.

AI CORE: is a Deep Learning algorithm with speech recognition NLP to create a keywords database of climate change news, scientific papers and EO tutorial videos from the NASA, JAXA and ESA resources.

ZAC IS SPACE CREATIVITY; the system owns an NFT collection that will be backend generated over the multispectral EO images to become tutorial diplomas. When a ZAC user completes, for example, the SAR Sentinel 1 videos serie, the specific NFT will be transferred to the user crypto-wallet.

1st ZAC NFT created for the NASA Hackathon 2022 participation

Zac technology has been demonstrated totheVices-President of the Catalonia Government, Laura Vilagrà. Now we have a direct feedback from EU politicians for the product validation and the main conclusions are:

there is a lack of data for the policymakers to take decisions when natural disasters.
the need of an EO expert user or robot in the ZAC metaverse to predict the disaster scenarios and it's probability.

Coding Languages:

Python for the NLP Deep Learning algorithm to create the NASA video tutorials keywords from the audio channel.
Unreal Engine 4 to design the Digital Ocean (Unity alternative since we couldn't compile to html5)
AWS cloud Computing to get Sentinel HUB space data from the S3 buckets and load the multispectral images in the Metaverse.
Open Source Computer Vision to apply expressions over RGB, NIR and UV tiff files.
Keras, Tensorflow, Panda and Numpy opensource libraries.

Space Agency Data

ZAC is connected to Earth Observation data to design a cloud tile server to feed any website or mobile map service like Google, Apple, MapBox or OpenstreetMaps via the next Space resources:

NASA

MODIS constellation for the 250, 500 and 1000 m resolution with hyperspectral satellite images.

ESA

Sentinel 1 for SAR technology that is day, night and all-weather technology,
Sentinel 2 for ports, beaches and river detail with up to 10m pixel accuracy for 13 bandwidths and
Sentinel 3 for huge range area with 300m pixel accuracy over 21 spectrum bands.

Hackathon Journey

Here we are, in the 2022 NASA Hackathon, what a Space opportunity! We have been 48 hours full-stack working over ZAC technology in the Mobile World Capital premises with Barcelona expert mentoring, OPGround excellent management and NASA professionals coming from Washington DC HQ for this event. Fantástico!

The most amazing thing is that the first day, Oriol expert mentor told us to talk with some users of our technology and get the feedback before implementing the solution. Since ZAC is for Governments and policymakers and after some lucky connections, We were talking with the vice-president of the Catalunya Government about NASA, natural disasters and how to predict this scenarios with ZAC. Thank you Laura!