High-Level Project Summary
We thought about a database and a web site, the website have the information that is provide for NTRS, but this information have a summary, keywords, autor, with the aim to teach the AI how to interact with the users and get a kind of social media.The AI has to interact with the user to improve himself who is an algorithm that is based on the preferences of the users, if the user like a math article more than others articles then the AI is going to show him more articles about math.
Link to Final Project
Link to Project "Demo"
Detailed Project Description
FIrst, we can let you a link for the explication of our project in spanish https://youtu.be/6nXDYPvnNfA.
- FIrst Step (Get the Data): In our project exist two differents was to get the data, in the first one we connectd our project with the NTRS API coming from a directly conection. The second way is use AI to use web scraping using python for to do click and fill all forms for get the data and put in a storage in our cloud project.
- We can use AWS, GCP or Azure for our project, to develeop all process and all jobs in our pipline.
- We use NLP to get a summary of each pdf file and insert this summary in a articles table in our new database
- We created a web platform, where users can interact with different articles, and the AISK platform will be able to give personalized recommendations to the users, and they will be able to read the summaries made by the AI to generate impressions and give statistical data about the articles and show different ratings of them.
Space Agency Data
In this project we are going to use the NASA Technical Reports Server (NTRS) for get the pdf files.
Hackathon Journey
This event was great for us, as we were able to share ideas that can help improve the scientific world and therefore the whole universe. Seeing how everyone gives ideas and shares experiences to solve a problem is something you don't see every day. We learned new technologies and knowledge that we can apply to our professional lives. We chose this challenge because our universities have helped us learn about artificial intelligence and its importance today. The focus of our project is to use artificial intelligence in most of the processes to solve different problems in our project. We want to thank the Sergio Arboleda University and Professor Adriana Araujo for organizing this event that left us a lot of knowledge and a great experience.
References
Comprehensive Guide to Text Summarization using Deep Learning in Python
https://www.analyticsvidhya.com/blog/2019/06/comprehensive-guide-textsummarization-
using-deep-learning-python/
- Recommenders https://github.com/microsoft/recommenders
- NLP examples https://github.com/microsoft/nlp-recipes
- Databases http://www.pymvpa.org/tutorial_datasets.html
- Recomendaciones usando
Python https://ourcodeworld.co/articulos/leer/1101/construyendo-un-sistema-derecomendacion-
simple-en-python
- Read pdf file using Python https://www.delftstack.com/es/howto/python/read-pdf-inpython/#:~:
text=PDFplumber%20es%20un%20m%C3%B3dulo%20de,para%20leer%2
0un%20archivo%20PDF.
- What is S3 https://aws.amazon.com/es/s3/getting-started/
-What is a container https://www.cio.com/article/247005/what-are-containers-and-whydo-
you-need-them.html
- Text Summarizer https://github.com/aravindpai/How-to-build-own-text-summarizerusing-
deeplearning/
blob/master/How_to_build_own_text_summarizer_using_deep_learning.ipynb
Tags
#AI #NLP #CloudComputing #Scrap #Python #Recommenders #MachineLearning #Colombia