Show HN: LOGEO, a web app based on Spanish language Twitter data

1 pointstranspy7y ago2 comments

INTRODUCTION

I present my first web application, written in Python! https://www.moorelanguage.com

I've been working in translation/localization for some years. Then I started learning more about text data and decided to learn Python.

Recently, I've been working on a side project that involves data analysis of Spanish language data.

THE DATA

I have seen some analysis on Twitter data, but none in Spanish so far. Thanks to Google Dataset Search I found a nice dataset: https://bit.ly/2Cn6sKH

I started learning some libraries and exploring the data set. Then I built a web app with it.

THE APP

This is an app that allows you to explore the whole dataset on a map. Also, it leverages the dataset to implement a similarity model, to guess the city of any text you input.

You can do the following things within the app:

Enter one word. See the cities in which the word is used with the highest frequency. Click on the circles on the map to see the most similar words in each city.

[https://imgur.com/YR8x0G2]

[https://imgur.com/8gJ3qEP]

Compare two words. See the cities in which these are used with the highest frequency.

[https://imgur.com/VQHmPLY]

Click on any country name. See the most frequent or unique words for that country.

[https://imgur.com/RMAMRy4]

Find the regional origin of a text in Spanish. See which cities are the most similar to the text you entered.

[https://imgur.com/nG69gie]

[https://imgur.com/N9Lni8A]

TOOLS

I used Pandas to read and process the dataset. For text processing, I used Gensim. To plot the cities on a map, I used Folium. I used Flask to build a web app, which I host on Digital Ocean.

CONCLUSION

I enjoyed this process a lot! I am happy about it, I learned a lot and I was able to materialize my idea.

The code is in github: https://github.com/luismond/logeo

What do you think? What could I do next?

2 comments

djaychela7y ago

Hey

Learning Python person here.... I like what you've done, and thanks for showing it (and the code). It's nice to see a project which does something that's interesting, but where the code base is small enough to actually understand, so I've found it useful to look through it and read some of the code.

For 'next', I'd have said some improvements to the UI - for instance, if it was possible to overlay one of the 'similar' to words which appear below a map in a different colour so you could see more of the difference in distribution? And maybe making the front page a series of buttons (with multiple buttons on each line) rather than the scroll-heavy list that's present at the moment.

Just meant as constructive suggestions, and also from experience I know that having someone else ask for something leads you down paths you've not thought of.. good work though!

transpyOP7y ago

Hey thank you! I really appreciate you taking the time to checking it out! Yes, I am working to improve the UI, I spent most of the time working on the back end, on the actual scripts. There lies my strength, I guess. I am not a very good graphics or web designer, and I plan to work with a UI person in the future. Stay tuned, I will make this app work also for English speaking cities!

j / k navigate · click thread line to collapse