Expanding Storage On EC2

While streaming hundreds of thousands of tweets from my EC2 cloud machine, I realized that my tiny 8gb EC2 instance was starting to run out of memory. So I went to my AWS dashboard to increase the memory, thinking that it would just take a couple clicks. Little did I…

Keeping Things Running on EC2

One of the joys of cloud computing is not having to keep your laptop/computer on 24/7. I remember back in the old old days, downloading at less than 1kb/s and having to leave the computer on overnight to download anything more than a few megabytes in size!…

Project Fletcher: Twitter Streaming Counties

Given a longitude and latitude point, how do you determine what county it's in. This is the problem I have finally solved. First of all, it seems really simple, and there are definitely simple ways to do it, but given the large volume of data I needed to process, I…

Twitter Stream from US Only

I won't lie, Twitter's streaming API is pretty amazing. I still find it amazing that companies like twitter give out so much much information for free. The streaming API returns a fraction of all current tweets an allows you to filter based on many different factors. One of the factors…

Project Fletcher

Project Fletcher Our 4th project at Metis is called Fletcher and involves using unsupervised learning and natural language processing (NLP) while also using NoSQL with MongoDB for DBs and different web APIs. It is also optional to continue this project through our final project. So we were challenged to think…