"The capacity to learn is a gift; the ability to learn is a skill; the willingness to learn is a choice." - Brian Herbert

Politweets: Real Time 2016 Election Twitter Analysis

For my final project at Metis, I've created a web application called PoliTweets. The app tracks twitter trends in volume, sentiment, and topicality for 2016 Election candidates. I am using Flask, MongoDB, D3, Vader Sentiment Analysis, and Gensim on an EC2 Server. Here is a link to the slides for…

Data Scientists vs Statisticians vs Programmers

I often get asked what a Data Scientist is and I think I've gotten my short laymen's answer down: "Data Scientists are kind of like programmers and statisticians. They know more about statistics than programmers and more about programming than statisticians." What I Learned Today: Almost half of the 1,…

Final Stretch at Metis

It's been 9 full weeks at Metis now! That means that there are 3 full weeks left. This is the final stretch. And to get myself ready I watched this video over and over again! Just do it! What I Learned Today: T-Rex weighed 14,000lbs.…

Cognitive Cooking with Watson

So what is Watson? On Wikipedia it's defined as: "Watson is a question answering (QA) computing system that IBM built to apply advanced natural language processing, information retrieval, knowledge representation, automated reasoning, and machine learning technologies to the field of open domain question answering." Basically it's the beginning of the…

Expanding Storage On EC2

While streaming hundreds of thousands of tweets from my EC2 cloud machine, I realized that my tiny 8gb EC2 instance was starting to run out of memory. So I went to my AWS dashboard to increase the memory, thinking that it would just take a couple clicks. Little did I…

Data Scientist Janitors

I came across this article the other day and it got me thinking. The main premise of the article is that Data Scientists' minds are being wasted cleaning data. While Data Scientists are hired to provided good analysis for decision making, what they end up doing the majority of time…

Machine Learning and Bird Identification

This is a pretty cool website that can be found here that's run by some researchers at Cornell University. I think it's pretty cool to see how machine learning techniques are being used in the real world. It actually reminded me of this site from Microsoft that guesses your age.…

The Power of Data Visualization

There's something about data visualization that gives power to statistics. Hearing the death counts of wars often doesn't hit home, but seeing it visualized gives it much more power. The video here about the human toll of WWII is incredibly well done and incredibly powerful. What I Learned Today: Over…

Keeping Things Running on EC2

One of the joys of cloud computing is not having to keep your laptop/computer on 24/7. I remember back in the old old days, downloading at less than 1kb/s and having to leave the computer on overnight to download anything more than a few megabytes in size!…

Project Fletcher: Twitter Streaming Counties

Given a longitude and latitude point, how do you determine what county it's in. This is the problem I have finally solved. First of all, it seems really simple, and there are definitely simple ways to do it, but given the large volume of data I needed to process, I…

Moving Blog from Github to Digital Ocean

I once again moved my blog. I first moved from using Jekyll to using Ghost with a tool called Buster. I've documented this process already here. While this was great, it also had several different issues that I had to work around. Static pages were a pain in the butt…

Twitter Stream from US Only

I won't lie, Twitter's streaming API is pretty amazing. I still find it amazing that companies like twitter give out so much much information for free. The streaming API returns a fraction of all current tweets an allows you to filter based on many different factors. One of the factors…

Project Fletcher

Project Fletcher Our 4th project at Metis is called Fletcher and involves using unsupervised learning and natural language processing (NLP) while also using NoSQL with MongoDB for DBs and different web APIs. It is also optional to continue this project through our final project. So we were challenged to think…

Web Projects: Collaborators CMS

To view all of my portfolio, click here: Portfolio Here are pictures from a custom-built responsive cms page I made for a past employer. It keeps track of magazine article/video collaborators while giving editors a way to edit and enter in people they worked with on their articles/shoots.…

Web Projects: Top Movie Charts

To view all of my portfolio, click here: Portfolio Here are pictures from a custom-built responsive movie charts page I made for a past employer. This page included a backend cms addition that allowed editors to update content appropriately:…

Web Projects: KPop Scraper

To view all of my portfolio, click here: Portfolio Here are pictures from an in-house KPop scraper I built for a past employer. It updated in real time asynchronously every 5 minutes and scraped articles from several different popular kpop news sites:…

Web Projects: Google Maps Tracker

To view all of my portfolio, click here: Portfolio Here are pictures from a custom-built responsive Google maps API project I made for a past employer. This was the MVP for an in-house mobile app to track celebrities' past locations:…

Web Projects: E-Commerce Platform

To view all of my portfolio, click here: Portfolio Here are pictures from a custom-built responsive ecommerce platform I built for a past employer. The system took in nearly $1 million usd in sales without a hitch and accomodated multiple languages and currencies:…

Web Projects: Auction App

To view all of my portfolio, click here: Portfolio Here are pictures from a custom-built responsive Auction platform I made for a past employer. This app had real time asynchronous updates and worked on mobile as well:…

Web Projects: Youtube Page

To view all of my portfolio, click here: Portfolio Here are pictures from a custom-built responsive youtube page I made for a past employer. It used the Youtube API and did not require and dynamically pulled new videos with options to not include designated videos:…