Project Fletcher: Twitter Streaming Counties

Given a longitude and latitude point, how do you determine what county it's in. This is the problem I have finally solved. First of all, it seems really simple, and there are definitely simple ways to do it, but given the large volume of data I needed to process, I…

Cleaning County Data - No Click Baity Titles Available...

This is a follow up to yesterday's entry about cleaning county election data. The other half (closer to 90%) of my data puzzle was county data for a myriad of other factors found here (the first download). While this dataset provides a wide range of data about counties, it also…

Logging Like a Professional Lumberjack

Basic Logging Tutorial for Python A while back, I wrote an entry where part of it describes a how to on logging in Python. If that was a super basic tutorial on logging, this one kicks it up a notch as a regular basic tutorial! What is it? I guess…

[post for post in posts if post == this]

Comprehending List Comprehensions List comprehensions are pretty cool. They make a lot of sense and are really well designed in Python. While working on some challenges today at Metis, I was able to shorten a lot of my code while using this technique. List comprehensions with Python are only now…

In a Pickle

Getting Out of a Pickle with Pickle The Problem One of the problems with writing functions for scraping data is that in the process while testing you may have to do multiple calls of the scraping program. And when you are sometimes making hundreds, if not thousands, or even far…

Just Scraping By

BeautifulSoup Today, we got into a python tool called BeautifulSoup (v.4) that is used to scrape data from websites. This wasn't my first time scraping since I have some experience using differnt PHP tools, especially SimpleHTMLDom. But, after using BeautifulSoup just for a few minutes, I quickly realized how…

I'm Now a Python Believer

Python Is Awesome I just want to say that compared to Javascript and PHP, Python is a beautiful language. I love the syntax that is used, especially the forced indentation. This really keeps code incredibly readable! I spent part of today looking at this quora post and was amazed at…