Who's Watching the Gatekeepers: Critiquing the Almighty Critics

A few weeks ago I was on a flight and was looking through the movies they offered. Two movies caught my eyes: Should I watch the 'regular' version of Lincoln or the 'vampire hunter' version... Looking up the Metacritic review of Lincoln Vampire Hunter I found this: While critics for…

Luther Presentations

D-DAY Today was the day when everyone in our class got to present our Luther Projects; which is our 2nd project, but really our first major individual project in class involving a lot of coding/statistical methods. Presentations We spent the whole day presenting. Everyone presented for about 5-10 min…

Debugging Metacritic

Metacritic, whyyyy? In this entry I'm going to talk about 2 major issues that came up while scraping data from metacritic.com, which is now the most important data source for my Luther Project. The 2 major issues involved TERRIBLE pagination issues and annoying redirects. Let's start with the pagination…

Scraped Knees, Logging Helps

Scraping Problems BeautifulSoup for Python is a great tool for scraping but that doesn't necessarily mean everything is easy. Scraping is all about the unknown. And one of the golden rules is that you can't trust the page you're trying to scrape. You can't trust that it's telling you the…

Long Days

What Day is Today? Today was one of those days when I thought it was much later on in the week than it actually was. I'm starting to feel very stretched and realize how important rest is to the learning process. It's easy to forget that there are only 24…

Just Scraping By

BeautifulSoup Today, we got into a python tool called BeautifulSoup (v.4) that is used to scrape data from websites. This wasn't my first time scraping since I have some experience using differnt PHP tools, especially SimpleHTMLDom. But, after using BeautifulSoup just for a few minutes, I quickly realized how…