Author Archives: Abdalla

Plotting Twitter Data

I’ve only just come to realize some social media sites allow you to download your entire historical activity in one large data file. I don’t know about other sites, but i’m aware that twitter does give you the option to download … Continue reading

Posted in Uncategorized | Tagged , , , , , , | Leave a comment

Exploring New and Used Car Data in Malaysia

I came across a local website where individuals/dealers in Malaysia can post information on used and new cars that they are selling. Why i, in particular, would browse such a site might dumbfound some people (those who personally know me would … Continue reading

Posted in Uncategorized | Tagged , , , , , | Leave a comment

Web Scraping: The Sequel | Propwall.my

Alright. Time to take another shot at web scraping. My attempt at scraping data off iBilik.my left me a little frustrated because of how long it took, and also at how i couldn’t get much information because of all the duplicated … Continue reading

Posted in Uncategorized | Tagged , , , , | Leave a comment

An Attempt at Web Scraping: Cyberjaya Rental Rates

I came across this short tutorial on how to use the rvest package to scrape information from websites. It looked pretty straightforward, although it took a while to get the hang of some of the HTML jargon. So i figured … Continue reading

Posted in Uncategorized | Leave a comment

Eroding Commitment

There’s an old saying that goes: “If you dream and want something hard enough, but have no commitment….then you’re probably full of shit”. After having finished the Getting and Cleaning Data course on Coursera, I haven’t typed a single line of R … Continue reading

Posted in Uncategorized | Tagged , , | Leave a comment

Summarizing/Exploring Global Wealth Data

Alright. Time to take a crack at another data set, and see if i can hone some of those data cleaning skills that i’ve just learned on Coursera. The data sets I’m using are from the World Bank’s Changing Wealth of … Continue reading

Posted in Uncategorized | Tagged , , , , , , , | Leave a comment

Summarizing Development Funds Data

Still going through the Getting and Cleaning Data course on Coursera while also enrolling in the Data Manipulation using dplyr course on DataCamp. That said, i guess working on a teeny data exploration task on actual raw data would help in remembering all these new … Continue reading

Posted in Uncategorized | Tagged , , , | Leave a comment

R Functions: Removing NA Columns

I realize that this might sound a little nerdy, but making simple and useful R functions can be quite fun. Here are a couple of simple R functions i occasionally use that remove columns with NAs. This function would remove … Continue reading

Posted in Uncategorized | Tagged , , , , | Leave a comment

Scraping IMDB’s Search Results

Learning how to scrape web pages on the internet, and given how i’m still a complete programming newbie, it took some getting used to. Credit to a certain Lee Hawthorn on how to do this. I used SelectorGadget, as was suggested in … Continue reading

Posted in Uncategorized | Tagged , , , , , , , | Leave a comment

First R function

One thing that i’ve always wanted is have a function that would run the corrplot function of all the numerical variables. Since i’m still new to R, this is all i could come up with. It definitely needs some more … Continue reading

Posted in Uncategorized | Tagged , , , , , | Leave a comment