top of page

R script to automatically scrape data from a google form to an SQL server

Software / programming languages used:
R
Google sheets
Google forms

Project Details:

This project was built to solve an issue that was faced whilst trying to create a live customer feedback dashboard on PowerBI.

​

The idea of the main project was for customers or users to submit their feedback via google forms and a customer service manager would get to view the reviews and any potential issues on a live dashboard and initiate real-time fixes to ensure smooth service delivery.

​

The data from google forms can be automatically stored in google sheets, however, there is no way to establish a live connction to PowerBI without the use of other expensive addons such as google bigquery or Micrsoft Power Automate.

​

Hence, this script was built which automatically imports the google sheets at a pre determined interval, filters out old data from new data and uploads it onto an SQL server. This process repeats itself every pre determined interval. With this, the dahsboard was able to get updated within a minute from someone leaving a review.

​

Scroll down to view highlights and download link for the R script

​

The link to the main PowerBI project is available here.

Highlights

R script google sheets

Output when the R script is running. Data is downloaded, old data is removed and new data is added to the SQL server which will then be queried by PowerBI

bottom of page