How to extract data from Google Analytics and build a data warehouse (webhouse) from it?

Posted by nkaur301 on Stack Overflow See other posts from Stack Overflow or by nkaur301
Published on 2010-05-18T14:23:52Z Indexed on 2010/05/18 14:30 UTC
Read the original article Hit count: 121

Filed under:

data-warehouse

|

google-analytics

|

etl

I have click stream data such as referring URL, top landing pages, top exit pages and metrics such as page views, number of visits, bounces all in Google Analytics. I am required to build a data warehouse from scratch(which I believe is known as web-house) from this data. My questions are:-

1)Is it possible? Every day data increases (some in terms of metrics or measures such as visits and some in terms of new referring sites), how would the process of loading the warehouse go about?

2)What ETL tool would help me to achieve this? Pentaho I believe has a way to pull out data from Google Analytics, has anyone used it? How does that process go? Any references, links would be appreciated besides answers.

© Stack Overflow or respective owner

Related posts about data-warehouse

PostgreSQL to Data-Warehouse: Best approach for near-real-time ETL / extraction of data

as seen on Stack Overflow - Search for 'Stack Overflow'
Background: I have a PostgreSQL (v8.3) database that is heavily optimized for OLTP. I need to extract data from it on a semi real-time basis (some-one is bound to ask what semi real-time means and the answer is as frequently as I reasonably can but I will be pragmatic, as a benchmark lets say we… >>> More
Time and date dimension in data warehouse

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm buildind an data warehouse. Each fact has it's timestamp. I need to create reports by day, month, quater but by hours too. Loking at the examples I see that dates tend to be saved in dimension tabels. But I think, that it makes no sense for time. The dimension table would grow and grow. On the… >>> More
Oracle Healthcare Data Warehouse Foundations RELEASED!

as seen on Oracle Blogs - Search for 'Oracle Blogs'
Since I joined Oracle I've been working on Oracle Healthcare Data Warehouse Foundations (OHDF). It was officially released earlier this month at HIMSS. But for over 2 months prior to that I had to keep it a secret. It was so tough; I didn't even tell my family when they asked me what I was working… >>> More
BIWA Wednesday TechCast Series - Opposition to Data Warehouse Initiatives

as seen on Oracle Blogs - Search for 'Oracle Blogs'
BIWA Wednesday TechCast Series - 19th Event! Opposition to Data Warehouse Initiatives Please join us for this webcast on Wednesday, March 24, 12 noon Eastern or check your local area's time Webcast is open to clients, prospects and partners. No matter how good your technology and technical skills… >>> More
OpenWorld on your iPad and iPhone

as seen on Oracle Blogs - Search for 'Oracle Blogs'
Most of you probably know that each year I publish a data warehouse guide for OpenWorld which contains links to the latest data warehouse videos, a calendar for the most important sessions and labs and a section that provides profiles and relevant links for all the most important data warehouse presenters… >>> More

Related posts about google-analytics

Problem with Google Analytics for Android : "Dispatcher thinks it finished, but there were 543 faile

as seen on Stack Overflow - Search for 'Stack Overflow'
Anyone know how to solve this problem? 03-23 13:03:20.585: WARN/googleanalytics(3430): Problem with socket or streams. 03-23 13:03:20.585: WARN/googleanalytics(3430): java.net.SocketException: Broken pipe 03-23 13:03:20.585: WARN/googleanalytics(3430): at org.apache.harmony.luni.platform… >>> More
Site too large to officially use Google Analytics?

as seen on Pro Webmasters - Search for 'Pro Webmasters'
We just got this email from the Google Analytics team: We love that you love our product and use it as much as you do. We have observed however, that a website you are tracking with Google Analytics is sending over 1 million hits per day to Google Analytics servers. This is well above the "5 million… >>> More
Google Analytics and Whos.amung.us in realtime visitors, why such an enormous discrepancy?

as seen on Pro Webmasters - Search for 'Pro Webmasters'
Since years I use in a site both Google Analytics and Whos.amung.us, both Google analytics and whos.amung.us javascripts are inserted in the same pages in the tracked part of the site. In real-time visitors, why such an enormous discrepancy ? for example at the moment, Google analytics gives me 9… >>> More
Change domain in Google Analytics [closed]

as seen on Server Fault - Search for 'Server Fault'
Hi, I have changed my website domain. Do I have to create another GA account or it is possible to do this in settings. Thanks in advance, Etam. >>> More
Google Analytics - Can I download the logs?

as seen on Server Fault - Search for 'Server Fault'
Can I download the raw logs of my Google Analytics data? I want to do some processing on the data. >>> More