Tuesday, July 19, 2011

Click flow analysis

Currently, about 30G of click records are logged. About 80M rows of records. For the first version, We'll get the basic PV PU etc.
We use the perl script to do the job for now.

And we find a good module called module bigint
Unlike integer, this pragma creates integer constants that are only limited in their size by the available memory and CPU time.

Since we can use the database to do calculation. The script will only nomolize the records and then load into the database.

We can defined the format of to be loaded data now.

No comments: