Very large database, very small portion most being retrieved in real time
Posted
by ming yeow
on Stack Overflow
See other posts from Stack Overflow
or by ming yeow
Published on 2010-05-20T17:30:49Z
Indexed on
2010/05/20
17:40 UTC
Read the original article
Hit count: 998
Hi folks, I have an interesting database problem. I have a DB that is 150GB in size. My memory buffer is 8GB.
Most of my data is rarely being retrieved, or mainly being retrieved by backend processes. I would very much prefer to keep them around because some features require them.
Some of it (namely some tables, and some identifiable parts of certain tables) are used very often in a user facing manner
How can I make sure that the latter is always being kept in memory? (there is more than enough space for these)
More info: We are on Ruby on rails. The database is MYSQL, our tables are stored using INNODB. We are sharding the data across 2 partitions. Because we are sharding it, we store most of our data using JSON blobs, while indexing only the primary keys
© Stack Overflow or respective owner
