What database platform should I use?

What database platform should I use?

Question by Joe: What database platform should I use?
I'm trying to collect forex market data for a relatively centralized database. There is already a ready network of ready contributors into this database, and--at its peak--I'm currently expecting about 1,000 INSERT queries a minute.

My current solution involves a MySQL database with matching php scripts.

The current structure is as follows:

There are three databases:
DB1: Holds only the current week's data.
DB2: Holds all data
DB3: Backs up DB2

Every Saturday, a cron job runs a php script which does the following:
1) Export all the data in DB1 to a csv file and save the file locally on the server.
2) Add data in DB1 to DB2
3) Order data in DB2 by the tick's timestamp
4) Back up DB2 to DB3
5) Delete data in DB1

All of the above used to run on a shared host, and--as expected--I hit the limit of the unlimited service. I would like to use the shared host, but I would consider a locally hosted server, or some other cheap solution.

My question:

Is there a better way to do what I'm trying to do?


Best answer:

Answer by Germann A
1000 inserts per minute is a LOT for forex...
How many currencies are you tracking here?

1000 recs / min = 60K recs / hour = 1.44M recs / day
I suspect that you hit a limit of DB usage, most shared hosts will allow few 10-100MB of DB data
You best option may be colocation hosting http://www.google.co.uk/search?q=colocation+hosting&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a

What do you think? Answer below!