[Database] So I'm using python to grab some data..

[Beelzebub]

... from the interblogs, and I want to /somehow/ have this data in some kind of searchable database. I'll then make the front end with C++. The problem is, I have no problems with the python regex's and such used to grab the data, I just have no experiences with databases and such.

There will be between 200,000 and 300,000 individual data entries, with each entry being (for sure) under 3kB.

Here's some more information: The data points themselves will contain a positive integer value as their identifier, and ~7 other values which will contain strings.


What my next step is to figure out how I'm data-basing this thing so I can code my python scripts to write the data in the proper form.I really don't know where to start, though.

[Jonanin]

SQLite sounds perfect for what you want to do. From the website: "SQLite is a software library that implements a self-contained, serverless, zero-configuration, transactional SQL database engine." It comes with the standard python installation.

Take a look at: http://docs.python.org/library/sqlite3.html

There are, of course, SQLite libraries for C and C++ too.

[Beelzebub]

Ah, that looks like it might be exactly what I need. I'll check it out, thanks.

[magcius]

You can also use BSDDB and CouchDB as well, which, like SQLite, are embeddable databases, but unlike SQLite, don't use SQL. They are non-relational databases that act like a big hashmap or datastore of sorts.