Fast relational Database for simple use with Python
Question: for my link scraping program, written in python3.3, i want to use a database
where i want to store the following thing:

  * around 100.000 websites, just the url, a timestamp and for each website a list with several properties

I dont have any knowledge in databases so far. By googling i found the
following database maybe fit my purposes: Postgresql, SQLite or Firebird.

Im very interested in the speed to access the database and to get the wanted
information. For example: for website x does property y exist and if yes read
it. The speed of writing is of course also important.

My question: Are there big differences in speed for the different databases or
does it not really matter for my small program? Maybe someone can tell which
database fits my requirements and is easy to handle with python.

thx alot


Answer: If speed is the main criteria, then i would suggest to go with a in-memory
database. Take a look at <http://docs.python.org/2/library/sqlite3.html>

it can be used as a normal database too, for the in-memory mode use the below
and the db should get created in the RAM itself and hence much faster run-time
access.

    
    
    import sqlite3
    conn = sqlite3.connect(':memory:')
    

