Feature #1077
New InputData rappresentation: an in-memory database.
0%
Description
With an in-memory database we can do complex query on the inputdata nearly real-time. The database better to be a zero-configuration one. The DAS database could not be used because it doesn't satisfy the realtime constraint.
Sub-tasks:
- We need a use case for this feature more complex then "select * from A where id == 0".
Files
Updated by Andrea Zoli about 11 years ago
- File sqlite3test.py sqlite3test.py added
A solution like sqlite3 has been tested.
sqlite3 execution limits:
SQLITE_MAX_COLUMN(Maximum Number Of Columns) 2000
SQLITE_MAX_VARIABLE_NUMBER(Maximum Number Of Host Parameters In A Single SQL Statement) 999
Test results:
Insert of 2000*500 rows and 1 column: Time Taken: 4.686 sec
Insert of 500 rows and 999 columns: Time Taken: 0.102 sec
Attached the script used for testing.
TODO:
- Additional infiniDB or mongoDB proposed by Luciano Nicastro need to be tested.
Updated by Andrea Zoli about 11 years ago
- Priority changed from Normal to Low
It's a long road.. not a major priority.