bitbake: toasterui: performance improvements

Improve the performance of data logging in toasterui.
We modify the data queries used to:

 * cache searching in memory
 * insert in bulk (i.e. multiple values per insert, where possible)

On development test rig (networked mysql), on no-op build,
time for data recording is reduced from 4:10 to 1:30 (minutes).

We also improve the logging, so it is easier to detect
toasterui errors.

(Bitbake rev: d42784432f927f58730caf80546c66772e0fec89)

Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>

bitbake/lib/bb/ui/toasterui.py

@@ -295,9 +295,17 @@ def main(server, eventHandler, params ):
             main.shutdown = 1
             pass
         except Exception as e:
+            # print errors to log
             logger.error(e)
             import traceback
-            traceback.print_exc()
+            exception_data = traceback.format_exc()
+
+            # save them to database, if possible; if it fails, we already logged to console.
+            try:
+                buildinfohelper.store_log_error("%s\n%s" % (str(e), exception_data))
+            except Exception:
+                pass
+
             pass
 
     if interrupted: