ItemSync: Use batch processing and allow throttling

Review Request #117471 - Created April 10, 2014 and submitted

Information
Christian Mollekopf
kdepimlibs
master
Reviewers
kdepimlibs
ItemSync: Use batch processing and allow throttling

With this patch we process the items in batches and gives resources the
possiblity to throttle the retrieval of messages using the
readyForNextBatch signal. This way we avoid using huge queries and
loading all items into memory, making the whole process a lot less
resource intensive, and make it work for large folder.
I adapted the imap resource accordingly and I can now sync 200k mail folder with the bottleneck being mysql (as it should) and no significant cpu or memory usage by akonadi-server or the imap resource. Also, unittests. 

Issues

  • 0
  • 12
  • 2
  • 14
Description From Last Updated
Daniel Vrátil
Christian Mollekopf
Daniel Vrátil
Commit Hook
This review has been submitted with commit bd303678fa111e08c73e3e0b549aced9602839ea by Christian Mollekopf to branch master.
Christian Mollekopf
Review request changed

Status: Closed (submitted)

Loading...