Timeout during export
I have a workflow that is exporting to a new table in an external database, using the option to create a new table. There are approximately 500,000 records and 7 columns.
The export seemed to be writing extremely slowly, and Aperture timed out whilst writing. I had no way of telling what Aperture had "written" to the table, or if it was continuing to write, because the settings were set up to commit changes at the very end. The monitoring section in Aperture did show a percentage complete but this was below 20% even after around 20 minutes.
I cancelled the job and decided to write to a CSV on my local PC, in the hope that it would be quicker, and it completed the export to CSV in half an hour. The final file size is around 49MB. Given that this is a simple text file I was hoping it would be quite a bit faster than that. I had checked to ensure that this time was not taken up by processing steps in the workflow, and the processing element had already finished. Only the write element was taking this time. I was also making an effort to ensure that Aperture didn't time out as I don't know if this would have an impact, and I didn't want to lose time by having to re-run a large export.
My questions are this: does Aperture continue with exports or processing workflows even if the user has timed out or logged out of Aperture? Does it continue as long as the service is running? Is this write speed typical? Could it be made quicker?
I am having to re-run this workflow where some records are changing, so I have changed the export setting to "Update" changed records in the external database, to see if this would be any quicker than extracting everything into CSV and importing it manually. There are around 200k records that need one text value changing. In around 90 minutes, the progress indicator has reached 3%. This is painful to see, and I think it needs to be addressed as soon as possible.