Drop Zone Configuration - Occasionally dropped files are not picked up

mpclark
mpclark Member
in Support

Howdy,

I have been dealing with a slight issue with a server drop zone setup we use for a specific workflow. Most times we have no issues… but then randomly a file will be dropped and it will just sit - it is not being read at all as it just stays in the root directory (doesnt trigger an error and create the error folder/move the file).

The only way I have found to correct this issue is to disable drop zone capability for that specific dataset and then reenable it. After dropping the file again all works!

I am curious as to what may be causing this. Perhaps linked to changing/upgrading Aperture? A setting of some kind? Magic?

If anyone has any insight on how to better manage this without this headache I would be greatly appreciative!

Comments

  • James T Sidebotham
    James T Sidebotham Contributor

    I would see if the system log had anything in there. Also, I have had an issue before where a file schema was incorrect for 1 file, and that seemed to stop other files loading. Correcting the broken schema seemed to allow the service to continue.

  • mpclark
    mpclark Member

    I will check the logs and see if I see anything there. Generally a broken schema / file type issue would dump out an error, but odder things have happened :P Thanks!

  • mpclark
    mpclark Member
    edited June 24

    There were hundreds of lines of this… looks like they tried initially with CSV (which is the appropriate format) .. it generated all these errors but didnt pull a file or throw it in the error folder. Then a .xlsx was tried (can see from logs)… then I was called into this.. Stopped drop zone .. reenabled and then dropped the .csv and everything worked.

    **Perhaps it is expecting this to copy to another locale as referenced (the temp dir) a setting on the server may be preventing this?

    2025-06-24 13:23:57,328 ERROR c.e.d.c.i.w.DirectoryWatcher [DirectoryWatcher-BulkHHmoveSource 980570494] Catching
    java.nio.file.NoSuchFileException: C:\ApertureDataStudio\data\datasetdropzone\Production\SharedSpaceTesting\BulkHHmoveSource\Bulk HH Move Source 062525.csv -> C:\ApertureDataStudio\data\temp\shared\datasetdropzoneinprogress\f05752e9-b4c0-420e-a7e2-6e6d0d0e974e..csv
    at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:85) ~[?:?]
    at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103) ~[?:?]
    at java.base/sun.nio.fs.WindowsFileCopy.move(WindowsFileCopy.java:403) ~[?:?]
    at java.base/sun.nio.fs.WindowsFileSystemProvider.move(WindowsFileSystemProvider.java:293) ~[?:?]
    at java.base/java.nio.file.Files.move(Files.java:1432) ~[?:?]
    at com.experian.datastudio.common.security.VerifiedPath.moveFromSource(VerifiedPath.java:485) ~[commoncore-3.0.0.jar:?]
    at com.experian.datastudio.common.io.watcher.DirectoryWatcher.fileIsQuiescent(DirectoryWatcher.java:159) [common-3.0.0.jar:?]
    at com.experian.datastudio.common.io.watcher.DirectoryWatcher.runImpl(DirectoryWatcher.java:99) [common-3.0.0.jar:?]
    at com.experian.datastudio.common.metrics.MonitoredThread.run0(MonitoredThread.java:56) [common-3.0.0.jar:?]
    at com.experian.datastudio.common.metrics.MonitoredThread.run(MonitoredThread.java:40) [common-3.0.0.jar:?]

  • Josh Boxer
    Josh Boxer Administrator

    Hello, please create a Support ticket and include details like your Aperture Data Studio version. Thanks

  • mpclark
    mpclark Member

    Will do Josh! Thanks for the review.

Categories