Dropzone stopped scanning

James T Sidebotham
James T Sidebotham Contributor
in General

Hi,

I have a lot of files that are auto-loaded when added to dropzone folders. However, that functionality seems to have stopped, even after a reboot. Could 'overloading' (with many files) a dropzone folder cause the function to stop?

I do see the following in the log file:

2026-05-12 11:04:35,061 INFO c.e.w.WebServer [WebServer Listener] Started Web Server on port 7701 (Insecure)
2026-05-12 11:04:35,061 INFO c.e.d.s.ServiceRunner [main] Started
2026-05-12 11:04:35,061 INFO c.e.d.s.ServiceRunner [WebServer Listener] Subsystem started: webserver in 2900 millis
2026-05-12 11:05:11,004 WARN i.m.c.i.i.DefaultGauge [logging-metrics-publisher] Failed to apply the value function for the gauge 'external.watcher.lastScan'. Note that subsequent logs will be logged at debug level.
java.lang.ArithmeticException: long overflow

Answers

  • James T Sidebotham
    James T Sidebotham Contributor
  • James T Sidebotham
    James T Sidebotham Contributor

    More errors related to what could be the 'directory watcher':

    2026-05-12 10:30:56,316 ERROR c.e.d.c.e.ErrorLogger [ExternalDirectoryWatcher-fe5fe977-f237-471c-a3c9-af282a4b66b7 1510737536] Context for error event 1: EnvironmentUuid=b41cb001-cb01-4f88-a057-ab720b18cc83; EnvironmentId=1; EnvironmentName=Default; SpaceUuid=4423fd84-8255-4c04-96c4-ad29be80de9a;
    2026-05-12 10:30:56,317 ERROR c.e.d.c.e.ErrorLogger [ExternalDirectoryWatcher-fe5fe977-f237-471c-a3c9-af282a4b66b7 1510737536] Error 1: 4010: Failed to load source
    com.experian.datastudio.common.exceptions.ExecutionException: 4010: Failed to load source

  • James T Sidebotham
    James T Sidebotham Contributor

    2026-05-12 10:30:56,319 INFO c.e.d.d.ExternalDirectoryWatcher [ExternalDirectoryWatcher-fe5fe977-f237-471c-a3c9-af282a4b66b7 1510737536] Failed to submit task for file: 201507_SCP Semi annual County37.xls in path: DUPMERGE_SCP. Executor is shutting down or overloaded. File will be processed in the next interval
    java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.CompletableFuture$AsyncRun@639562ea rejected from java.util.concurrent.ThreadPoolExecutor@2547da7a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55]

  • Simms, Henry
    Simms, Henry Administrator
    edited May 13

    I haven't seen this before. Please could you send full datastudio.log and monitor.log files from the past few days to our support team?

    Email: edq.support@experian.com

  • James T Sidebotham
    James T Sidebotham Contributor

    @Simms, Henry _ just sent off the logs to the support team. After a reboot today, 23 files processed but then stopped again. Maybe the logs can pinpoint what the issue is (could be resource related on the server?).

    Thanks

  • James T Sidebotham
    James T Sidebotham Contributor

    @Simms, Henry

    I sent more logs to the support team - not sure if you get them. But in the monitor log I see:

    external.watcher.activeTasks{credential=SERVICE-ACCOUNT-OSI,environment=Default,system=SAFE-DQ-XINPUT} value=1

    There are 1,000 of those in about 5 hours. My theory is that the watcher thinks it is still processing, so no more dropzones in that external system are going thru. If we could change wherever that flag is to be value=0 then I think the dropzones will start processing again. Just my guess anyway!

Categories