refactor: Add URI field to IngestorDocument and add new properties to…

… LocalIngestorSettings

This commit adds a new field, `URI`, to the `IngestorDocument` class, allowing for the storage of document URIs. Additionally, it introduces new properties, `matches` and `recursive`, to the `LocalIngestorSettings` class. The `matches` property represents a string pattern for matching documents, while the `recursive` property indicates whether the document listing should be done recursively. These changes enhance the functionality and flexibility of the codebase.

backend/src/main/java/ai/dragon/job/silo/ingestor/dto/IngestorDocument.java

@@ -1,5 +1,10 @@
 package ai.dragon.job.silo.ingestor.dto;
 
+import java.net.URI;
+
+import lombok.Data;
+
+@Data
 public class IngestorDocument {
-
+    private URI uri;
 }

backend/src/main/java/ai/dragon/job/silo/ingestor/dto/LocalIngestorSettings.java

@@ -8,4 +8,10 @@
 @JsonIgnoreProperties(ignoreUnknown = true)
 public class LocalIngestorSettings {
     private String localPath;
+    private String matches;
+    private boolean recursive;
+
+    public LocalIngestorSettings() {
+        recursive = false;
+    }
 }