Skip to content

Commit 11450ae

Browse files
committed
docs: fix FileSystem Listing section (#246)
Resolves: #246
1 parent c836ded commit 11450ae

File tree

1 file changed

+16
-6
lines changed

1 file changed

+16
-6
lines changed

docs/content/en/docs/Developer Guide/file-system-listing.md

Lines changed: 16 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
date: 2022-02-23
2+
date: 2022-04-13
33
title: "FileSystem Listing"
44
linkTitle: "FileSystem Listing"
55
weight: 30
@@ -115,7 +115,7 @@ The `IgnoreHiddenFileFilter` can be used to filter hidden files from being read.
115115
**Configuration example**
116116

117117
```properties
118-
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.IgnoreHiddenFileListFilter
118+
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.fs.filter.IgnoreHiddenFileListFilter
119119
```
120120

121121
{{% alert title="Limitation" color="warning" %}}
@@ -124,20 +124,30 @@ This filter is only supported by the `LocalFSDirectoryListing`.
124124

125125
### LastModifiedFileFilter
126126

127-
The `LastModifiedFileFilter` can be used to filter files that have been modified to recently based on their last modified date property.
127+
The `LastModifiedFileFilter` can be used to filter all files that have been modified to recently based on their last modified date property.
128128

129129
```properties
130-
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.LastModifiedFileFilter
130+
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.fs.filter.LastModifiedFileFilter
131131
# The last modified time for a file can be accepted (default: 5000)
132132
file.filter.minimum.age.ms=10000
133133
```
134134

135135
### RegexFileFilter
136136

137-
The `RegexFileFilter` can be used to filter files that do not match the specified regex.
137+
The `RegexFileFilter` can be used to filter all files that do not match the specified regex.
138138

139139
```properties
140-
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.scanner.local.filter.RegexFileListFilter
140+
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.fs.filter.RegexFileListFilter
141141
# The regex pattern used to match input files
142142
file.filter.regex.pattern="\\.log$"
143+
```
144+
145+
### SizeFileListFilter
146+
147+
The `SizeFileListFilter` can be used to filter all files that are smaller or larger than a specific byte size.
148+
149+
```properties
150+
fs.listing.filters=io.streamthoughts.kafka.connect.filepulse.fs.filter.RegexFileListFilter
151+
file.filter.minimum.size.bytes=0
152+
file.filter.maximum.size.bytes=9223372036854775807
143153
```

0 commit comments

Comments
 (0)