The directory has 20k folders in it. In these folders there are subfolders and some files. I don't need to look into the subfolders. I need to get all the files with .EIA extension from the folders.
I know I could use Get-Item, Get-ChildItem for this but these cmdlet are too slow in the getting the data. Also, this script has to run every hour therefore, it cannot be taking superlong.
I was trying to use [System.IO.File]::GetFiles($path)
but this gives an error
Method invocation failed because [System.IO.File] does not contain a method named 'GetFile'
I have also tried
$pathEia = "\\Sidney2\MfgLib\AidLibTest\*\*.EIA"
[System.IO.File]::GetFiles($pathEia)
This also throws an error:
Exception calling "GetFiles" with "1" argument(s): "The filename, directory name, or volume label
| syntax is incorrect. : '\\Sidney2\MfgLib\AidLibTest\*\*.EIA'"
I am using PowerShell Core 7.2 .Net Framework 4.8 Any help is appreciated. Thanks in advance.
CodePudding user response:
Try the following:
$path = '\\Sidney2\MfgLib\AidLibTest'
$allFilesOfInterest =
foreach ($dir in [System.IO.Directory]::GetDirectories($path)) {
[System.IO.Directory]::GetFiles($dir, '*.EIA')
}
Note the two-step approach - get subdirectories first, then examine their files - because I'm not aware of a standard .NET API that would allow you to process wildcards across levels of the hierarchy (e.g.,
\\Sidney2\MfgLib\AidLibTest\*\*.EIA'
).If you need more control over the enumeration of the files and directories, the
GetDirectories
andGetFiles
methods offer overloads that accept aSystem.IO.EnumerationOptions
instance, but, unfortunately, in PowerShell (Core) 7 / .NET (Core) only:- Windows PowerShell / .NET Framework only offers overloads with a
System.IO.SearchOption
instance, but the only thing that controls is whether the enumeration is recursive.
- Windows PowerShell / .NET Framework only offers overloads with a
The above stores the full paths of the matching files in
$allFilesOfInterest
; if you only want the file names, runSplit-Path -Leaf $allFilesOfInterest
CodePudding user response:
Very similar to mklement0's helpful answer but using the instance methods from DirectoryInfo
and multi-threading with ForEach-Object -Parallel
.
This answer requires PowerShell Core 7 .
# Skip the following Attributes:
# 2. Hidden
# 4. System
# 1024. ReparsePoint
# 512. SparseFile
$enum = [System.IO.EnumerationOptions]@{
RecurseSubdirectories = $false # Set to `$true` if you need to do a recursive search
AttributesToSkip = 2, 4, 1024, 512
}
$start = [IO.DirectoryInfo]::new('\\Sidney2\MfgLib\AidLibTest')
$result = $start.EnumerateDirectories() | ForEach-Object -Parallel {
$_.GetFiles('*.EIA', $using:enum)
}
$result | Format-Table