Problem with recursion when using Get-PWFolders in large directories

I have a script which traverses all subfolders within a given master directory and extracts certain properties from the documents stored there.

It works perfectly if a master directory contains a small amount (20-40) of subfolders at various depths.

The problem starts if a master directory contains let's say 7000 subfolders - then, for some reason the script would traverse through all the subfolders and the return back to the first one ant try to repeat the process again. In addition, when the subfolders are scanned it appears that the script runs through them in some random order, i.e. in not that order that you might expect when viewing the directory tree in PWE.

In my code i attempted to label the visited folders and documents so that the recursive function does not process them again, but it doesnt help. 

I repeat - the script works perfectly well if the directory contains a small amount of subfolders.

Does anyone has any tips on how to properly traverse through large directory trees in PW datasource?

I am using pwps_dab v23.2.6   and powershell v5.1

Here is my code:

<...datasource, login and other initial setup omitted...>

#store already visited folders and docs in hashtable
$processedFolders = @{}
$uniqueDocs = @{}

function Get-DocumentsRecursive {
param (
[string]$folderPath
)

if ($processedFolders[$folderPath]) {
return
}

Write-Host "Now processing documents in: $folderPath"

# Mark the current folder as processed
$processedFolders[$folderPath] = $true

$docs = Get-PWDocumentsBySearch -Folderpath $folderPath -GetAttributes

foreach ($doc in $docs) {
$guid = $doc.DocumentGUID
if (-not $uniqueDocs[$guid]) {
$uniqueDocs[$guid] = $doc
}
}

# Get only immediate subfolders, excluding the current folder so that we are not stuck forever in the very first folder
$subfolders = Get-PWFolders -FolderPath $folderPath -Slow -Verbose | Where-Object { $_.FullPath.TrimEnd('\') -ne $folderPath.TrimEnd('\') }

foreach ($subfolder in $subfolders) {
Get-DocumentsRecursive -folderPath $subfolder.FullPath
}
}

$masterFolderPath = '\Companyname\Region\PS6_Garla-P'+[char]0x00E4+'rnu\02_HCL\03_Deliverables\05_Master_Designs\ABC\'
Get-DocumentsRecursive -folderPath $masterFolderPath

$attributeMap = @{
"PROP:CreateDate" = "Creation Date";
"PROP:DocumentCreatorName" = "Created By";
"PROP:Name" = "File Name";
"PROP:FolderPath" = "Folder Name";
"PROP:ProjectID" = "Folder ID";
"PROP:DocumentGUID" = "Document GUID";
"PROP:WorkflowState" = "State";
"PROP:Version" = "Version";
"CA:dc_document_no" = "File Number";
"CA:tb_title_line_1" = "Deliverable (Title)";
"CA:pw_doc_description" = "Document Description";
"CA:qa_doc_no_status" = "Doc_No_Status";
"CA:pw_deliverable" = "Is Deliverable";
"CA:a_attrno" = "Attribute Record ID"
}

$results = New-Object 'System.Collections.Generic.List[PSCustomObject]'

foreach ($guid in $uniqueDocs.Keys) {
$document = $uniqueDocs[$guid]
$row = [ordered]@{} # to maintain the order of properties
foreach ($key in $attributeMap.Keys) {
$userFriendlyName = $attributeMap[$key]

if ($key -like "CA:*") {
$actualKey = $key -replace "CA:"
$value = $document.CustomAttributes[$actualKey]
} elseif ($key -like "PROP:*") {
$actualKey = $key -replace "PROP:"
$value = $document.$actualKey
} else {
continue
}
$row[$userFriendlyName] = $value
}
$results.Add([PSCustomObject]$row)
}


$results | Export-Excel -Path ".\Output.xlsx" -WorksheetName "Documents" -AutoSize -FreezeTopRow

$sw.Stop()

Write-Host 'Total script run time: ' $sw.Elapsed


Undo-PWLogin