Fast Data Masker Shuffle Function Limit

Document ID : KB000123033
Last Modified Date : 14/12/2018
Show Technical Document Details
Question:
We have been working with the Shuffle Function in FDM, and it appears the function shuffles only does 1,000 row at the time. Is it possible to do 10,000 or 100,000 at the time? 
Answer:
FDM shuffles all the rows in one go, but we only write 1,000 rows at a time to an intermediate seed table.This is hard-coded and is not configurable. Increasing the number of rows we write to the the seed table will not make any fuctional difference. Keep in mind that FDM is still a 32-bit application, thus we need to be cautious not to cause a condition where we exceed the 2GB memory limit set by the Windows OS.