Optimizing Ingestion of Large Files
If your delimited text files are very large, consider using the -split_input
option. When this option is true, mlcp attempts to break each input file into multiple splits, enabling more documents to be loaded in parallel. For details, see Improving Throughput with -split_input.